A method for learning depth-aware keypoints and associated descriptors from monocular video for ego-motion estimation is described. The method includes training a keypoint network and a depth network to learn depth-aware keypoints and the associated descriptors. The training is based on a target image and a context image from successive images of the monocular video. The method also includes lifting 2D keypoints from the target image to learn 3D keypoints based on a learned depth map from the depth network. The method further includes estimating ego-motion from the target image to the context image based on the learned 3D keypoints.
SELF-SUPERVISED 3D KEYPOINT LEARNING FOR EGO-MOTION ESTIMATION
2021-08-05
Patent
Electronic Resource
English
IPC: | G06V / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL |
Self-supervised 3D keypoint learning for ego-motion estimation
European Patent Office | 2024
|Self-supervised 3D keypoint learning for monocular visual odometry
European Patent Office | 2024
|SELF-SUPERVISED 3D KEYPOINT LEARNING FOR MONOCULAR VISUAL ODOMETRY
European Patent Office | 2021
|KEYPOINT TRAJECTORY ESTIMATION USING PROPAGATION BASED TRACKING
British Library Conference Proceedings | 2016
|Keypoint descriptor matching with context-based orientation estimation
British Library Online Contents | 2014
|