For continuous performance optimization of camera sensor systems in automated driving, training data from rare corner cases occurring in series production cars are required. In this article, we propose collaborative acquisition of camera images via connected car fleets for synthesis of image sequences from arbitrary road sections which are challenging for machine vision. While allowing a scalable hardware architecture inside the cars, this concept demands to reconstruct the recording locations of the individual images aggregated in the back-end. Varying environmental conditions, dynamic scenes, and small numbers of significant landmarks may hamper camera pose estimation through sparse reconstruction from unordered road scene images. Tackling those problems, we extend a state-of-the-art Structure from Motion pipeline by selecting keypoints based on a semantic image segmentation and removing GPS outliers. We present three challenging image datasets recorded on repetitive test drives under differing environmental conditions for evaluation of our method. The results demonstrate that our optimized pipeline is able to reconstruct the camera viewpoints robustly in the majority of road scenes observed while preserving high image registration rates. Reducing the median deviation from GPS measurements by over 48% for car fleet images, the method increases the accuracy of camera poses dramatically.
Robust Camera Pose Estimation for Unordered Road Scene Images in Varying Viewing Conditions
IEEE Transactions on Intelligent Vehicles ; 5 , 1 ; 165-174
2020-03-01
4826437 byte
Article (Journal)
Electronic Resource
English
Horizon matching for localizing unordered panoramic images
British Library Online Contents | 2010
|Accelerating robust 3D pose estimation using c*-images
AIAA | 2012
|Accelerating Robust 3D Pose Estimation Using C^*-Images
British Library Conference Proceedings | 2012
|