Place recognition is a fundamental technology for vehicle localization. LiDAR-based methods could work under visual appearance-changing conditions, such as season or weather changes, and different times of a day. However, these methods require every vehicle to be equipped with a 3-D LiDAR during the online localization stage, resulting in high costs for the vehicles. To alleviate this issue, we propose a cross-modal place recognition network, which can localize vehicles with visual images obtained from a low-cost monocular camera against a pre-built LiDAR point-cloud database. To this end, we first bridge the modality gap between visual images and point clouds via modality alignment. Then, we propose an orientation voting module to suppress the recognition ambiguity caused by the inconsistent field-of-view between images and point clouds, thereby improving the place recognition accuracy. Experiments are conducted with three public datasets: KITTI, KITTI-360, and Oxford RobotCar, covering over 71.6 KM of vehicle trajectories in 12 urban and suburban regions in two countries. The results demonstrate the superiority of our network.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    C2L-PR: Cross-Modal Camera-to-LiDAR Place Recognition via Modality Alignment and Orientation Voting


    Contributors:

    Published in:

    Publication date :

    2025-02-01


    Size :

    7375581 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English





    Robust lidar to camera sensor alignment

    OMAR YAHYA A / YU HAO / ZHANG WENDE | European Patent Office | 2024

    Free access

    A Comprehensive Approach for Camera/LIDAR Frame Alignment

    Bouain, Mokhtar / Berdjag, Denis / Fakhfakh, Nizar et al. | Springer Verlag | 2019


    EventAlign: LiDAR-Event Camera Calibration with Event Alignment Loss

    Dong, Pengfei / Hai, Renwei / Shen, Yanqing et al. | IEEE | 2024