Collaboration between autonomous vehicles and drones can enhance the efficiency and connectivity of three-dimensional transportation systems. When satellite signals are unavailable, vehicles can achieve accurate localization by matching rich ground environmental data to digital maps, simultaneously providing the auxiliary localization information for drones. However, conventional digital maps suffer from high construction costs, easy misalignment, and low localization accuracy. Thus, this paper proposes a visual point cloud map (VPCM) construction and matching localization for autonomous vehicles. We fuse multi-source information from vehicle-mounted sensors and the regional road network to establish the geographically high-precision VPCM. In the absence of satellite signals, we segment the prior VPCM on the road network based on real-time localization results, which accelerates matching speed and reduces mismatch probability. Simultaneously, by continuously introducing matching constraints of real-time point cloud and prior VPCM through improved iterative closest point matching method, the proposed solution can effectively suppress the drift error of the odometry and output accurate fusion localization results based on pose graph optimization theory. The experiments carried out on the KITTI datasets demonstrate the effectiveness of the proposed method, which can autonomously construct the high-precision prior VPCM. The localization strategy achieves sub-meter accuracy and reduces the average error per frame by 25.84% compared to similar methods. Subsequently, this method’s reusability and localization robustness under light condition changes and environment changes are verified using the campus dataset. Compared to the similar camera-based method, the matching success rate increased by 21.15%, and the average localization error decreased by 62.39%.


    Access

    Download


    Export, share and cite



    Title :

    Visual Point Cloud Map Construction and Matching Localization for Autonomous Vehicle


    Contributors:
    Shuchen Xu (author) / Kedong Zhao (author) / Yongrong Sun (author) / Xiyu Fu (author) / Kang Luo (author)


    Publication date :

    2025




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Visual Localization for Autonomous Driving using Pre-built Point Cloud Maps

    Yabuuchi, Kento / Wong, David Robert / Ishita, Takeshi et al. | IEEE | 2021


    CloudVision: DNN-based Visual Localization of Autonomous Robots using Prebuilt LiDAR Point Cloud

    Yudin, Evgeny / Karpyshev, Pavel / Kurenkov, Mikhail et al. | IEEE | 2023


    Vehicle localization by matching triangulated point patterns

    Haunert, Jan-Henrik / Brenner, Claus | Tema Archive | 2009


    Methods for multi-dimensional lane matching for autonomous vehicle localization

    NAGAPPAN MEENA / KWON HYUKSEONG / LAMPKINS JOSHUA et al. | European Patent Office | 2023

    Free access

    SaliencyVR: Saliency Matching Based Visual Relocalization for Autonomous Vehicle

    Wang, Ke / Zhao, Guoliang / Wang, Yong et al. | IEEE | 2025