In this paper, we propose a multi-object tracking and reconstruction approach through measurement-level fusion of LiDAR and camera. The proposed method, regardless of object class, estimates 3D motion and structure for all rigid obstacles. Using an intermediate surface representation, measurements from both sensors are processed within a joint framework. We combine optical flow, surface reconstruction, and point-to-surface terms in a tightly-coupled non-linear energy function, which is minimized using Iterative Reweighted Least Squares (IRLS). We demonstrate the performance of our model on different datasets (KITTI with Velodyne HDL-64E and our collected data with 4-layer ScaLa Ibeo), and show an improvement in velocity error and crispness over state-of-the-art trackers.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Velocity and shape from tightly-coupled LiDAR and camera


    Contributors:


    Publication date :

    2017-06-01


    Size :

    1066111 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Velocity and Shape from Tightly-Coupled LiDAR and Camera

    Daraei, M. Hossein / Vu, Anh / Manduchi, Roberto | British Library Conference Proceedings | 2017


    Efficient and Accurate Tightly-Coupled Visual-Lidar SLAM

    Chou, Chih-Chung / Chou, Cheng-Fu | IEEE | 2022


    Hierarchical Distribution-Based Tightly-Coupled LiDAR Inertial Odometry

    Wang, Chengpeng / Cao, Zhiqiang / Li, Jianjie et al. | IEEE | 2024


    InLIOM: Tightly-Coupled Intensity LiDAR Inertial Odometry and Mapping

    Wang, Hanqi / Liang, Huawei / Li, Zhiyuan et al. | IEEE | 2024