The safe operation of automated vehicles depends on their ability to perceive the environment comprehensively. However, occlusion, sensor range, and environmental factors limit their perception capabilities. To overcome these limitations, collective perception enables vehicles to exchange information. However, fusing this exchanged information is a challenging task. Early fusion approaches require large amounts of bandwidth, while intermediate fusion approaches face interchangeability issues. Late fusion of shared detections is currently the only feasible approach. However, it often results in inferior performance due to information loss. To address this issue, we propose MR3D-Net, a dynamic multi-resolution 3D sparse voxel grid fusion backbone architecture for LiDAR-based collective perception. We show that sparse voxel grids at varying resolutions provide a meaningful and compact environment representation that can adapt to the communication bandwidth. MR3D-Net achieves state-of-the-art performance on the OPV2V 3D object detection benchmark while reducing the required bandwidth by up to 94 % compared to early fusion. Code is available at https://github.com/ekut-esIMR3D-Net


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    MR3D-Net: Dynamic Multi-Resolution 3D Sparse Voxel Grid Fusion for LiDAR-Based Collective Perception


    Contributors:


    Publication date :

    2024-09-24


    Size :

    381343 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    3D Surface Reconstruction from Voxel-based Lidar Data

    Roldao, Luis / de Charette, Raoul / Verroust-Blondet, Anne | IEEE | 2019


    Monocular localization within sparse voxel maps

    Wong, David / Kawanishi, Yasutomo / Deguchi, Daisuke et al. | IEEE | 2017


    Characterizing Perspective Error in Voxel-Based Lidar Scan Matching

    Jason H. Rife / Matthew McDermott | DOAJ | 2024

    Free access

    IMAGE AND LIDAR ADAPTIVE TRANSFORMER FOR FUSION-BASED PERCEPTION

    SADEGHIGOOGHARI MEYSAM / RAVI KUMAR VARUN / YOGAMANI SENTHIL KUMAR | European Patent Office | 2025

    Free access