3D vehicle detectors based on point clouds generally have higher detection performance than detectors based on multi-sensors. However, with the lack of texture information, point-based methods get many missing detection of occluded and distant vehicles, and false detection with high-confidence of similarly shaped objects, which is a potential threat to traffic safety. Therefore, in the long run, fusion-based methods have more potential. This paper presents a multi-level fusion network for 3D vehicle detection from point clouds and images. The fusion network includes three stages: data-level fusion of point clouds and images, feature-level fusion of voxel and Bird’s Eye View (BEV) in the point cloud branch, and feature-level fusion of point clouds and images. Besides, a novel coarse-fine detection header is proposed, which simulates the two-stage detectors, generating coarse proposals on the encoder, and refining them on the decoder. Extensive experiments show that the proposed network has better detection performance on occluded and distant vehicles, and reduces the false detection of similarly shaped objects, proving its superiority over some state-of-the-art detectors on the challenging KITTI benchmark. Ablation studies have also demonstrated the effectiveness of each designed module.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    3D Vehicle Detection Using Multi-Level Fusion From Point Clouds and Images


    Beteiligte:
    Zhao, Kun (Autor:in) / Ma, Lingfei (Autor:in) / Meng, Yu (Autor:in) / Liu, Li (Autor:in) / Wang, Junbo (Autor:in) / Junior, Jose Marcato (Autor:in) / Goncalves, Wesley Nunes (Autor:in) / Li, Jonathan (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.09.2022


    Format / Umfang :

    2587783 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    ACF-Net: Asymmetric Cascade Fusion for 3D Detection With LiDAR Point Clouds and Images

    Tian, Yonglin / Zhang, Xianjing / Wang, Xiao et al. | IEEE | 2024


    Robust vehicle environment reconstruction from point clouds for irregularity detection

    Sidiya, Ahmed C. / Rubaiyat, A.H.M. / Fallah, Yaser et al. | IEEE | 2017


    Robust Vehicle Environment Reconstruction from Point Clouds for Irregularity Detection

    Cheikh Sidiya, Ahmed / Bansal, Gaurav / Shimizu, Takayuki et al. | British Library Conference Proceedings | 2017


    3D vehicle detection on an FPGA from LiDAR point clouds

    García López, Javier / Moreno-Noguer, Francesc / Agudo, Antonio | BASE | 2019

    Freier Zugriff

    CHALLENGES IN FUSION OF HETEROGENEOUS POINT CLOUDS

    Bracci, Fabio / Kühne, Stefan / Marton, Zoltan-Csaba | Deutsches Zentrum für Luft- und Raumfahrt (DLR) | 2018

    Freier Zugriff