3D perception is one of the most important tasks of autonomous vehicles. Both methods based on expensive LiDAR and stereo cameras, and methods based on monocular cameras, have achieved great success in 3D object detection from vehicle view. The roadside view, as an important component of the entire intelligent transportation system, has distinct features from the vehicle's forward view. The 3D object detection from the roadside view has enormous research and application value. However, current research on 3D object detection from roadside view lags far behind the research on 3D object detection from vehicle view. Based on the work of M3D-RPN, we analyze the differences in sample space between roadside view and vehicle view. We find that although the post-optimization based on 2D-3D geometric consistency can improve 3D detection performance in the front view of the vehicle, it can reduce the performance of 3D detection in the roadside view. At the same time, to adapt to the characteristics of the roadside view, we propose a novel ray-aware convolution to replace the depth-aware convolution for the vehicle view. Compared to the M3D-RPN, our proposed M3D-RA-RPN improves the performance of monocular 3D object detection and BEV object detection on the Rope3d dataset.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Monocular 3D Ray-Aware RPN For Roadside View Object Detection


    Contributors:
    Zhang, Caiji (author) / Tian, Bin (author) / Sun, Yang (author) / Zhang, Rui (author)


    Publication date :

    2023-10-20


    Size :

    3255154 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    MonoGAE: Roadside Monocular 3D Object Detection With Ground-Aware Embeddings

    Yang, Lei / Zhang, Xinyu / Yu, Jiaxin et al. | IEEE | 2024



    Shape-Aware Monocular 3D Object Detection

    Chen, Wei / Zhao, Jie / Zhao, Wan-Lei et al. | IEEE | 2023