We propose a new method for fusing LIDAR point cloud and camera-captured images in deep convolutional neural networks (CNN). The proposed method constructs a new layer called sparse non-homogeneous pooling layer to transform features between bird’s eye view and front view. The sparse point cloud is used to construct the mapping between the two views. The pooling layer allows efficient fusion of the multi-view features at any stage of the network. This is favorable for 3D object detection using camera-LIDAR fusion for autonomous driving. A corresponding one-stage detector is designed and tested on the KITTI bird’s eye view object detection dataset, which produces 3D bounding boxes from the bird’s eye view map. The fusion method shows significant improvement on both speed and accuracy of the pedestrian detection over other fusion-based object detection networks.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Fusing Bird’s Eye View LIDAR Point Cloud and Front View Camera Image for 3D Object Detection


    Contributors:


    Publication date :

    2018-06-01


    Size :

    353802 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    BEVDetNet: Bird's Eye View LiDAR Point Cloud based Real-time 3D Object Detection for Autonomous Driving

    Mohapatra, Sambit / Yogamani, Senthil / Gotzig, Heinrich et al. | IEEE | 2021


    BirdNet+: End-to-End 3D Object Detection in LiDAR Bird’s Eye View

    Barrera, Alejandro / Guindel, Carlos / Beltran, Jorge et al. | IEEE | 2020