Autonomous vehicles are expected to save almost half-million lives between 2035 to 2045. Moreover, since 90% of the accidents are caused by humans, 9% by weather and road conditions, and only 1% by vehicular failures, autonomous vehicles will provide much safer traffic, drastically decreasing the number of accidents. To perceive the surrounding objects and environment, autonomous vehicles depend on their sensor systems such as cameras, LiDARs, radars, and sonars. Traditionally, decision fusion is performed, implying into first individually processing each sensor’s data and then combining the processed information of the different sensors. In contrast to the traditional decision fusion of the processed information from each sensor, the raw data fusion extracts information from all sensors’ raw data providing higher reliability and accuracy in terms of object and environment perception. This paper proposes an improved sensor fusion framework based on You Only Look Once (YOLO) that jointly processes the raw data from cameras and LiDARs. To validate our framework, the dataset of the Karlsruhe Institute of Technology (KITTI) in partnership with Toyota Technical University generated using two cameras, and a Velodyne laser scanner is considered. The proposed raw data fusion framework outperforms the traditional decision fusion framework with a gain of 5% in terms of vehicle detection performance.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Sensor fusion of camera and LiDAR raw data for vehicle detection




    Publication date :

    2020-11-12


    Size :

    3752248 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Vehicle detection based on LiDAR and camera fusion

    Zhang, Feihu / Clarke, Daniel / Knoll, Alois | IEEE | 2014


    LIDAR AND CAMERA DATA FUSION FOR AUTOMATED VEHICLE

    WEI JUNQING / KIM JUNSUNG / LEE JONG HO | European Patent Office | 2018

    Free access

    Lidar and camera data fusion for automated vehicle

    WEI JUNQING / KIM JUNSUNG / LEE JONG HO | European Patent Office | 2020

    Free access

    Vehicle tracking with lane assignment by camera and lidar sensor fusion

    Weigel, Hendrik / Lindner, Philipp / Wanielik, Gerd | IEEE | 2009


    Vehicle Tracking with Lane Assignment by Camera and Lidar Sensor Fusion

    Weigel, H. / Lindner, P. / Wanielik, G. | British Library Conference Proceedings | 2009