A method of multi-sensor data fusion using deep learning is proposed for the autonomous driving system. First, the realtime road condition information is collected through the binocular camera mounted on the car model, and the road and the obstacles on the road are identified with the semantic segmentation of the deep neural network image. At the same time, supplemented with other information collected by the laser sensor and ultrasonic sensor on the car model, as well as the road information obtained by Beidou navigation, the Kalman filter parameters are optimized with deep learning and passed via algorithm fusion to the car model actuator for automatic operation. The signals collected by multiple groups of the same type of sensors on the car model are optimized by an improved Kalman filter algorithm to achieve fast and accurate output of real-time results. The actual vehicle experiment results of the smart car model show that the solution can realize tasks such as autonomous navigation and driving, automatic obstacle avoidance, automatic route planning and prediction in a variety of complex road environments, with an operating speed equivalent to 80 km/h and a safety rate of 99.8%.


    Access

    Access via TIB

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Design and Application of Autonomous Driving System based on Multi-sensor Fusion


    Contributors:
    Xie, Jingwei (author) / Li, Dan (author)

    Conference:

    ICMLCA 2021 - 2nd International Conference on Machine Learning and Computer Application ; 2021 ; Shenyang, China


    Published in:

    Publication date :

    2022-01-01


    Size :

    6 pages



    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Multi-sensor fusion for autonomous driving

    Zhang, Xinyu / Li, Jun / Li, Zhiwei et al. | TIBKAT | 2023


    Research on the Application of Multi-Sensor Fusion in Autonomous Driving

    Li, Wu / Xie, Zongzhi / He, Pengfei | IEEE | 2025


    Autonomous driving trolley device based on multi-sensor fusion slam

    ZHONG HONGLONG / JIANG HONG / ZHANG XIANGFENG et al. | European Patent Office | 2024

    Free access

    Multi-sensor fusion 3D object detection for autonomous driving

    Alaba, Simegnew Yihunie / Ball, John E. | British Library Conference Proceedings | 2023