With the rapid development of intelligent vehicles and Advanced Driver-Assistance Systems (ADAS), a new trend is that mixed levels of human driver engagements will be involved in the transportation system. Therefore, necessary visual guidance for drivers is vitally important under this situation to prevent potential risks. To advance the development of visual guidance systems, we introduce a novel vision-cloud data fusion methodology, integrating camera image and Digital Twin information from the cloud to help intelligent vehicles make better decisions. Target vehicle bounding box is drawn and matched with the help of the object detector (running on the ego-vehicle) and position information (received from the cloud). The best matching result, a 79.2% accuracy under 0.7 intersection over union threshold, is obtained with depth images served as an additional feature source. A case study on lane change prediction is conducted to show the effectiveness of the proposed data fusion methodology. In the case study, a multi-layer perceptron algorithm is proposed with modified lane change prediction approaches. Human-in-the-loop simulation results obtained from the Unity game engine reveal that the proposed model can improve highway driving performance significantly in terms of safety, comfort, and environmental sustainability.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Vision-Cloud Data Fusion for ADAS: A Lane Change Prediction Case Study


    Contributors:

    Published in:

    Publication date :

    2022-06-01


    Size :

    4348358 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Lane Detection Using Computer Vision Techniques in ADAS Systems

    Mahmoud, Youssef A. / Badran, Abdelrahman B. / Mohamed, Mohamed K. et al. | IEEE | 2024


    Prediction-Uncertainty-Aware Threat Detection for ADAS: A Case Study on Lane-Keeping Assistance

    Dahl, John / de Campos, Gabriel Rodrigues / Fredriksson, Jonas | IEEE | 2023


    Optimising computer vision based ADAS: vehicle detection case study

    Nieto, Marcos / Vélez, Gorka / Otaegui, Oihana et al. | Wiley | 2016

    Free access

    MANUAL LANE BIASING MODE FOR ADAS

    HARISH SUMUKHA MYSORE / JIANG JINNING / AVADHANAM SHARATH et al. | European Patent Office | 2025

    Free access

    MANUAL LANE BIASING MODE FOR ADAS

    HARISH SUMUKHA MYSORE / JIANG JINNING / AVADHANAM SHARATH et al. | European Patent Office | 2025

    Free access