Autonomous driving based on foundation models has recently garnered widespread attention. However, the risk of hallucinations inherent in foundation models could compromise the safety and reliability of autonomous driving systems. This letter, as part of a series of reports from the Distributed/Decentralized Hybrid Workshop on Foundation/Infrastructure Intelligence (DHW-FII), aims to tackle these issues. We introduce VistaRAG, which integrates retrieval-augmented generation (RAG) technologies into autonomous driving systems based on foundation models, to address the inherent reliability challenges in decision-making. VistaRAG employs a dynamic retrieval mechanism to access highly relevant driving experience, real-time road network status, and other contextual information from external databases. This aids foundation models in informed reasoning and decision-making, thereby enhancing the safety and trustworthiness of foundation-model-based autonomous driving systems under complex traffic scenarios.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    VistaRAG: Toward Safe and Trustworthy Autonomous Driving Through Retrieval-Augmented Generation


    Contributors:
    Dai, Xingyuan (author) / Guo, Chao (author) / Tang, Yun (author) / Li, Haichuan (author) / Wang, Yutong (author) / Huang, Jun (author) / Tian, Yonglin (author) / Xia, Xin (author) / Lv, Yisheng (author) / Wang, Fei-Yue (author)

    Published in:

    Publication date :

    2024-04-01


    Size :

    230191 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Explainable AI for Safe and Trustworthy Autonomous Driving: A Systematic Review

    Kuznietsov, Anton / Gyevnar, Balint / Wang, Cheng et al. | IEEE | 2024


    ATTRACTOR: TOWARD TRUSTWORTHY AND TRUSTED AUTONOMOUS SYSTEMS

    Allen, B. D. / Alexandrov, Natalia / Puig-Navarro, Javier | TIBKAT | 2021


    ATTRACTOR: Toward Trustworthy and Trusted Autonomous Systems

    Allen, B. D. / Alexandrov, Natalia / Puig - Navarro, Javier | AIAA | 2021