Human drivers instinctively reason with commonsense knowledge to predict hazards in unfamiliar scenarios and to understand the intentions of other road users. However, this essential capability is entirely missing from traditional decision-making systems in autonomous driving. In response, this paper presents DriveLLM, a decision-making framework that integrates large language models (LLMs) with existing autonomous driving stacks. This integration allows for commonsense reasoning in decision-making. DriveLLM also features a unique cyber-physical feedback system, allowing it to learn and improve from its mistakes. In real-world case studies, the proposed framework outperforms traditional decision-making methods in complex scenarios, including difficult edge cases. Furthermore, we propose a novel approach that allows the decision-making system to interact with human inputs while guarding against adversarial attacks. Empirical evaluations demonstrate that this framework responds correctly to complex human instructions.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    DriveLLM: Charting the Path Toward Full Autonomous Driving With Large Language Models


    Beteiligte:
    Cui, Yaodong (Autor:in) / Huang, Shucheng (Autor:in) / Zhong, Jiaming (Autor:in) / Liu, Zhenan (Autor:in) / Wang, Yutong (Autor:in) / Sun, Chen (Autor:in) / Li, Bai (Autor:in) / Wang, Xiao (Autor:in) / Khajepour, Amir (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.01.2024


    Format / Umfang :

    8612270 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Personalized Autonomous Driving with Large Language Models: Field Experiments

    Cui, Can / Yang, Zichong / Zhou, Yupeng et al. | IEEE | 2024


    Advancing Autonomous Driving with Large Language Models: Integration and Impact

    Ananthajothi, K / Satyaa Sudarshan, G S / Saran, J U | IEEE | 2024


    A Superalignment Framework in Autonomous Driving with Large Language Models

    Kong, Xiangrui / Braunl, Thomas / Fahmi, Marco et al. | IEEE | 2024


    Charting the electronics path

    Buchholz, K. | Tema Archiv | 1999


    Large Language Models for Human-Like Autonomous Driving: A Survey

    Li, Yun / Katsumata, Kai / Javanmardi, Ehsan et al. | IEEE | 2024