Advanced driver assistance systems (ADAS) play a crucial role in enhancing road safety by providing timely warnings and assistance. However, drivers exhibit varying hazard perception abilities and interaction needs due to their distinct characteristics, necessitating personalized warning systems to improve user experience and acceptance. Despite most advanced systems today are able to offer personalization, they remain static based on user setting rather than updating automatically. Large Language Models (LLMs), known for their exceptional knowledge acquisition, reasoning, and human-machine interaction skills, offer a promising solution for developing more customized systems. In light of this, we developed a LLM-based Multimodal Warning system (LLM-MW), which offers personalized warnings through multimodal interaction. By interpreting the traffic environment and drivers' profiles, the system can plan multimodal warning contents and perform warnings. Our experiment results show that the LLM-MW provides a level of personalization for different drivers in various scenarios.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A LLM-based Multimodal Warning System for Driver Assistance


    Contributors:
    Xu, Zixuan (author) / Chen, Tiantian (author) / Chen, Sikai (author)


    Publication date :

    2024-09-24


    Size :

    1999967 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    ADAPTIVE WARNING MANAGEMENT FOR ADVANCED DRIVER ASSISTANCE SYSTEM (ADAS)

    ISERT CARSTEN / GRANZOW SEBASTIAN / LAI SAM | European Patent Office | 2015

    Free access

    DRIVER ASSISTANCE DEVICE, DRIVER ASSISTANCE METHOD, AND DRIVER ASSISTANCE SYSTEM

    HATO JUMPEI / ARII SHIORI / MATSUOKA BUNKEI et al. | European Patent Office | 2022

    Free access

    DRIVER-ASSISTANCE DEVICE, DRIVER-ASSISTANCE SYSTEM, AND DRIVER-ASSISTANCE PROGRAM

    NAWA KAZUNARI / HAGIYA TOSHIYUKI | European Patent Office | 2021

    Free access


    Driver assistance device, driver assistance system, and driver assistance method

    KUNIEDA NOBUYUKI / ITO YUKIKO / EMURA KOICHI et al. | European Patent Office | 2025

    Free access