This paper investigates the potential of PaliGemma, a recently released open-source Visual-Language Model (VLM), for detecting phone-based driver distraction. We evaluate PaliGemma’s performance on the State Farm Distracted Driver Detection (SFDDD) dataset. The proposed method involves three steps: (1) generating a textual description of the input image using PaliGemma, (2) create prompts related to phone distraction based on the text description (e.g., “Is the driver distracted by talking or using the phone?”), and (3) identifying the driver’s phone use status (talking or texting) based on PaliGemma’s response. We compare the accuracy of three PaliGemma models for classifying four driver actions: texting/talking on the phone with left/right hand. All models achieved high accuracy (>95%) for most categories, with PaliGemma-3b-pt-896 achieving impressive 100% accuracy. Our findings suggest that PaliGemma VLMs offer promising potential for detecting phone distraction while driving.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Detection of Phone Distraction While Driving Using Open Visual-Language Models


    Weitere Titelangaben:

    Proceedings in Automotive Engineering


    Beteiligte:
    Chiru, Anghel (Herausgeber:in) / Covaciu, Dinu (Herausgeber:in) / Girbacia, Florin (Autor:in) / Voinea, Gheorghe Daniel (Autor:in) / Danu, Manuela Daniela (Autor:in) / Buzdugan, Ioana-Diana (Autor:in) / Duguleana, Mihai (Autor:in)

    Kongress:

    International Congress of Automotive and Transport Engineering ; 2024 ; Brasov, Romania November 06, 2024 - November 08, 2024



    Erscheinungsdatum :

    20.11.2024


    Format / Umfang :

    6 pages





    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Wearables distraction reduction while driving

    RAJENDRAN SHANTHA KUMARI / KANAGARAJ PADHU | Europäisches Patentamt | 2018

    Freier Zugriff

    WEARABLES DISTRACTION REDUCTION WHILE DRIVING

    RAJENDRAN SHANTHA KUMARI / KANAGARAJ PADHU | Europäisches Patentamt | 2017

    Freier Zugriff

    Analysis of visual distraction related to smartphone use while driving

    Fancello, Gianfranco / Serra, Patrizia / Adamu, Marta | Elsevier | 2025

    Freier Zugriff

    Predicting visual distraction using driving performance data

    Kircher, Katja / Ahlstrom, Christer | Tema Archiv | 2010


    Predicting Visual Distraction Using Driving Performance Data

    Kircher, K. / Ahlstrom, C. / Association for the Advancement of Automotive Medicine | British Library Conference Proceedings | 2008