Driving has various risk factors, including the possibility of traffic accidents involving pedestrians and/or oncoming vehicles. A driver assistance system that can prevent traffic accidents must be able to get the driver ' s attention. A practical solution for attention attraction should involve caption generation from in-vehicle images. Although a number of approaches for caption generation with deep neural networks have been proposed, they are inadequate for the specific risk factors while driving. The reason is that conventional captioning methods focus on not these factors but the entirety of an image. To tackle this problem, we first created a dataset to attract attention, one that considers risk factors during driving. Furthermore, we propose an image captioning method for the assistance system. Our method is based on neural baby talk and introduces an attention mask focusing on risk factors in an image. The mask enables our model to generate captions on each factor. Experimental results with our created dataset show that our method can generate captions for ideal attention attraction.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Attention Neural Baby Talk: Captioning of Risk Factors while Driving


    Beteiligte:
    Mori, Yuki (Autor:in) / Fukui, Hiroshi (Autor:in) / Hirakawa, Tsubasa (Autor:in) / Nishiyama, Jo (Autor:in) / Yamashita, Takayoshi (Autor:in) / Fujiyoshi, Hironobu (Autor:in)


    Erscheinungsdatum :

    01.10.2019


    Format / Umfang :

    2582598 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Traffic Scenario Understanding and Video Captioning via Guidance Attention Captioning Network

    Liu, Chunsheng / Zhang, Xiao / Chang, Faliang et al. | IEEE | 2024


    Visual Attention While Performing Driving and Driving-Related Tasks

    Underwood, G. / Crundall, D. / Chapman, P. | British Library Conference Proceedings | 1997


    VISUAL ATTENTION WHILE PERFORMING DRIVING AND DRIVING-RELATED TASKS

    Underwood, G. / Crundall, D. / Chapman, P. | British Library Conference Proceedings | 1997


    SYSTEM AND METHOD FOR ASSESSING USER ATTENTION WHILE DRIVING

    ZILBERMAN BOAZ / VAKULENKO MICHAEL / SANDLERMAN NIMROD et al. | Europäisches Patentamt | 2017

    Freier Zugriff

    SYSTEM AND METHOD FOR ASSESSING USER ATTENTION WHILE DRIVING

    ZILBERMAN BOAZ / VAKULENKO MICHAEL / SANDLERMAN NIMROD et al. | Europäisches Patentamt | 2016

    Freier Zugriff