Driving involves the processing of rich audio, visual and haptic signals to make safe and calculated decisions on the road. Human vision plays a crucial role in this task and analysis of the gaze behavior could provide some insights into the action the driver takes upon seeing an object/region. A typical representation of the gaze behavior is a saliency map. The work in this paper aims to predict this saliency map given a sequence of image frames. Strategies are developed to address important topics for video saliency including active gaze (i.e. gaze that is useful for driving), pixel- and object-level information, and suppression of non-negative pixels in the saliency maps. These strategies enabled the development of a novel pixel- and object-level saliency ground truth dataset using real-world driving data around traffic intersections. We further proposed a fully convolutional RNN architecture capable of handling time sequence image data to estimate saliency map. Our methodology shows promising results.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Learning to Attend to Salient Targets in Driving Videos Using Fully Convolutional RNN


    Beteiligte:
    Tawari, Ashish (Autor:in) / Mallela, Praneeta (Autor:in) / Martin, Sujitha (Autor:in)


    Erscheinungsdatum :

    01.11.2018


    Format / Umfang :

    2637138 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    LIDAR-based driving path generation using fully convolutional neural networks

    Caltagirone, Luca / Bellone, Mauro / Svensson, Lennart et al. | IEEE | 2017


    What Does Visual Gaze Attend to during Driving?

    Shirpour, Mohsen / Beauchemin, Steven S. / Bauer, Michael A. | TIBKAT | 2021


    Time Series Segmentation for Driving Scenario Detection with Fully Convolutional Networks

    Elspas, Philip / Klose, Yannick / Isele, Simon Tobias et al. | TIBKAT | 2021


    SuperCNN: A Superpixelwise Convolutional Neural Network for Salient Object Detection

    He, S. / Lau, R. W. / Liu, W. et al. | British Library Online Contents | 2015


    Learning where to attend like a human driver

    Palazzi, Andrea / Solera, Francesco / Calderara, Simone et al. | IEEE | 2017