Driving involves the processing of rich audio, visual and haptic signals to make safe and calculated decisions on the road. Human vision plays a crucial role in this task and analysis of the gaze behavior could provide some insights into the action the driver takes upon seeing an object/region. A typical representation of the gaze behavior is a saliency map. The work in this paper aims to predict this saliency map given a sequence of image frames. Strategies are developed to address important topics for video saliency including active gaze (i.e. gaze that is useful for driving), pixel- and object-level information, and suppression of non-negative pixels in the saliency maps. These strategies enabled the development of a novel pixel- and object-level saliency ground truth dataset using real-world driving data around traffic intersections. We further proposed a fully convolutional RNN architecture capable of handling time sequence image data to estimate saliency map. Our methodology shows promising results.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Learning to Attend to Salient Targets in Driving Videos Using Fully Convolutional RNN


    Contributors:


    Publication date :

    2018-11-01


    Size :

    2637138 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    What Does Visual Gaze Attend to during Driving?

    Shirpour, Mohsen / Beauchemin, Steven S. / Bauer, Michael A. | TIBKAT | 2021


    LIDAR-based driving path generation using fully convolutional neural networks

    Caltagirone, Luca / Bellone, Mauro / Svensson, Lennart et al. | IEEE | 2017


    Time Series Segmentation for Driving Scenario Detection with Fully Convolutional Networks

    Elspas, Philip / Klose, Yannick / Isele, Simon Tobias et al. | TIBKAT | 2021


    SuperCNN: A Superpixelwise Convolutional Neural Network for Salient Object Detection

    He, S. / Lau, R. W. / Liu, W. et al. | British Library Online Contents | 2015


    Learning where to attend like a human driver

    Palazzi, Andrea / Solera, Francesco / Calderara, Simone et al. | IEEE | 2017