We present a context aware object detection method based on a retrieve-and-transform scene layout model. Given an input image, our approach first retrieves a coarse scene layout from a codebook of typical layout templates. In order to handle large layout variations, we use a variant of the spatial transformer network to transform and refine the retrieved layout, resulting in a set of interpretable and semantically meaningful feature maps of object locations and scales. The above steps are implemented as a Layout Transfer Network which we integrate into Faster RCNN to allow for joint reasoning of object detection and scene layout estimation. Extensive experiments on three public datasets verified that our approach provides consistent performance improvements to the state-of-the-art object detection baselines on a variety of challenging tasks in the traffic surveillance and the autonomous driving domains.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Learning a Layout Transfer Network for Context Aware Object Detection


    Contributors:
    Wang, Tao (author) / He, Xuming (author) / Cai, Yuanzheng (author) / Xiao, Guobao (author)


    Publication date :

    2020-10-01


    Size :

    8970967 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Unknown-Aware Hierarchical Object Detection in the Context of Automated Driving

    Zhou, Jingxing / Wandelburg, Nick / Beyerer, Jurgen | IEEE | 2023


    A framework for visual-context-aware object detection in still images

    Perko, R. / Leonardis, A. | British Library Online Contents | 2010


    Context-Aware Dynamic Feature Extraction for 3D Object Detection in Point Clouds

    Tian, Yonglin / Huang, Lichao / Yu, Hui et al. | IEEE | 2022


    Context-aware object detection in aerial photographs/videos using travel path metadata

    FLORES ARTURO / KIM KYUNGNAM / OWECHKO YURI | European Patent Office | 2017

    Free access

    Context-Aware 3D Object Detection From a Single Image in Autonomous Driving

    Zhou, Dingfu / Song, Xibin / Fang, Jin et al. | IEEE | 2022