Semantic segmentation is an important step of visual scene understanding for autonomous driving. Recently, Convolutional Neural Network (CNN) based methods have successfully applied in semantic segmentation using narrow-angle or even wide-angle pinhole camera. However, in urban traffic environments, autonomous vehicles need wider field of view to perceive surrounding things and stuff, especially at intersections. This paper describes a CNN-based semantic segmentation solution using fisheye camera which covers a large field of view. To handle the complex scene in the fisheye image, Overlapping Pyramid Pooling (OPP) module is proposed to explore local, global and pyramid local region context information. Based on the OPP module, a network structure called OPP-net is proposed for semantic segmentation. The net is trained and evaluated on a fisheye image dataset for semantic segmentation which is generated from an existing dataset of urban traffic scenes. In addition, zoom augmentation, a novel data augmentation policy specially designed for fisheye image, is proposed to improve the net's generalization performance. Experiments demonstrate the outstanding performance of the OPP-net for urban traffic scenes and the effectiveness of the zoom augmentation.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    CNN based semantic segmentation for urban traffic scenes using fisheye camera


    Contributors:
    Deng, Liuyuan (author) / Yang, Ming (author) / Qian, Yeqiang (author) / Wang, Chunxiang (author) / Wang, Bing (author)


    Publication date :

    2017-06-01


    Size :

    1931835 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    CNN-based Fisheye Image Real-Time Semantic Segmentation

    Saez, Alvaro / Bergasa, Luis M. / Romeral, Eduardo et al. | IEEE | 2018


    Domain-Incremental Semantic Segmentation for Traffic Scenes

    Liu, Yazhou / Chen, Haoqi / Lasang, Pongsak et al. | IEEE | 2025


    Obstacle detection based on semantic segmentation for unmanned vehicles in traffic scenes

    Liu, YunXiang / Guan, QianXun | British Library Conference Proceedings | 2022


    Real-Time High-Performance Semantic Image Segmentation of Urban Street Scenes

    Dong, Genshun / Yan, Yan / Shen, Chunhua et al. | IEEE | 2021


    A Simple Weight Recall for Semantic Segmentation: Application to Urban Scenes

    LI, Xuhong / DAVOINE, Franck / GRANDVALET, Yves | IEEE | 2018