Real-time semantic segmentation of street scenes is an essential and challenging task for autonomous driving systems, which needs to achieve both high accuracy and efficiency. Moreover, numerous objects and stuff at different scales in street scenes further increase the difficulty of this task. To address this challenge, we develop a lightweight and high-accuracy network termed Scale-Aware Network (SANet), which aims to selectively aggregate multi-scale features while maintaining high efficiency. In SANet, we first design a Selective Context Encoding (SCE) module, which considers the intrinsic differences of various pixels to selectively encode private contexts for each pixel, thus learning more desirable contextual features while reducing redundancy. With the context embedding in hand, we then design a Selective Feature Fusion (SFF) module to recursively fuses them with multiple features at different levels or scales to generate scale-aware features, where each feature map contains scale-specific information. Extensive experiments on challenging street scene datasets, i.e., Cityscapes and CamVid, illustrate that our SANet achieves a leading trade-off between segmentation accuracy and speed. Concretely, our method yields 78.1% mIoU at 109.0 FPS on the Cityscapes test set and 77.2% mIoU at 250.4 FPS on the CamVid test set. Code will be available at https://github.com/kaigelee/SANet.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Exploring Scale-Aware Features for Real-Time Semantic Segmentation of Street Scenes


    Contributors:
    Li, Kaige (author) / Geng, Qichuan (author) / Zhou, Zhong (author)


    Publication date :

    2024-05-01


    Size :

    4947368 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Real-Time High-Performance Semantic Image Segmentation of Urban Street Scenes

    Dong, Genshun / Yan, Yan / Shen, Chunhua et al. | IEEE | 2021



    Parallel Complement Network for Real-Time Semantic Segmentation of Road Scenes

    Lv, Qingxuan / Sun, Xin / Chen, Changrui et al. | IEEE | 2022


    Attribute-aware Semantic Segmentation of Road Scenes for Understanding Pedestrian Orientations

    Sulistiyo, M. D. / Kawanishi, Y. / Deguchi, D. et al. | IEEE | 2018


    MFNet: Multi-Feature Fusion Network for Real-Time Semantic Segmentation in Road Scenes

    Lu, Mengxu / Chen, Zhenxue / Liu, Chengyun et al. | IEEE | 2022