The tradeoff between speed and accuracy is important in semantic segmentation problems, especially for resource-constrained platforms, such as intelligent vehicles. In this paper, we address this issue by proposing a well-deployed real-time semantic segmentation architecture named MLFNet. Specifically, we first build a lightweight backbone (SEFE) with a larger receptive field and multi-scale contextual representation performance to encode the pixel-level features. For better preserving target boundaries and contours, a spatial compensation branch (SPFE) is designed to gradually reduce the dimension of feature maps and refine the low-level specifics. In the decoding phase, we introduce a well-designed multi-branch fusion extractor (MBFD) for integrating the spatial details into high-level layers. Finally, the outputs from the semantic and spatial branches are fused to predict the final segmentation results. Extensive offline and online experiments have shown that our model has a superior speed and accuracy trade-off. On the Cityscapes test dataset, our model (MLFNet-Res18) achieves 71.0% mIoU with 95.1 FPS for 512 × 1024 inputs, and 72.1% mIoU with 72.2 FPS while inferring on MLFNet-Res34 model. Meanwhile, MLFNet-Res18 can reach 24.5 FPS when deployed to NVIDIA Jetson AGX Xavier and 64.0 FPS with an experimental vehicle.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    MLFNet: Multi-Level Fusion Network for Real-Time Semantic Segmentation of Autonomous Driving


    Contributors:
    Fan, Jiaqi (author) / Wang, Fei (author) / Chu, Hongqing (author) / Hu, Xiao (author) / Cheng, Yifan (author) / Gao, Bingzhao (author)

    Published in:

    Publication date :

    2023-01-01


    Size :

    6304783 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    MLRFNet: Multi-Level Real-Time Fusion Semantic Segmentation Network for Autonomous Driving

    Ma, Xiaochuan / Xun, Zhijie / Mao, Bomin et al. | IEEE | 2025





    CSNet: Cross-Stage Subtraction Network for Real-Time Semantic Segmentation in Autonomous Driving

    Elhassan, Mohammed A. M. / Zhou, Changjun / Zhu, Donglin et al. | IEEE | 2025