Robust semantic scene segmentation for automotive applications is a challenging problem in two key aspects: (1) labelling every individual scene pixel and (2) performing this task under unstable weather and illumination changes (e.g., foggy weather), which results in poor outdoor scene visibility. Such visibility limitations lead to non-optimal performance of generalised deep convolutional neural network-based semantic scene segmentation. In this paper, we propose an efficient end-to-end automotive semantic scene understanding approach that is robust to foggy weather conditions. As an end-to-end pipeline, our proposed approach provides: (1) the transformation of imagery from foggy to clear weather conditions using a domain transfer approach (correcting for poor visibility) and (2) semantically segmenting the scene using a competitive encoder-decoder architecture with low computational complexity (en-abling real-time performance). Our approach incorporates RGB colour, depth and luminance images via distinct encoders with dense connectivity and features fusion to effectively exploit information from different inputs, which contributes to an optimal feature representation within the overall model. Using this architectural formulation with dense skip connections, our model achieves comparable performance to contemporary approaches at a fraction of the overall model complexity.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multi-Modal Learning for Real-Time Automotive Semantic Foggy Scene Understanding via Domain Adaptation


    Contributors:


    Publication date :

    2021-07-11


    Size :

    3164952 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English





    Semantic Understanding of Foggy Scenes with Purely Synthetic Data

    Hahner, Martin / Dai, Dengxin / Sakaridis, Christos et al. | IEEE | 2019


    Rainy Night Scene Understanding With Near Scene Semantic Adaptation

    Di, Shuai / Feng, Qi / Li, Chun-Guang et al. | IEEE | 2021


    Foggy Drone Teacher: Domain Adaptive Drone Detection Under Foggy Conditions

    Guida Zheng / Benying Tan / Jingxin Wu et al. | DOAJ | 2025

    Free access