Deep learning techniques have been widely used in autonomous driving systems for the semantic understanding of urban scenes. However, they need a huge amount of labeled data for training, which is difficult and expensive to acquire. A recently proposed workaround is to train deep networks using synthetic data, but the domain shift between real world and synthetic representations limits the performance. In this work, a novel Unsupervised Domain Adaptation (UDA) strategy is introduced to solve this issue. The proposed learning strategy is driven by three components: a standard supervised learning loss on labeled synthetic data; an adversarial learning module that exploits both labeled synthetic data and unlabeled real data; finally, a self-teaching strategy applied to unlabeled data. The last component exploits a region growing framework guided by the segmentation confidence. Furthermore, we weighted this component on the basis of the class frequencies to enhance the performance on less common classes. Experimental results prove the effectiveness of the proposed strategy in adapting a segmentation network trained on synthetic datasets, like GTA5 and SYNTHIA, to real world datasets like Cityscapes and Mapillary.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Adversarial Learning and Self-Teaching Techniques for Domain Adaptation in Semantic Segmentation


    Contributors:

    Published in:

    Publication date :

    2020-09-01


    Size :

    3294810 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Adversarial Self-Training with Domain Mask for Semantic Segmentation

    Hsin, Hsien-Kai / Chiu, Hsiao-Chien / Lin, Chun-Chen et al. | IEEE | 2019



    Combining Semantic Self-Supervision and Self-Training for Domain Adaptation in Semantic Segmentation

    Niemeijer, Joshua / Schäfer, P. Jörg | German Aerospace Center (DLR) | 2021

    Free access


    Domain Adaptation in LiDAR Semantic Segmentation via Hybrid Learning with Alternating Skip Connections

    Corral-Soto, Eduardo R. / Rochan, Mrigank / He, Yannis Y. et al. | IEEE | 2023