Despite significant progress in RGB-D based road segmentation in recent years, the latest methods cannot achieve both state-of-the-art accuracy and real time due to the high-performance reliance on heavy structures. We argue that this reliance is due to unsuitable multimodal fusion. To be specific, RGB and depth data in road scenes are each sensitive to different regions, but current RGB-D based road segmentation methods generally combine features within sensitive regions which preserves false road representation from one of the data. Based on such findings, we design an Evidence-based Road Segmentation Method (Evi-RoadSeg), which incorporates prior knowledge of the modal-specific characteristics. Firstly, we abandon the cross-modal fusion operation commonly used in existing multimodal based methods. Instead, we collect the road evidence from RGB and depth inputs separately via two low-latency subnetworks, and fuse the road representation of the two subnetworks by taking both modalities’ evidence as a measure of confidence. Secondly, we propose an RGB-D data augmentation scheme tailored to road scenes to enhance the unique properties of RGB and depth data. It facilitates learning by adding more sensitive regions to the samples. Finally, the proposed method is evaluated on the widely used KITTI-road, ORFD, and R2D datasets. Our method achieves state-of-the-art accuracy at over 70 FPS, $5\times $ faster than comparable RGB-D methods. Furthermore, extensive experiments illustrate that our method can be deployed on a Jetson Nano 2GB with a speed of 8+ FPS. The code will be released in https://github.com/xuefeng-cvr/Evi-RoadSeg.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Evidence-Based Real-Time Road Segmentation With RGB-D Data Augmentation


    Beteiligte:
    Xue, Feng (Autor:in) / Chang, Yicong (Autor:in) / Xu, Wenzhuang (Autor:in) / Liang, Wenteng (Autor:in) / Sheng, Fei (Autor:in) / Ming, Anlong (Autor:in)


    Erscheinungsdatum :

    01.02.2025


    Format / Umfang :

    6820736 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Real-Time Method for General Road Segmentation

    Valente, Michelle / Stanciulescu, Bogdan | British Library Conference Proceedings | 2017


    Real-time method for general road segmentation

    Valente, Michelle / Stanciulescu, Bogdan | IEEE | 2017



    Real-Time Road Segmentation Using a Morphological Multi-Pipeline Processor

    Peyrard, R. / Gauthier, M. / Klein, J.-C. et al. | British Library Conference Proceedings | 1994


    Multi Path Real-time Semantic Segmentation Network in Road Scenarios

    Pengfei, Gao / Xiaolong, Tian / Cuihong, Liu et al. | Springer Verlag | 2025