The RGB complementary metal-oxide-semiconductor (CMOS) sensor works within the visible light spectrum. Therefore it is very sensitive to environmental light conditions. On the contrary, a long-wave infrared (LWIR) sensor operating in 8-14 μm spectral band, functions independent of visible light.In this paper, we exploit both visual and thermal perception units for robust object detection purposes. After delicate synchronization and (cross-) labeling of the FLIR [1] dataset, this multi-modal perception data passes through a convolutional neural network (CNN) to detect three critical objects on the road, namely pedestrians, bicycles, and cars. After evaluation of RGB and infrared (thermal and infrared are often used interchangeably) sensors separately, various network structures are compared to fuse the data at the feature level effectively. Our RGB-thermal (RGBT) fusion network, which takes advantage of a novel entropy-block attention module (EBAM), outperforms the state-of-the-art network [2] by 10% with 82.9% mAP.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Robust Environment Perception for Automated Driving: A Unified Learning Pipeline for Visual-Infrared Object Detection


    Beteiligte:
    Vadidar, Mohsen (Autor:in) / Kariminezhad, Ali (Autor:in) / Mayr, Christian (Autor:in) / Kloeker, Laurent (Autor:in) / Eckstein, Lutz (Autor:in)


    Erscheinungsdatum :

    05.06.2022


    Format / Umfang :

    3565012 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    NeurAll: Towards a Unified Visual Perception Model for Automated Driving

    Sistu, Ganesh / Leang, Isabelle / Chennupati, Sumanth et al. | IEEE | 2019



    A Review of Testing Object-Based Environment Perception for Safe Automated Driving

    Hoß, Michael / Scholtes, Maike Eva / Eckstein, Lutz | DataCite | 2021



    TOWARDS ROBUST DIRECT PERCEPTION NETWORKS FOR AUTOMATED DRIVING

    Cheng, Chih-Hong | British Library Conference Proceedings | 2020