Lane segmentation at night is a challenging problem in autonomous driving perception, which is beneficial to improve the robustness of the application. Existing methods has shown great performance in the benchmark dataset, however, they do not consider the bad lighting scenes in practical applications, for example, the performance of the lane segmentation algorithm will be greatly affected at night. In this paper, we propose a novel multi-modal nighttime lane segmentation algorithm, which utilizes camera and LiDAR for complementary information. We illustrate the role of image entropy in showing the distribution of light at night, and propose an adaptive entropy fusion method to obtain the spatial relationship between entropy and modalities to adapt to different lighting scenes. The features of narrow and long lanes are more likely to be lost at night, a lane feature enhancement module is proposed to enhance the network's ability to capture lane features. Extensive experiments and analysis demostrate the effectiveness of our method against the state-of-the-art semantic segmentation and lane segmentation approaches on SHIFT dataset at night. Extensive experiments conducted on SHIFT dataset at night demonstrate that the proposed method achieves the state-of-the-art performance, 88.36%@14.06fps and 87.24%@26.88fps on SHIFT dataset at night, having the capability for real-time applications.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Adaptive Entropy Multi-Modal Fusion for Nighttime Lane Segmentation


    Contributors:
    Zhang, Xinyu (author) / Yin, Xiangchen (author) / Gao, Xin (author) / Qiu, Tianheng (author) / Wang, Li (author) / Yu, Guizhen (author) / Wang, Yunpeng (author) / Zhang, Guoying (author) / Li, Jun (author)

    Published in:

    Publication date :

    2024-11-01


    Size :

    4958710 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Lane mark segmentation method based on maximum entropy

    Yu Tianhong, / Wang Rongben, / Jin Lisheng, et al. | IEEE | 2005


    Lane Mark Segmentation Method Based on Maximum Entropy

    Yu, T. / Wang, R. / Jin, L. et al. | British Library Conference Proceedings | 2005


    Corona segmentation for nighttime brake light detection

    Alpar, Orcan | IET | 2016

    Free access

    Nighttime lane detection and vehicle position determination based on OpenCV

    Chen, Leilei / Liu, Yingshun / Zhang, Weiye | SPIE | 2024


    Corona segmentation for nighttime brake light detection

    Alpar, Orcan | Wiley | 2016

    Free access