Bird's Eye View (BEV) based perception algorithms are receiving increasing attention in the field of autonomous driving, how to more effectively utilize multi-sensor data in BEV is a challenge. In this paper, we propose PETRFusion, a BEV segmentation network that integrates multiple cameras with a LiDAR sensor. We focus on the task of BEV segmentation, designing the network architecture based on the similarity between LiDAR point clouds and semantic segmentation maps. The proposed method uses point cloud features as queries for semantic segmentation and employs Transformers to fuse image features with point cloud features, thereby maximizing the preservation of 3D spatial information from the point cloud. Additionally, we enhance the 3D positional encoder of PETR to provide more reliable 3D image features. We conduct detailed validation on the nuScenes dataset and achieve state-of-the-art results.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    PETRFusion: Multi-Sensor Fusion Based BEV Semantic Segmentation Network for Autonomous Driving


    Contributors:
    Zhao, Yang (author) / Du, Jingyu (author) / Yang, Qihang (author) / Cai, Ningze (author) / Peng, Zhinan (author) / Zhan, Huiqin (author) / Cheng, Hong (author)


    Publication date :

    2024-09-24


    Size :

    521931 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    MLRFNet: Multi-Level Real-Time Fusion Semantic Segmentation Network for Autonomous Driving

    Ma, Xiaochuan / Xun, Zhijie / Mao, Bomin et al. | IEEE | 2025



    RGB and LiDAR fusion based 3D Semantic Segmentation for Autonomous Driving

    El Madawi, Khaled / Rashed, Hazem / El Sallab, Ahmad et al. | IEEE | 2019