Bird's eye view (BEV) perception is becoming increasingly important in the field of autonomous driving. It uses multi-view camera data to learn a transformer model that directly projects the perception of the road environment onto the BEV perspective. However, training a transformer model often requires a large amount of data, and as camera data for road traffic are often private, they are typically not shared. Federated learning offers a solution that enables clients to collaborate and train models without exchanging data but model parameters. In this article, we introduce FedBEVT, a federated transformer learning approach for BEV perception. In order to address two common data heterogeneity issues in FedBEVT: (i) diverse sensor poses, and (ii) varying sensor numbers in perception systems, we propose two approaches – Federated Learning with Camera-Attentive Personalization (FedCaP) and Adaptive Multi-Camera Masking (AMCM), respectively. To evaluate our method in real-world settings, we create a dataset consisting of four typical federated use cases. Our findings suggest that FedBEVT outperforms the baseline approaches in all four use cases, demonstrating the potential of our approach for improving BEV perception in autonomous driving.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    FedBEVT: Federated Learning Bird's Eye View Perception Transformer in Road Traffic Systems


    Beteiligte:
    Song, Rui (Autor:in) / Xu, Runsheng (Autor:in) / Festag, Andreas (Autor:in) / Ma, Jiaqi (Autor:in) / Knoll, Alois (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.01.2024


    Format / Umfang :

    3924282 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Semantic Bird's-Eye View Road Line Mapping

    Bellusci, Matteo / Cudrano, Paolo / Mentasti, Simone et al. | IEEE | 2023


    Dynamic Traffic Management: A Bird’s Eye View

    Barceló, Jaume / Martínez-Díaz, Margarita | Springer Verlag | 2022


    RoadBEV: Road Surface Reconstruction in Bird’s Eye View

    Zhao, Tong / Yang, Lei / Xie, Yichen et al. | IEEE | 2024


    KERNELIZED BIRD’S EYE VIEW SEGMENTATION FOR MULTI-SENSOR PERCEPTION

    BANGALORE RAVI KIRAN / RAVI KUMAR VARUN / YOGAMANI SENTHIL KUMAR | Europäisches Patentamt | 2025

    Freier Zugriff

    BIRD'S EYE VIEW

    Online Contents | 1998