Compared to the modularized rule-based framework, end-to-end deep reinforcement learning (DRL) algorithms have demonstrated greater adaptability in autonomous driving (AD) scenarios. However, DRL algorithms often face challenges related to model convergence and sample dependence, which limit their applicability to complex driving tasks and lack interpretability. To address these limitations, we present a novel hybrid algorithm framework called federated learning (FL)-based distributed proximal policy optimization (FLDPPO). This framework combines modularized rule-based complex network cognition and end-to-end DRL to realize the fusion driving of the mechanism model and data. Our algorithm generates dynamic driving recommendations that guide agent learning rules, enabling the model to handle complex driving environments. In addition, FLDPPO addresses model robustness and sample dependence issues through a model confidence-based distributed multiagent aggregation architecture. By measuring model confidence, the architecture learns to effectively aggregate knowledge from each unique experience distribution. Simulation results show that the proposed FLDPPO algorithm achieves competitive performance on various benchmarks.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Complex Network Cognition-Based Federated Reinforcement Learning for End-to-End Urban Autonomous Driving


    Beteiligte:
    Cai, Yingfeng (Autor:in) / Lu, Sikai (Autor:in) / Wang, Hai (Autor:in) / Lian, Yubo (Autor:in) / Chen, Long (Autor:in) / Liu, Qingchao (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.09.2024


    Format / Umfang :

    6102696 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    A Selective Federated Reinforcement Learning Strategy for Autonomous Driving

    Fu, Yuchuan / Li, Changle / Yu, F. Richard et al. | IEEE | 2023


    Deep Federated Learning for Autonomous Driving

    Nguyen, Anh / Do, Tuong / Tran, Minh et al. | IEEE | 2022


    Urban Autonomous Driving of Emergency Vehicles with Reinforcement Learning

    Tong, Zherui / Ayala, Angel / Sandoval, Eduardo Benitez et al. | IEEE | 2023