Autonomous driving has made significant advancements in recent years, with reinforcement learning emerging as a promising approach for developing high-level driving policies in urban traffic scenarios. Nevertheless, one challenge encountered when utilizing reinforcement learning is the issue of suboptimal and unstable driving policy due to the Q-value overestimation. To address this challenge, we propose a novel distributional reinforcement learning method that incorporates implicit quantiles into the actor-critic framework, thereby enabling a more accurate estimation of Q-values. Another issue is the inefficiency of sample learning. To enhance the representation learning of urban traffic scenarios and improve sample efficiency, we introduce a temporal-wise attention-based model that effectively aggregates heterogeneous types of state information. Through extensive experiments, our approach demonstrates superior performance when compared to the baselines on the NoCrash and CoRL benchmarks. The results show that our proposed method not only learns improved policies but also surpasses the baselines in dense traffic scenarios, as well as obtains comparative performance in other traffic scenarios.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Heterogeneous Information Fusion-Based Distributional Reinforcement Learning for Autonomous Driving


    Beteiligte:
    Yin, Jianwen (Autor:in) / Jiang, Zhengmin (Autor:in) / Liang, Qingyi (Autor:in) / Peng, Lei (Autor:in) / Zhu, Fenghua (Autor:in) / Liu, Jia (Autor:in) / Li, Huiyun (Autor:in)


    Erscheinungsdatum :

    24.09.2024


    Format / Umfang :

    723646 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Distributional Reinforcement Learning For Automated Driving Vehicle

    Naveen, A M / Ravish, Roopa / Ranga Swamy, Shanta | IEEE | 2022



    Distributional expert demonstrations for autonomous driving

    WU SZU-HAO / JIANG SHU / CAO YU et al. | Europäisches Patentamt | 2025

    Freier Zugriff

    DISTRIBUTIONAL EXPERT DEMONSTRATIONS FOR AUTONOMOUS DRIVING

    WU SZU-HAO / JIANG SHU / CAO YU et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Navigating autonomous vehicles in uncertain environments with distributional reinforcement learning

    Xu, Shuyuan / Hao, Jiachen / Chen, Xuemei et al. | SAGE Publications | 2024