While autonomous intersection management (AIM) emerges to facilitate signal-free scheduling for connected and autonomous vehicles (CAVs), several challenges arise for planning secure and swift trajectories. Existing works mainly focus on addressing the challenge of multi-CAV interaction complexity. In this context, multi-agent reinforcement learning-based (MARL) methods exhibit higher scalability and efficiency compared with other traditional methods. However, current AIM methods omit discussions on the practical challenge of CAV heterogeneity. As CAVs exhibit different dynamics features and perception capabilities, it is inappropriate to adapt identical control schemes. Besides, existing MARL methods that lack heterogeneity adaptability may experience a performance decline. In response, this paper exploits MARL to model the decision-making process among CAVs and proposes a novel heterogeneous-agent attention gated trust region policy optimization (HAG-TRPO) method. The proposed method can accomplish more effective and efficient AIM with CAV discrepancies by applying a sequential update schema that boosts the algorithm adaptability for MARL tasks with agent-level heterogeneity. In addition, the proposed method utilizes the attention mechanism to intensify vehicular cognition on disordered ambience messages, as well as a gated recurrent unit for temporal comprehension on global status. Numerical experiments verify that our method results in CAVs passing at the intersection with fewer collisions and faster traffic flow, showing the superiority of our method over existing benchmarks in terms of both traffic safety and efficiency.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Autonomous Intersection Management with Heterogeneous Vehicles: A Multi-Agent Reinforcement Learning Approach


    Contributors:
    Chen, Kaixin (author) / Li, Bing (author) / Zhang, Rongqing (author) / Cheng, Xiang (author)


    Publication date :

    2024-06-02


    Size :

    3977908 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    MULTI-AGENT REINFORCEMENT LEARNING FOR AUTONOMOUS ON DEMAND VEHICLES

    Boyali, Ali / Hashimoto, Naohisa / John, Vijay et al. | British Library Conference Proceedings | 2019


    Multi-agent reinforcement learning for autonomous vehicles: a survey

    Dinneweth, Joris / Boubezoul, Abderrahmane / Mandiau, René et al. | Springer Verlag | 2022

    Free access

    Multi-agent reinforcement learning for autonomous vehicles: a survey

    Joris Dinneweth / Abderrahmane Boubezoul / René Mandiau et al. | DOAJ | 2022

    Free access

    Multi-Agent Reinforcement Learning for Autonomous On Demand Vehicles

    Boyali, Ali / Hashimoto, Naohisa / John, Vijay et al. | IEEE | 2019