Active traffic management with autonomous vehicles offers the potential for reduced congestion and improved traffic flow. However, developing effective algorithms for real-world scenarios requires overcoming challenges related to infinite-horizon traffic flow and partial observability. To address these issues and further decentralize traffic management, we propose an asymmetric actor-critic model that learns decentralized cooperative driving policies for autonomous vehicles using single-agent reinforcement learning. By employing attention neural networks with masking, our approach efficiently manages real-world traffic dynamics and partial observability, eliminating the need for predefined agents or agent-specific experience buffers in multi-agent reinforcement learning. Extensive evaluations across various traffic scenarios demonstrate our method's significant potential in improving traffic flow at critical bottleneck points. Moreover, we address the challenges posed by conservative autonomous vehicle driving behaviors that adhere strictly to traffic rules, showing that our cooperative policy effectively alleviates potential slowdowns without compromising safety.


    Access

    Download


    Export, share and cite



    Title :

    Agent-Agnostic Centralized Training for Decentralized Multi-Agent Cooperative Driving


    Contributors:

    Publication date :

    2024


    Remarks:

    accepted by IROS 2024


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Multi-agent Actor-Critic traffic signal cooperative control method based on centralized training and decentralized execution

    ZHANG YONGNAN / PENG SIRUI / LI YUNXUAN et al. | European Patent Office | 2024

    Free access

    Swarm Cooperative Navigation Using Centralized Training and Decentralized Execution

    Rana Azzam / Igor Boiko / Yahya Zweiri | DOAJ | 2023

    Free access

    Agent-Based Cooperative Decentralized Airplane-Collision Avoidance

    Šišlák, D / Volf, P / Pěchouček, M | IEEE | 2011


    Agent-Based Cooperative Decentralized Airplane-Collision Avoidance

    Sislak, D. / Volf, P. / Pechoucek, M. | Tema Archive | 2011