Traffic congestion remains a significant challenge in modern urban networks. Autonomous driving technologies have emerged as a potential solution. Among traffic control methods, reinforcement learning has shown superior performance over traffic signals in various scenarios. However, prior research has largely focused on small-scale networks or isolated intersections, leaving large-scale mixed traffic control largely unexplored. This study presents the first attempt to use decentralized multi-agent reinforcement learning for large-scale mixed traffic control in which some intersections are managed by traffic signals and others by robot vehicles. Evaluating a real-world network in Colorado Springs, CO, USA with 14 intersections, we measure traffic efficiency via average waiting time of vehicles at intersections and the number of vehicles reaching their destinations within a time window (i.e., throughput). At 80% RV penetration rate, our method reduces waiting time from 6.17 s to 5.09 s and increases throughput from 454 vehicles per 500 seconds to 493 vehicles per 500 seconds, outperforming the baseline of fully signalized intersections. These findings suggest that integrating reinforcement learning-based control large-scale traffic can improve overall efficiency and may inform future urban planning strategies.


    Access

    Download


    Export, share and cite



    Title :

    Large-Scale Mixed-Traffic and Intersection Control using Multi-agent Reinforcement Learning


    Contributors:
    Liu, Songyang (author) / Fan, Muyang (author) / Li, Weizi (author) / Du, Jing (author) / Li, Shuai (author)

    Publication date :

    2025


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English





    Large-scale intersection management method based on multi-agent reinforcement learning

    ZHAO SHENGJIE / XUE JINWEI / DENG HAO | European Patent Office | 2023

    Free access

    Multi-agent reinforcement learning traffic signal cooperative control method considering intersection heterogeneity

    BIE YIMING / JI YUTING / JI JINHUA et al. | European Patent Office | 2024

    Free access


    Multi-Agent Deep Reinforcement Learning for Large-Scale Traffic Signal Control

    Chu, Tianshu / Wang, Jie / Codeca, Lara et al. | IEEE | 2020