Smart traffic control and management become an emerging application for Deep Reinforcement Learning (DRL) to solve traffic congestion problems in urban networks. Different traffic control and management policies can be tested on the traffic simulation. Current DRL-based studies are mainly supported by the microscopic simulation software (e.g., SUMO11https://www.eclipse.org/sumo/), while it is not suitable for city-wide control due to the computational burden and gridlock effect. To the best of our knowledge, there is a lack of studies on the large-scale traffic simulator for D RL testbeds. In view of this, we propose a meso-macro traffic simulator for very large-scale DRL scenarios. The proposed simulator integrates meso scopic and macroscopic traffic simulation models to improve efficiency and eliminate gridlocks. The meso scopic link model simulates flow dynamics on roads, and the macroscopic Bathtub model depicts vehicle movement in regions. Moreover, both types of models can be hybridized to accommodate various DRL tasks. The result shows that the developed simulator only takes 46 seconds to finish a 24-hour simulation in a very large city with 2.2 million vehicles, which is much faster than SUMO. In the future, the developed meso-macro traffic simulator could serve as a new environment for very large-scale DRL problems.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Towards a Very Large Scale Traffic Simulator for Multi-Agent Reinforcement Learning Testbeds


    Contributors:
    Hu, Zijian (author) / Zhuge, Chengxiang (author) / Ma, Wei (author)


    Publication date :

    2022-10-08


    Size :

    2940474 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Multi-Agent Deep Reinforcement Learning for Large-Scale Traffic Signal Control

    Chu, Tianshu / Wang, Jie / Codeca, Lara et al. | IEEE | 2020


    Large-Scale Mixed-Traffic and Intersection Control using Multi-agent Reinforcement Learning

    Liu, Songyang / Fan, Muyang / Li, Weizi et al. | ArXiv | 2025

    Free access

    CityFlow: A Multi-Agent Reinforcement Learning Environment for Large Scale City Traffic Scenario

    Zhang, Huichu / Feng, Siyuan / Liu, Chang et al. | ArXiv | 2019

    Free access