Smart traffic control and management become an emerging application for Deep Reinforcement Learning (DRL) to solve traffic congestion problems in urban networks. Different traffic control and management policies can be tested on the traffic simulation. Current DRL-based studies are mainly supported by the microscopic simulation software (e.g., SUMO11https://www.eclipse.org/sumo/), while it is not suitable for city-wide control due to the computational burden and gridlock effect. To the best of our knowledge, there is a lack of studies on the large-scale traffic simulator for D RL testbeds. In view of this, we propose a meso-macro traffic simulator for very large-scale DRL scenarios. The proposed simulator integrates meso scopic and macroscopic traffic simulation models to improve efficiency and eliminate gridlocks. The meso scopic link model simulates flow dynamics on roads, and the macroscopic Bathtub model depicts vehicle movement in regions. Moreover, both types of models can be hybridized to accommodate various DRL tasks. The result shows that the developed simulator only takes 46 seconds to finish a 24-hour simulation in a very large city with 2.2 million vehicles, which is much faster than SUMO. In the future, the developed meso-macro traffic simulator could serve as a new environment for very large-scale DRL problems.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Towards a Very Large Scale Traffic Simulator for Multi-Agent Reinforcement Learning Testbeds


    Beteiligte:
    Hu, Zijian (Autor:in) / Zhuge, Chengxiang (Autor:in) / Ma, Wei (Autor:in)


    Erscheinungsdatum :

    08.10.2022


    Format / Umfang :

    2940474 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Multi-Agent Deep Reinforcement Learning for Large-Scale Traffic Signal Control

    Chu, Tianshu / Wang, Jie / Codeca, Lara et al. | IEEE | 2020


    Large-Scale Mixed-Traffic and Intersection Control using Multi-agent Reinforcement Learning

    Liu, Songyang / Fan, Muyang / Li, Weizi et al. | ArXiv | 2025

    Freier Zugriff

    CityFlow: A Multi-Agent Reinforcement Learning Environment for Large Scale City Traffic Scenario

    Zhang, Huichu / Feng, Siyuan / Liu, Chang et al. | ArXiv | 2019

    Freier Zugriff


    Dynamic traffic signal control using mean field multi‐agent reinforcement learning in large scale road‐networks

    Hu, Tianfeng / Hu, Zhiqun / Lu, Zhaoming et al. | Wiley | 2023

    Freier Zugriff