With the emerging connected-vehicle technologies and smart roadways, the need for intelligent adaptive traffic signal controls (ATSC) is more than ever before. This paper first proposes an Accumulated Exponentially Weighted Waiting Time-based Adaptive Traffic Signal Control (AEWWT-ATSC) model to calculate priorities of roadways for signal scheduling. As the size of the traffic network grows, it adds great complexities and challenges to computational efficiencies. Considering this, we propose a novel Distributed Multi-agent Reinforcement Learning (DMARL) with a graph decomposition approach for large-scale ATSC problems. The decomposition clusters intersections by the level of connectivity (LoC), defined by the average residual capacities (ARC) between connected intersections, enabling us to train subgraphs instead of the entire network in a synchronized way. The problem is formulated as a Markov Decision Process (MDP), and the Double Dueling Deep Q Network with Prioritized Experience Replay is utilized to solve it. Under the optimal policy, the agents can select the optimal signal durations to minimize the waiting time and queue size. In evaluation, we show the superiority of the AEWWT-ATSC based RL methods in different densities and demonstrate the DMARL with a graph decomposition approach on a large graph in Manhattan, NYC. The approach is generic and can be extended to various types of use cases.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A Distributed Multi-Agent Reinforcement Learning With Graph Decomposition Approach for Large-Scale Adaptive Traffic Signal Control


    Contributors:


    Publication date :

    2022-09-01


    Size :

    3053826 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Multi-Agent Deep Reinforcement Learning for Large-Scale Traffic Signal Control

    Chu, Tianshu / Wang, Jie / Codeca, Lara et al. | IEEE | 2020


    Multi-agent reinforcement learning method for fair adaptive traffic signal control

    ZHANG CHENGWEI / FANG WANQING / ZHAO XINTIAN | European Patent Office | 2023

    Free access

    Adaptive traffic signal control method based on multi-agent reinforcement learning

    ZHANG CHENGWEI / JIN SHAN / ZHENG KANGJIE | European Patent Office | 2021

    Free access

    Multi-agent reinforcement learning for integrated and networked adaptive traffic signal control

    EL-TANTAWY SAMAH / ABDULHAI BAHER | European Patent Office | 2017

    Free access

    MULTI-AGENT REINFORCEMENT LEARNING FOR INTEGRATED AND NETWORKED ADAPTIVE TRAFFIC SIGNAL CONTROL

    EL-TANTAWY SAMAH / ABDULHAI BAHER | European Patent Office | 2018

    Free access