With rapid development of the urbanization, how to improve the traffic lights efficiency has become an urgent issue. The traditional traffic light control is a method that calculates a series of corresponding timing parameters by optimizing the cycle length. However, fixing sequence and duration of traffic lights is inefficient for dynamic traffic flow regulation. In order to solve the above problem, this study proposes a traffic light timing optimization scheme based on deep reinforcement learning (DRL). In this scheme, the traffic lights can output an appropriate phase according to the traffic flow state of each direction at the intersection and dynamically adjust the phase length. Specifically, we first adopt Proximal Policy Optimization (PPO) to improve the convergence speed of the model. Then, we elaborate the design of state, action, and reward, with the vehicle state defined by Discrete Traffic State Encoding (DTSE) method. Finally, we conduct experiments on real traffic data via the traffic simulation platform SUMO. The results show that, compared to the traditional timing control, the proposed scheme can effectively reduce the waiting time of vehicles and queue length in various traffic flow modes.


    Access

    Download


    Export, share and cite



    Title :

    Adaptive Optimization of Traffic Signal Timing via Deep Reinforcement Learning


    Contributors:
    Zibo Ma (author) / Tongchao Cui (author) / Wenxing Deng (author) / Fengyao Jiang (author) / Liguo Zhang (author)


    Publication date :

    2021




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Traffic Signal Timing via Parallel Reinforcement Learning

    Zhao, Qian / Xu, Cheng / jin, Sheng | Springer Verlag | 2019


    Adaptive Traffic Signal Control System Using Deep Reinforcement Learning

    Agrawal, Satyam / Sharma, Ritvij / Srivastava, Pankaj et al. | IEEE | 2024


    Deep Learning vs. Discrete Reinforcement Learning for Adaptive Traffic Signal Control

    Shabestary, Soheil Mohamad Alizadeh / Abdulhai, Baher | IEEE | 2018


    Traffic signal lamp timing method, device and equipment based on deep reinforcement learning

    ZHOU JIANHONG / HUANG YUMIN / WANG YUNXIANG et al. | European Patent Office | 2023

    Free access

    RA-TSC: Learning Adaptive Traffic Signal Control Strategy via Deep Reinforcement Learning

    Du, Yu / ShangGuan, Wei / Rong, Dingchao et al. | IEEE | 2019