We consider a system to optimize duration of traffic signals using multi-agent deep reinforcement learning and Vehicle-to-Everything (V2X) communication. This system aims at analyzing independent and shared rewards for multi-agents to control duration of traffic lights. A learning agent traffic light gets information along its lanes within a circular V2X coverage. The duration cycles of traffic light are modeled as Markov decision Processes. We investigate four variations of reward functions. The first two are unshared-rewards: based on waiting number, and waiting time of vehicles between two cycles of traffic light. The third and fourth functions are: shared-rewards based on waiting cars, and waiting time for all agents. Each agent has a memory for optimization through target network and prioritized experience replay. We evaluate multi-agents through the Simulation of Urban MObility (SUMO) simulator. The results prove effectiveness of the proposed system to optimize traffic signals and reduce average waiting cars to 41.5 % as compared to the traditional periodic traffic control system.


    Access

    Download


    Export, share and cite



    Title :

    Optimizing Traffic Lights with Multi-agent Deep Reinforcement Learning and V2X communication


    Contributors:
    Hussain, Azhar (author) / Wang, Tong (author) / Jiahua, Cao (author)

    Publication date :

    2020


    Remarks:

    7 Figure, Table 1


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Communicate with Traffic Lights and Vehicles Based on Multi-Agent Reinforcement Learning

    Wu, Qiang / Zhi, Peng / Wei, Yongqiang et al. | IEEE | 2021


    Road Traffic: Deep Q-learning Agent Control Traffic lights in the intersection.

    Chouiekh, Chaymae / Yahyaouy, Ali / Aarab, Abdellah et al. | IEEE | 2022



    Signal Synchronization of Traffic Lights Using Reinforcement Learning

    Aydin, Ilhan / Sevi, Mehmet / Gungoren, Gurbet et al. | IEEE | 2022