The invention provides a distributed multi-agent traffic signal cooperative control method, and belongs to the field of intelligent traffic control. The method comprises the steps of performing initialization operation on a road network environment, constructing an adjacency list according to a topological structure of an urban road network, and regarding each traffic signal lamp control intersection in the urban road network as an independent intelligent agent; for each intelligent agent, acquiring a local observation state of the intersection where the intelligent agent is located; performing action selection through sampling according to the action probability distribution; sending the selected action to the traffic simulator by using the intelligent agent, updating the state of the traffic signal lamp, and calculating and returning the intelligent agent information of the next time step by using the traffic simulator; sending the action probability distribution to all neighbor agents; and parameter updating is carried out until a preset training round is reached, and cooperative control of the traffic signals is completed. By adopting the distributed multi-agent reinforcement learning framework, the exploration efficiency is improved, and the collaboration among the agents is promoted.

    本发明提供了一种分布式多智能体交通信号协同控制方法,属于智能交通控制领域。该方法包括对路网环境进行初始化操作,并根据城市路网的拓扑结构,构建邻接表,以及将城市路网中的每个交通信号灯控制路口视为一个独立的智能体;对于每个智能体,获取所在交叉口的局部观测状态;根据动作概率分布,通过采样进行动作选择;利用智能体将选择的动作发送至交通模拟器,并更新交通信号灯的状态,利用交通模拟器计算并返回下一个时间步的智能体信息;将动作概率分布发送至其所有邻居智能体;进行参数更新,直至达到预设的训练轮次,完成对交通信号的协同控制。本发明采用分布式多智能体强化学习框架提高了探索效率和促进智能体之间的协同合作。


    Access

    Download


    Export, share and cite



    Title :

    Distributed multi-agent traffic signal cooperative control method


    Additional title:

    一种分布式多智能体交通信号协同控制方法


    Contributors:
    ZHANG XING (author) / ZHANG HENGRU (author)

    Publication date :

    2025-04-25


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS



    Multi-Agent Deep Reinforcement Learning for Decentralized Cooperative Traffic Signal Control

    Zhao, Yang / Hu, Jian-Ming / Gao, Ming-Yang et al. | ASCE | 2020


    ACTAM: cooperative multi-agent system architecture for urban traffic signal control

    Chen, Ruey-Shun / Chen, Duen-Kai / Lin, Szu-Yin | Tema Archive | 2005


    Multi-agent reinforcement learning traffic signal cooperative control method considering intersection heterogeneity

    BIE YIMING / JI YUTING / JI JINHUA et al. | European Patent Office | 2024

    Free access

    Multi-intersection traffic signal cooperative control method

    WANG ZHIWEN / ZHANG HAIPENG / WANG YUHANG et al. | European Patent Office | 2023

    Free access

    Cooperative traffic signal control method for enhancing multi-agent characterization based on comparative learning

    REN YILONG / FU XIANG / SONG ZHIHONG et al. | European Patent Office | 2024

    Free access