The invention provides a distributed multi-agent traffic signal cooperative control method, and belongs to the field of intelligent traffic control. The method comprises the steps of performing initialization operation on a road network environment, constructing an adjacency list according to a topological structure of an urban road network, and regarding each traffic signal lamp control intersection in the urban road network as an independent intelligent agent; for each intelligent agent, acquiring a local observation state of the intersection where the intelligent agent is located; performing action selection through sampling according to the action probability distribution; sending the selected action to the traffic simulator by using the intelligent agent, updating the state of the traffic signal lamp, and calculating and returning the intelligent agent information of the next time step by using the traffic simulator; sending the action probability distribution to all neighbor agents; and parameter updating is carried out until a preset training round is reached, and cooperative control of the traffic signals is completed. By adopting the distributed multi-agent reinforcement learning framework, the exploration efficiency is improved, and the collaboration among the agents is promoted.
本发明提供了一种分布式多智能体交通信号协同控制方法,属于智能交通控制领域。该方法包括对路网环境进行初始化操作,并根据城市路网的拓扑结构,构建邻接表,以及将城市路网中的每个交通信号灯控制路口视为一个独立的智能体;对于每个智能体,获取所在交叉口的局部观测状态;根据动作概率分布,通过采样进行动作选择;利用智能体将选择的动作发送至交通模拟器,并更新交通信号灯的状态,利用交通模拟器计算并返回下一个时间步的智能体信息;将动作概率分布发送至其所有邻居智能体;进行参数更新,直至达到预设的训练轮次,完成对交通信号的协同控制。本发明采用分布式多智能体强化学习框架提高了探索效率和促进智能体之间的协同合作。
Distributed multi-agent traffic signal cooperative control method
一种分布式多智能体交通信号协同控制方法
2025-04-25
Patent
Electronic Resource
Chinese
ACTAM: cooperative multi-agent system architecture for urban traffic signal control
Tema Archive | 2005
|European Patent Office | 2024
|Multi-intersection traffic signal cooperative control method
European Patent Office | 2023
|European Patent Office | 2024
|