The invention discloses a traffic signal and direction-variable lane cooperative control method based on multi-agent learning, and the method comprises the steps: making a decision through the iteration of a traffic signal control module and a lane guiding control module, and carrying out the operation at the same time to control the traffic; the lane guiding control module adopts a dual depth Q network algorithm to enhance a learning model, an intelligent agent selects actions based on traffic flow and traffic signal states to maximize the lane utilization rate, and an award is calculated based on lane queuing length difference and the maximum direction demand traffic flow ratio; the traffic signal control module agent selects an action based on the observed lane density and the current lane state and obtains an award according to the traffic flow satisfaction of the selected phase. According to the method, the lane utilization rate is improved by controlling lane guidance, and the dynamically changing traffic flow is controlled in space and time dimensions by using a reinforcement learning framework; higher stability and efficiency are shown, and the traffic capacity of the intersection is improved.

    本发明公开了一种基于多智能体学习的交通信号与可变方向车道的协同控制方法,通过交通信号控制模块和车道导向控制模块迭代做出决策,并同时运行以控制交通;车道导向控制模块采用双重深度Q网络算法增强学习模型,智能体基于交通流量和交通信号状态选择动作,以最大化车道利用率,奖励基于车道排队长度差异和最大方向需求交通流量比率计算;交通信号控制模块智能体基于观察到的车道密度和当前车道状态选择动作,并根据所选相位的交通流满意度获得奖励。本发明通过控制车道导向来改善车道利用率,使用强化学习框架,在空间和时间维度上控制动态变化的交通流量;表现出更高的稳定性和效率,并提高了交叉口的通行能力。


    Access

    Download


    Export, share and cite



    Title :

    Cooperative control method for traffic signal and direction-variable lane based on multi-agent learning


    Additional title:

    基于多智能体学习的交通信号与可变方向车道的协同控制方法


    Contributors:
    WANG HAIYONG (author) / WANG MENGLIN (author) / WANG YIXUAN (author) / WEI SHENG (author) / ZHANG RU (author) / ZHANG DAN (author) / TIAN AIAI (author) / LU YUHENG (author) / ZHAO HONGJIAN (author)

    Publication date :

    2025-05-30


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS



    Multi-intersection variable guide lane and traffic signal cooperative control optimization method

    ZHAO FEI / ZHAO WEIHUA / ZHONG MING et al. | European Patent Office | 2024

    Free access

    Variable lane and traffic signal cooperative control method based on deep reinforcement learning

    DING CHUAN / NIE WUYANG / LU YINGRONG et al. | European Patent Office | 2020

    Free access

    Variable-direction lane dynamic traffic signal lamp and control method thereof

    CHEN YAOHUI / CAO YANG | European Patent Office | 2023

    Free access

    Multi-Agent Deep Reinforcement Learning for Decentralized Cooperative Traffic Signal Control

    Zhao, Yang / Hu, Jian-Ming / Gao, Ming-Yang et al. | ASCE | 2020


    Multi-agent reinforcement learning traffic signal cooperative control method considering intersection heterogeneity

    BIE YIMING / JI YUTING / JI JINHUA et al. | European Patent Office | 2024

    Free access