The invention discloses an expressway road cooperative control system and method based on deep reinforcement learning, wherein the system comprises a traffic information interaction module, a trafficcontrol module, a deep learning network training module, and a plurality of variable speed limit and ramp control units. The traffic status of ta road is obtained through the information interaction module, and then the traffic status is transmitted to the traffic control module. And the control strategy is continuously optimized through the training module, and the stability of the training process is ensured by adopting a deep reinforcement learning algorithm with an actor-critic architecture. All traffic control units in the system can be controlled at the same time, the problems of trafficstatus space explosion and the like cannot be caused, it can be guaranteed that vehicles pass through bottleneck road sections at a high speed, and passing of surrounding road vehicles cannot be affected by queuing and the like.

    本发明公开了一种基于深度强化学习的高速公路道路协同控制系统及方法,系统包括交通信息交互模块、交通控制模块、深度学习网络训练模块以及若干可变限速和匝道控制单元,通过信息交互模块获取道路的交通状态,再传递给交通控制模块。后者通过训练模块不断优化控制策略,并采用具有actor‑critic架构的深度强化学习算法保证训练过程的稳定性。本发明能同时控制系统中的所有交通控制单元,且不会造成交通状态空间爆炸等问题,能保障车辆以较高速度通过瓶颈路段,且不会因为排队等问题影响周边道路车辆的通行。


    Access

    Download


    Export, share and cite



    Title :

    Expressway road cooperative control system and method based on deep reinforcement learning


    Additional title:

    基于深度强化学习的高速公路道路协同控制系统及方法


    Contributors:
    WANG CHONG (author)

    Publication date :

    2021-01-29


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    Expressway vehicle-road cooperative control system based on V2X

    HAO NENGBAO / QI JINGJING / LIU JUN et al. | European Patent Office | 2021

    Free access

    Vehicle-road cooperative control method for expressway entrance ramp

    WU JIAXIN / ZHENG PENGJUN / WEN YIQING et al. | European Patent Office | 2023

    Free access

    expressway vehicle-road cooperative detection device

    ZHANG XIZHENG / LU ZHANGYU / WAN QIN et al. | European Patent Office | 2021

    Free access

    Expressway generalized vehicle-road cooperative traffic management and control system

    CHENG SUSHA / LI QIANG / XU CHENQUN et al. | European Patent Office | 2021

    Free access

    Vehicle-road cooperative dynamic lane control system and method for preventing expressway secondary accident

    PENG CHANG / ZHANG JIYANG / WANG CHANGSHUAI et al. | European Patent Office | 2022

    Free access