The invention discloses a DQN-based expressway entrance ramp control method. The method comprises the following steps: modeling a road network model according to an actual road network, designing various traffic demands, and adjusting a vehicle following model and a vehicle lane changing model; designing ramp control signal timing as action selection, changing the ramp control signal timing to adjust the turn-in rate of the ramp traffic flow, and changing the green light duration to adjust the number of vehicles entering the main line; the actual congestion condition of the expressway is reflected by the change of the total travel time, the goal of the minimum total travel time is converted into the goal of enabling the lane occupancy rate of the main line to be close to the expected occupancy rate, a reward function is established, and hierarchical control is performed on the reward function through the number of vehicles queued on the ramp; and training the DQN by using various traffic demands, and taking the trained deep reinforcement learning model as a ramp control model. The method gives consideration to the better passing efficiency of the main line and the shorter time loss of the vehicles on the ramps, so that the queuing phenomenon on the ramps is reduced as much as possible while the passing of the main line is smoother.
本发明公开了一种基于DQN的高速公路入口匝道控制方法,包括根据实际路网对路网模型进行建模,设计多种交通需求,调整车辆跟驰模型、车辆换道模型;设计匝道控制信号配时作为动作选择,改变匝道控制信号配时来调节匝道交通流的入匝率,改变绿灯时长来调节进入主线的车辆数;以总行程时间的变化反映高速公路实际拥堵情况,将总行程时间最小的目标转化为使主线的车道占有率接近期望占有率,建立奖励函数,通过匝道排队车辆数对奖励函数进行分级控制;使用多种交通需求对DQN进行训练,取训练后的深度强化学习模型作为匝道控制模型。本发明兼顾主线通行效率较优与匝道车辆损失时间较小,使主线通行更加通畅的同时尽可能减少匝道排队现象。
DQN-based expressway entrance ramp control method
一种基于DQN的高速公路入口匝道控制方法
2024-02-27
Patent
Electronic Resource
Chinese
IPC: | G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS |
Vehicle-road cooperative control method for expressway entrance ramp
European Patent Office | 2023
|Expressway entrance ramp control method and system based on heterogeneous traffic scene
European Patent Office | 2020
|Expressway long-distance downstream bottleneck road section entrance ramp control method
European Patent Office | 2020
|Expressway main line divided lane control and entrance ramp cooperative control method
European Patent Office | 2023
|