The primary objective of this paper was to incorporate the reinforcement learning technique in variable speed limit (VSL) control strategies to reduce system travel time at freeway bottlenecks. A Q-learning (QL)-based VSL control strategy was proposed. The controller included two components: a QL-based offline agent and an online VSL controller. The VSL controller was trained to learn the optimal speed limits for various traffic states to achieve a long-term goal of system optimization. The control effects of the VSL were evaluated using a modified cell transmission model for a freeway recurrent bottleneck. A new parameter was introduced in the cell transmission model to account for the overspeed of drivers in unsaturated traffic conditions. Two scenarios that considered both stable and fluctuating traffic demands were evaluated. The effects of the proposed strategy were compared with those of the feedback-based VSL strategy. The results showed that the proposed QL-based VSL strategy outperformed the feedback-based VSL strategy. More specifically, the proposed VSL control strategy reduced the system travel time by 49.34% in the stable demand scenario and 21.84% in the fluctuating demand scenario.
Reinforcement Learning-Based Variable Speed Limit Control Strategy to Reduce Traffic Congestion at Freeway Recurrent Bottlenecks
IEEE Transactions on Intelligent Transportation Systems ; 18 , 11 ; 3204-3217
2017-11-01
2720259 byte
Article (Journal)
Electronic Resource
English
Variable speed limit control for severe non-recurrent freeway bottlenecks
Online Contents | 2015
|ArXiv | 2018
|Dynamic Control Cycle Speed Limit Strategy for Improving Traffic Operation at Freeway Bottlenecks
Springer Verlag | 2021
|Variable speed limit control at fixed freeway bottlenecks using connected vehicles
Online Contents | 2017
|