In this paper, we develop a framework to enhance the control of autonomous vehicles within signalized intersections by integrating system dynamics with imperfect sensor data. Although sensor data for autonomous vehicles is often partial, noisy, or missing, its alignment with underlying physics has the potential to significantly improve prediction accuracy. Our methodology involves a physics-based representation of system dynamics, accounting for stochastic elements originating from differences between real-world scenarios and model-based representations, using a Markov decision process (MDP) model that embraces system physics while accommodating uncertainties. Leveraging partial sensor data, we aim to diminish uncertainty associated with segments of the system model reflected in the data and better estimate the other physical variables that are not measurable through data. This framework develops particle-based reinforcement learning action policies, seamlessly integrating data and physics for controlling autonomous vehicles approaching signalized intersections. Numerical experiments showcase the effectiveness of these policies in ensuring safe control and decision-making in different scenarios of missing state variables and varying levels of data sparsity.
Physics-Informed Particle-Based Reinforcement Learning for Autonomy in Signalized Intersections
Int. J. ITS Res.
International Journal of Intelligent Transportation Systems Research ; 22 , 2 ; 416-430
2024-08-01
15 pages
Article (Journal)
Electronic Resource
English
Autonomous vehicles , Signalized intersections , System dynamics , Imperfect sensor data , Reinforcement learning , Particle filtering Engineering , Electrical Engineering , Automotive Engineering , Robotics and Automation , Computer Imaging, Vision, Pattern Recognition and Graphics , Civil Engineering , User Interfaces and Human Computer Interaction
Physics-Informed Particle-Based Reinforcement Learning for Autonomy in Signalized Intersections
Springer Verlag | 2024
|Reinforcement Learning for Mixed Autonomy Intersections
IEEE | 2021
|Engineering Index Backfile | 1968
|Eco-driving at signalized intersections: a parameterized reinforcement learning approach
Taylor & Francis Verlag | 2023
|