Safety is one of the critical challenges in the autonomous driving task. Recent works address the safety by implementing a safe reinforcement learning (safe RL) mechanism. However, most approaches make conservative decisions without knowing the confidence of the actions, which ultimately causes traffic congestion and low travel efficiency. This paper proposes an uncertainty-augmented Lagrangian safe reinforcement algorithm (Lag-U) to improve exploration and safety performance for autonomous driving. First, epistemic uncertainty is introduced into safe RL by using deep ensemble. We use the estimated epistemic uncertainty to encourage exploration and to learn a risk-sensitive policy by adaptively modifying safety constraints. Second, we facilitate an intervention assurance to choose safer actions based on the quantified epistemic uncertainty during deployment. Experimental results prove that the proposed method outperforms other safe RL baselines. The trained vehicle can make a decent trade-off between high efficiency and avoiding risks, thus preventing ultra-conservative policy.
Safe Reinforcement Learning in Autonomous Driving With Epistemic Uncertainty Estimation
IEEE Transactions on Intelligent Transportation Systems ; 25 , 10 ; 13653-13666
2024-10-01
3951466 byte
Article (Journal)
Electronic Resource
English
European Patent Office | 2022
|TACTICAL DECISION-MAKING IN AUTONOMOUS DRIVING BY REINFORCEMENT LEARNING WITH UNCERTAINTY ESTIMATION
British Library Conference Proceedings | 2020
|Safe Reinforcement Learning with Policy-Guided Planning for Autonomous Driving
British Library Conference Proceedings | 2020
|