Safety is one of the critical challenges in the autonomous driving task. Recent works address the safety by implementing a safe reinforcement learning (safe RL) mechanism. However, most approaches make conservative decisions without knowing the confidence of the actions, which ultimately causes traffic congestion and low travel efficiency. This paper proposes an uncertainty-augmented Lagrangian safe reinforcement algorithm (Lag-U) to improve exploration and safety performance for autonomous driving. First, epistemic uncertainty is introduced into safe RL by using deep ensemble. We use the estimated epistemic uncertainty to encourage exploration and to learn a risk-sensitive policy by adaptively modifying safety constraints. Second, we facilitate an intervention assurance to choose safer actions based on the quantified epistemic uncertainty during deployment. Experimental results prove that the proposed method outperforms other safe RL baselines. The trained vehicle can make a decent trade-off between high efficiency and avoiding risks, thus preventing ultra-conservative policy.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Safe Reinforcement Learning in Autonomous Driving With Epistemic Uncertainty Estimation


    Contributors:
    Zhang, Zheng (author) / Liu, Qi (author) / Li, Yanjie (author) / Lin, Ke (author) / Li, Linyu (author)

    Published in:

    Publication date :

    2024-10-01


    Size :

    3951466 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English





    TACTICAL DECISION-MAKING IN AUTONOMOUS DRIVING BY REINFORCEMENT LEARNING WITH UNCERTAINTY ESTIMATION

    Hoel, Carl-Johan / Wolff, Krister / Laine, Leo | British Library Conference Proceedings | 2020


    Safe Reinforcement Learning with Policy-Guided Planning for Autonomous Driving

    Rong, Jikun / Luan, Nan | British Library Conference Proceedings | 2020


    Safe and Rule-Aware Deep Reinforcement Learning for Autonomous Driving at Intersections

    Zhang, Chi / Kacem, Kais / Hinz, Gereon et al. | IEEE | 2022