Deep reinforcement learning (DRL) has become a powerful method for autonomous driving while often lacking safety guarantees. In this paper, we propose a Risk-fused Constraint Deep Reinforcement Learning (RCDRL) with D3QN network for safe decision making in lane change maneuver. The problem is formulated as a state-wise MDP (SCMDP), which embeds a rule-based risk-fused Constraint module. We map the decision action to the trajectory layer via a polynomial curve-based trajectory planner, which is combined with the predicted trajectories of surrounding vehicles to assess future risk and correct the unsafe action. Therefore, the proposed method can deal with unsafe decision actions when training the policy network. To investigate the decision performance, the trained RCDRL policy is tested and validated under different traffic densities. In particular, we implement real vehicle tests to validate the effectiveness of the proposed method. Simulation and real vehicle tests demonstrated that the proposed RCDRL method achieves better performance, especially in safe decision. In addition, the framework can be extended with other advanced DRL networks.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Safe Reinforcement Learning of Lane Change Decision Making with Risk-Fused Constraint


    Beteiligte:
    Li, Zhuoren (Autor:in) / Xiong, Lu (Autor:in) / Leng, Bo (Autor:in) / Xu, Puhang (Autor:in) / Fu, Zhiqing (Autor:in)


    Erscheinungsdatum :

    24.09.2023


    Format / Umfang :

    1116257 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Automated Speed and Lane Change Decision Making using Deep Reinforcement Learning

    Hoel, Carl-Johan / Wolff, Krister / Laine, Leo | IEEE | 2018


    Safe Hybrid-Action Reinforcement Learning-Based Decision and Control for Discretionary Lane Change

    Xu, Ruichen / Liu, Xiao / Xu, Jinming et al. | ArXiv | 2024

    Freier Zugriff

    Autonomous Lane Change Decision Making Using Different Deep Reinforcement Learning Methods

    Feng, Xidong / Hu, Jianming / Huo, Yusen et al. | ASCE | 2019