In this paper, we introduce a novel hierarchical decision-making framework that integrates control barrier functions (CBFs) with reinforcement learning (RL) to enhance the safety and efficiency of autonomous vehicle merging at on-ramps. The proposed technique is comprised of three layers: a behavioral planning layer that employs proximal policy optimization (PPO) algorithm aims to learn its driving behaviors, which are not necessarily compliant with vehicle dynamics; a motion control layer that adopts model predictive control (MPC) framework to ensure the kinematic feasibility to follow the trajectories with heading angles and velocities provided by the upper layer; and lastly, a control barrier function-guided layer, which is the core innovation of this paper, is implemented. It leverages the forward invariance of control barrier functions to design a safety controller that refines the output of MPC to maintain continuous driving safety. The refined results are then used as objective function, guiding subsequent updates in the learning process. Simulation results demonstrate that the proposed CBF-guided architecture significantly improves training efficiency and performance, achieving a 60% reduction in training time and 6% increase in success rate compared to standard RL methods.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Control Barrier Function-Guided Deep Reinforcement Learning for Decision-Making of Autonomous Vehicle at On-Ramp Merging


    Beteiligte:
    Zhang, Changzhu (Autor:in) / Dai, Lifei (Autor:in) / Zhang, Hao (Autor:in) / Wang, Zhuping (Autor:in)


    Erscheinungsdatum :

    01.06.2025


    Format / Umfang :

    7404072 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Reinforcement Learning-Based On-Ramp Merging Decision-Making for Autonomous Vehicles

    Ma, Ning / Zhang, Ying / Cai, Wangze et al. | IEEE | 2023


    Deep reinforcement learning algorithm based ramp merging decision model

    Chen, Zeyu / Du, Yu / Jiang, Anni et al. | SAGE Publications | 2025




    Anti-Jerk On-Ramp Merging Using Deep Reinforcement Learning

    Lin, Yuan / McPhee, John / Azad, Nasser L. | IEEE | 2020