In this paper, we introduce a novel hierarchical decision-making framework that integrates control barrier functions (CBFs) with reinforcement learning (RL) to enhance the safety and efficiency of autonomous vehicle merging at on-ramps. The proposed technique is comprised of three layers: a behavioral planning layer that employs proximal policy optimization (PPO) algorithm aims to learn its driving behaviors, which are not necessarily compliant with vehicle dynamics; a motion control layer that adopts model predictive control (MPC) framework to ensure the kinematic feasibility to follow the trajectories with heading angles and velocities provided by the upper layer; and lastly, a control barrier function-guided layer, which is the core innovation of this paper, is implemented. It leverages the forward invariance of control barrier functions to design a safety controller that refines the output of MPC to maintain continuous driving safety. The refined results are then used as objective function, guiding subsequent updates in the learning process. Simulation results demonstrate that the proposed CBF-guided architecture significantly improves training efficiency and performance, achieving a 60% reduction in training time and 6% increase in success rate compared to standard RL methods.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Control Barrier Function-Guided Deep Reinforcement Learning for Decision-Making of Autonomous Vehicle at On-Ramp Merging


    Contributors:
    Zhang, Changzhu (author) / Dai, Lifei (author) / Zhang, Hao (author) / Wang, Zhuping (author)


    Publication date :

    2025-06-01


    Size :

    7404072 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Reinforcement Learning-Based On-Ramp Merging Decision-Making for Autonomous Vehicles

    Ma, Ning / Zhang, Ying / Cai, Wangze et al. | IEEE | 2023


    Deep reinforcement learning algorithm based ramp merging decision model

    Chen, Zeyu / Du, Yu / Jiang, Anni et al. | SAGE Publications | 2025




    Anti-Jerk On-Ramp Merging Using Deep Reinforcement Learning

    Lin, Yuan / McPhee, John / Azad, Nasser L. | IEEE | 2020