This paper presents a novel approach to address the challenging problem of autonomous on-ramp merging, where a self-driving vehicle needs to seamlessly integrate into a flow of vehicles on a multi-lane highway. We introduce the Lane-keeping, Lane-changing with Latent-state Inference and Safety Controller (L3IS) agent, designed to perform the on-ramp merging task safely without comprehensive knowledge about surrounding vehicles' intents or driving styles. We also present an augmentation of this agent called AL3IS that accounts for observation delays, allowing the agent to make more robust decisions in real-world environments with vehicle-to-vehicle (V2V) communication delays. By modeling the unobservable aspects of the environment through latent states, such as other drivers' intents, our approach enhances the agent's ability to adapt to dynamic traffic conditions, optimize merging maneuvers, and ensure safe interactions with other vehicles. We demonstrate the effectiveness of our method through extensive simulations generated from real traffic data and compare its performance with existing approaches. L3IS shows a 99.90% success rate in a challenging on-ramp merging case generated from the real US Highway 101 data. We further perform a sensitivity analysis on AL3IS to evaluate its robustness against varying observation delays, which demonstrates an acceptable performance of 93.84% success rate in 1-second V2V communication delay.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Reinforcement Learning with Latent State Inference for Autonomous On-ramp Merging under Observation Delay


    Beteiligte:
    Tabrizian, Amin (Autor:in) / Huang, Zhitong (Autor:in) / Wei, Peng (Autor:in)

    Erscheinungsdatum :

    2024


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Reinforcement Learning-Based On-Ramp Merging Decision-Making for Autonomous Vehicles

    Ma, Ning / Zhang, Ying / Cai, Wangze et al. | IEEE | 2023



    Learning Highway Ramp Merging Via Reinforcement Learning with Temporally-Extended Actions

    Triest, Samuel / Villaflor, Adam / Dolan, John M. | IEEE | 2020


    Deep reinforcement learning algorithm based ramp merging decision model

    Chen, Zeyu / Du, Yu / Jiang, Anni et al. | SAGE Publications | 2025


    ANTI-JERK ON-RAMP MERGING USING DEEP REINFORCEMENT LEARNING

    Lin, Yuan / McPhee, John / Azad, Nasser L. | British Library Conference Proceedings | 2020