Given the complex nature of interaction under ambiguous right-of-way scenarios, the interactions between Autonomous Vehicles (AVs) and Human-driven Vehicles (HVs) present considerable challenges to the safety and efficiency of the traffic system. Existing AVs struggle to comprehend and apply common HV social norms, especially the proactive behavior exhibited by adept human drivers in ambiguous right-of-way scenarios. In this study, we propose a novel framework to leverage expert priors for proactive-aware decision-making in ambiguous right-of-way, merging Reinforcement Learning (RL) with parameterized modeling. Building upon unprotected-turning interactions from real-world driving datasets, we select typical cases under ambiguous right-of-way as human-expert priors, which are utilized to guide the learning of the RL agent. Then, a Hidden Markov Model (HMM), which is governed by interpretable parameters derived from expert priors, introduces human decision updating mechanism into AV strategy. Experimenting with typical driving tasks, our approach achieves balanced safety and efficiency in tackling ambiguities of right-of-way, with superior decision-making performance via the guidance of expert priors when compared with established baselines. Furthermore, the results indicate that the proposed method enables AVs to accelerate the convergence during the interaction by consistent probing and decision updates.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Toward Proactive-Aware Autonomous Driving: A Reinforcement Learning Approach Utilizing Expert Priors During Unprotected Turns


    Contributors:
    Fan, Jialin (author) / Ni, Ying (author) / Zhao, Donghu (author) / Hang, Peng (author) / Sun, Jian (author)


    Publication date :

    2025-03-01


    Size :

    2532800 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Efficient Reinforcement Learning for Autonomous Driving with Parameterized Skills and Priors

    Wang, Letian / Liu, Jie / Shao, Hao et al. | ArXiv | 2023

    Free access

    Early object detection for unprotected turns

    LUDERS BRANDON DOUGLAS | European Patent Office | 2019

    Free access

    EARLY OBJECT DETECTION FOR UNPROTECTED TURNS

    LUDERS BRANDON | European Patent Office | 2019

    Free access

    EARLY OBJECT DETECTION FOR UNPROTECTED TURNS

    LUDERS BRANDON DOUGLAS | European Patent Office | 2022

    Free access

    Early object detection for unprotected turns

    LUDERS BRANDON DOUGLAS | European Patent Office | 2022

    Free access