Ensuring social acceptability is a key factor in the successful operation of autonomous vehicles. To achieve this, it is important to extract driving habits from expert human drivers. This paper proposes a method for training reward functions using maximum entropy inverse reinforcement learning based on Frenet frame sampling. The proposed method is applied to learn reward functions for the replication of human driver's lane-changing and velocity-keeping behaviors in multi-lane scenarios from human driving dataset, outperforming traditional methods based on Cartesian frame sampling. Converting the reward value of each sample into a probability distribution in the sample space allows for the provision of a convex space with human driving characteristics to the lower-level trajectory planner. These enhancements will help autonomous vehicles to select trajectories that align more with human driving habits. Experimental results show that the learned reward function can characterize human drivers' tendencies in multi-lane scenarios across multiple optimization metrics and exhibit strong interpretability. The proposed method effectively extract human driving behavior and habits under test conditions.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Maximum Entropy Inverse Reinforcement Learning Based on Frenet Frame Sampling for Human-Like Autonomous Driving


    Contributors:
    Zhang, Tangyike (author) / Sun, Shuo (author) / Shi, Jiamin (author) / Chen, Shitao (author) / Ang, Marcelo H. (author) / Xin, Jingmin (author) / Zheng, Nanning (author)


    Publication date :

    2023-09-24


    Size :

    1064953 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    Maximum Entropy Inverse Reinforcement Learning Using Monte Carlo Tree Search for Autonomous Driving

    Rodrigues da Silva, Junior Anderson / Grassi, Valdir / Wolf, Denis Fernando | IEEE | 2024


    Trajectory Tracking for Autonomous Vehicles based on Frenet Frame

    Yang, Tianqi / Hu, Juqi / Zhang, Youmin | IEEE | 2022


    LF-Net: A Learning-Based Frenet Planning Approach for Urban Autonomous Driving

    Yu, Zihan / Zhu, Meixin / Chen, Kehua et al. | IEEE | 2024