Learning-based approaches, such as reinforcement learning (RL) and imitation learning (IL), have indicated superiority over rule-based approaches in complex urban autonomous driving environments, showing great potential to make intelligent decisions. However, current RL and IL approaches still have their own drawbacks, such as low data efficiency for RL and poor generalization capability for IL. In light of this, this paper proposes a novel learning-based method that combines deep reinforcement learning and imitation learning from expert demonstrations, which is applied to longitudinal vehicle motion control in autonomous driving scenarios. Our proposed method employs the soft actor-critic structure and modifies the learning process of the policy network to incorporate both the goals of maximizing reward and imitating the expert. Moreover, an adaptive prioritized experience replay is designed to sample experience from both the agent’s self-exploration and expert demonstration, in order to improve sample efficiency. The proposed method is validated in a simulated urban roundabout scenario and compared with various prevailing RL and IL baseline approaches. The results manifest that the proposed method has a faster training speed, as well as better performance in navigating safely and time-efficiently.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Improved Deep Reinforcement Learning with Expert Demonstrations for Urban Autonomous Driving


    Contributors:
    Liu, Haochen (author) / Huang, Zhiyu (author) / Wu, Jingda (author) / Lv, Chen (author)


    Publication date :

    2022-06-05


    Size :

    763491 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Reinforcement Learning-based Autonomous Parking with Expert Demonstrations

    Wu, Yao / Wang, Lucai / Lu, Xiao et al. | IEEE | 2023


    Distributional expert demonstrations for autonomous driving

    WU SZU-HAO / JIANG SHU / CAO YU et al. | European Patent Office | 2025

    Free access

    DISTRIBUTIONAL EXPERT DEMONSTRATIONS FOR AUTONOMOUS DRIVING

    WU SZU-HAO / JIANG SHU / CAO YU et al. | European Patent Office | 2023

    Free access

    Autonomous Driving using Deep Reinforcement Learning in Urban Environment

    Hashim Shakil Ansari / Goutam R | BASE | 2019

    Free access

    Model-free Deep Reinforcement Learning for Urban Autonomous Driving

    Chen, Jianyu / Yuan, Bodi / Tomizuka, Masayoshi | IEEE | 2019