Learning-based approaches, such as reinforcement learning (RL) and imitation learning (IL), have indicated superiority over rule-based approaches in complex urban autonomous driving environments, showing great potential to make intelligent decisions. However, current RL and IL approaches still have their own drawbacks, such as low data efficiency for RL and poor generalization capability for IL. In light of this, this paper proposes a novel learning-based method that combines deep reinforcement learning and imitation learning from expert demonstrations, which is applied to longitudinal vehicle motion control in autonomous driving scenarios. Our proposed method employs the soft actor-critic structure and modifies the learning process of the policy network to incorporate both the goals of maximizing reward and imitating the expert. Moreover, an adaptive prioritized experience replay is designed to sample experience from both the agent’s self-exploration and expert demonstration, in order to improve sample efficiency. The proposed method is validated in a simulated urban roundabout scenario and compared with various prevailing RL and IL baseline approaches. The results manifest that the proposed method has a faster training speed, as well as better performance in navigating safely and time-efficiently.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Improved Deep Reinforcement Learning with Expert Demonstrations for Urban Autonomous Driving


    Beteiligte:
    Liu, Haochen (Autor:in) / Huang, Zhiyu (Autor:in) / Wu, Jingda (Autor:in) / Lv, Chen (Autor:in)


    Erscheinungsdatum :

    05.06.2022


    Format / Umfang :

    763491 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Reinforcement Learning-based Autonomous Parking with Expert Demonstrations

    Wu, Yao / Wang, Lucai / Lu, Xiao et al. | IEEE | 2023


    Distributional expert demonstrations for autonomous driving

    WU SZU-HAO / JIANG SHU / CAO YU et al. | Europäisches Patentamt | 2025

    Freier Zugriff

    DISTRIBUTIONAL EXPERT DEMONSTRATIONS FOR AUTONOMOUS DRIVING

    WU SZU-HAO / JIANG SHU / CAO YU et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Autonomous Driving using Deep Reinforcement Learning in Urban Environment

    Hashim Shakil Ansari / Goutam R | BASE | 2019

    Freier Zugriff

    Model-free Deep Reinforcement Learning for Urban Autonomous Driving

    Chen, Jianyu / Yuan, Bodi / Tomizuka, Masayoshi | IEEE | 2019