Mandatory lane-change scenarios are often challenging for autonomous vehicles in complex environments. In this paper, a human-knowledge-enhanced reinforcement learning (RL) method for lane-change decision making is proposed, where the human intelligence is integrated with RL algorithm in a multiple manner. First, this paper constructs a complex ramp-off scenario with congested traffic flow to help agents master lane-change skills. On the basis of the Twin Delayed Deep Deterministic policy gradient (TD3) algorithm, the human prior experience is encoded into reward function and safety constraints offline, and the online guidance of experts is also introduced into the framework, which can limit the unsafe exploration during the training process and provide demonstration in complex scenarios. The experimental results indicate that our method can effectively improve the training efficiency and outperform typical RL method and expert drivers, without specific requirements on the expertise. The proposed method can enhance the learning ability of RL based driving strategies.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Human Knowledge Enhanced Reinforcement Learning for Mandatory Lane-Change of Autonomous Vehicles in Congested Traffic


    Beteiligte:
    Huang, Yanjun (Autor:in) / Gu, Yuxiao (Autor:in) / Yuan, Kang (Autor:in) / Yang, Shuo (Autor:in) / Liu, Tao (Autor:in) / Chen, Hong (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.02.2024


    Format / Umfang :

    3380511 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Cooperative Lane Change Model for Connected Vehicles under Congested Traffic Conditions

    Wang, Di / Wang, Jianqiang / Wang, Yunpeng et al. | ASCE | 2015


    Analysing driving efficiency of mandatory lane change decision for autonomous vehicles

    Cao, Peng / Xu, Zhandong / Fan, Qiaochu et al. | IET | 2018

    Freier Zugriff

    Analysing driving efficiency of mandatory lane change decision for autonomous vehicles

    Cao, Peng / Xu, Zhandong / Fan, Qiaochu et al. | Wiley | 2019

    Freier Zugriff

    A Game-Based Hierarchical Model for Mandatory Lane Change of Autonomous Vehicles

    Huang, Ping / Ding, Haitao / Sun, Zhenjia et al. | IEEE | 2024