In this paper, we study how to learn a harmonious deep reinforcement learning (DRL) based lane-changing strategy for autonomous vehicles without Vehicle-to-Everything (V2X) communication support. The basic framework of this paper can be viewed as a multi-agent reinforcement learning in which different agents will exchange their strategies after each round of learning to reach a zero-sum game state. Unlike cooperation driving, harmonious driving only relies on individual vehicles’ limited sensing results to balance overall and individual efficiency. Specifically, we propose a well-designed reward that combines individual efficiency with overall efficiency for harmony, instead of only emphasizing individual interests like competitive strategy. Testing results show that competitive strategy often leads to selfish lane change behaviors, anarchy of crowd, and thus the degeneration of traffic efficiency. In contrast, the proposed harmonious strategy can promote traffic efficiency in both free flow and traffic jam than the competitive strategy. This interesting finding indicates that we should take care of the reward setting for reinforcement learning-based AI robots (e.g., automated vehicles) design, when the utilities of these robots are not strictly in alignment.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Harmonious Lane Changing via Deep Reinforcement Learning


    Contributors:
    Wang, Guan (author) / Hu, Jianming (author) / Li, Zhiheng (author) / Li, Li (author)


    Publication date :

    2022-05-01


    Size :

    3742850 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Deep Reinforcement Learning Approach for Automated Vehicle Mandatory Lane Changing

    Ammourah, Rami / Talebpour, Alireza | Transportation Research Record | 2022


    Hybrid automatic driving lane changing decision-making method based on deep reinforcement learning

    LIANG SHANSHAN / ZHANG JIE / CHEN CHONGCHONG et al. | European Patent Office | 2024

    Free access


    Automatic driving vehicle lane changing method based on double-layer deep reinforcement learning

    PENG JIANKUN / SHEN YANG / ZHANG SIYU et al. | European Patent Office | 2023

    Free access