Frequent lane changes during congestion at freeway bottlenecks such as merge and weaving areas further reduce roadway capacity. The emergence of deep reinforcement learning (RL) and connected and automated vehicle technology provides a possible solution to improve mobility and energy efficiency at freeway bottlenecks through cooperative lane changing. Deep RL is a collection of machine-learning methods that enables an agent to improve its performance by learning from the environment. In this study, a decentralized cooperative lane-changing controller was developed using proximal policy optimization by adopting a multi-agent deep RL paradigm. In the decentralized control strategy, policy learning and action reward are evaluated locally, with each agent (vehicle) getting access to global state information. Multi-agent deep RL requires lower computational resources and is more scalable than single-agent deep RL, making it a powerful tool for time-sensitive applications such as cooperative lane changing. The results of this study show that cooperative lane changing enabled by multi-agent deep RL yields superior performance to human drivers in term of traffic throughput, vehicle speed, number of stops per vehicle, vehicle fuel efficiency, and emissions. The trained RL policy is transferable and can be generalized to uncongested, moderately congested, and extremely congested traffic conditions.


    Access

    Download


    Export, share and cite



    Title :

    Decentralized Cooperative Lane Changing at Freeway Weaving Areas Using Multi-Agent Deep Reinforcement Learning


    Contributors:
    Hou, Yi (author) / Graf, Peter (author)

    Publication date :

    2021


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    A cooperative longitudinal lane-changing distributions advisory for a freeway weaving segment

    Long, Meng / Chung, Edward / Sulejic, David et al. | Taylor & Francis Verlag | 2025



    Simulation of Freeway Weaving Areas

    Skabardonis, A. / Transportation Research Board | British Library Conference Proceedings | 2002


    Simulation of Freeway Weaving Areas

    Skabardonis, Alexander | Online Contents | 2002


    Simulation of Freeway Weaving Areas

    Skabardonis, Alexander | Transportation Research Record | 2002