This work studies mixed-autonomy traffic optimization at a network level with Deep Reinforcement Learning (DRL). In mixed-autonomy traffic, a mixture of connected autonomous vehicles (CAVs) and human driving vehicles is present on the roads at the same time. We hypothesize that controlling distributed CAVs at a network level can outperform the individually controlled CAVs. Our goal is to improve traffic fluidity in terms of the vehicle's average velocity and collision avoidance. We propose three distributed learning control policies for CAVs in mixed-autonomy traffic using Proximal Policy Optimization (PPO), a policy gradient DRL method. We conduct the experiments with different traffic settings and CAV penetration rates on the Flow framework, a new open-source microscopic traffic simulator. The experiments show that network-level RL policies for controlling CAVs outperform the individual-level RL policies in terms of the total rewards and the average velocity.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Mixed-Autonomy Traffic Control with Proximal Policy Optimization


    Contributors:


    Publication date :

    2019-12-01


    Size :

    1555289 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Improving traffic signal control operations using proximal policy optimization

    Huang, Liben / Qu, Xiaohui | Wiley | 2023

    Free access


    Traffic Signal Timing and Trajectory Optimization in a Mixed Autonomy Traffic Stream

    Tajalli, Mehrdad / Hajbabaie, Ali | IEEE | 2022

    Free access

    Simulation Environment for Traffic Control Systems Targeting Mixed Autonomy Traffic Scenarios

    Link, Christopher / Malena, Kevin / Gausemeier, Sandra et al. | Fraunhofer Publica | 2023

    Free access

    A mixed autonomy coordination methodology for multi-robotic traffic control

    Aditya, V.T. / Viswanath, D.V.K. / Krishna, K.M. | Tema Archive | 2008