Connected automated driving has the potential to significantly improve urban traffic efficiency, e.g., by alleviating issues due to occlusion. Cooperative behavior planning can be employed to jointly optimize the motion of multiple vehicles. Most existing approaches to automatic intersection management, however, only consider fully automated traffic. In practice, mixed traffic, i.e., the simultaneous road usage by automated and human-driven vehicles, will be prevalent. The present work proposes to leverage reinforcement learning and a graph-based scene representation for cooperative multi-agent planning. We build upon our previous works that showed the applicability of such machine learning methods to fully automated traffic. The scene representation is extended for mixed traffic and considers uncertainty in the human drivers’ intentions. In the simulation-based evaluation, we model measurement uncertainties through noise processes that are tuned using real-world data. The paper evaluates the proposed method against an enhanced first in -first out scheme, our baseline for mixed traffic management. With increasing share of automated vehicles, the learned planner significantly increases the vehicle throughput and reduces the delay due to interaction. Non-automated vehicles benefit virtually alike.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Automatic Intersection Management in Mixed Traffic Using Reinforcement Learning and Graph Neural Networks


    Contributors:


    Publication date :

    2023-06-04


    Size :

    1056552 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Automatic Intersection Management in Mixed Traffic Using Reinforcement Learning and Graph Neural Networks

    Klimke, Marvin / Völz, Benjamin / Buchholz, Michael | ArXiv | 2023

    Free access

    Large-Scale Mixed-Traffic and Intersection Control using Multi-agent Reinforcement Learning

    Liu, Songyang / Fan, Muyang / Li, Weizi et al. | ArXiv | 2025

    Free access


    Flow distribution area mixed traffic flow control method based on graph neural network reinforcement learning

    XU DONGWEI / LIU PEIWEN / QIU QINGWEI | European Patent Office | 2023

    Free access

    Single-intersection intersection traffic light control method based on improved deep reinforcement learning

    LIU BINGYAN / GUO HONG / DU JUNLIN et al. | European Patent Office | 2024

    Free access