Autonomous vehicles (AVs) using Multi-Agent Reinforcement Learning (MARL) for simultaneous route optimization may destabilize traffic environments, with human drivers possibly experiencing longer travel times. We study this interaction by simulating human drivers and AVs. Our experiments with standard MARL algorithms reveal that, even in trivial cases, policies often fail to converge to an optimal solution or require long training periods. The problem is amplified by the fact that we cannot rely entirely on simulated training, as there are no accurate models of human routing behavior. At the same time, real-world training in cities risks destabilizing urban traffic systems, increasing externalities, such as $CO_2$ emissions, and introducing non-stationarity as human drivers adapt unpredictably to AV behaviors. Centralization can improve convergence in some cases, however, it raises privacy concerns for the travelers' destination data. In this position paper, we argue that future research must prioritize realistic benchmarks, cautious deployment strategies, and tools for monitoring and regulating AV routing behaviors to ensure sustainable and equitable urban mobility systems.


    Access

    Download


    Export, share and cite



    Title :

    Autonomous Vehicles Using Multi-Agent Reinforcement Learning for Routing Decisions Can Harm Urban Traffic



    Publication date :

    2025


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    RouteRL: Multi-agent reinforcement learning framework for urban route choice with autonomous vehicles

    Akman, Ahmet Onur / Psarou, Anastasia / Gorczyca, Łukasz et al. | ArXiv | 2025

    Free access

    Traffic Management of Autonomous Vehicles using Policy Based Deep Reinforcement Learning and Intelligent Routing

    Mushtaq, Anum / Haq, Irfan ul / Sarwar, Muhammad Azeem et al. | ArXiv | 2022

    Free access

    MULTI-AGENT REINFORCEMENT LEARNING FOR AUTONOMOUS ON DEMAND VEHICLES

    Boyali, Ali / Hashimoto, Naohisa / John, Vijay et al. | British Library Conference Proceedings | 2019


    Multi-agent reinforcement learning for autonomous vehicles: a survey

    Dinneweth, Joris / Boubezoul, Abderrahmane / Mandiau, René et al. | Springer Verlag | 2022

    Free access

    Multi-agent reinforcement learning for autonomous vehicles: a survey

    Joris Dinneweth / Abderrahmane Boubezoul / René Mandiau et al. | DOAJ | 2022

    Free access