Bus bunching, a pervasive phenomenon in public transit systems, significantly undermines passenger satisfaction and operational efficiency. Recent studies on mitigating bus bunching have turned to model-free reinforcement learning (RL)-based methods for developing holding control strategies, demonstrating superior performance over traditional model-based approaches. However, a systematic evaluation of how different learning configurations affect the overall performance of these methods remains unexplored. To this end, this study develops an open-source framework to systematically examine the control performance of various RL approaches, including both value-based and policy-based algorithms, under different configurations using real-world bus data. Our findings reveal that: 1) simpler state representations (e.g., considering only forward and backward spacings between adjacent buses) may outperform more complex ones that additionally incorporate stop-specific information; 2) adopting actions with discrete holding time achieve comparable results to their continuous counterparts, offering practical advantages for implementation; 3) while multi-agent methods can slightly improve performance, their computational costs can outweigh benefits in certain scenarios; and 4) RL approaches demonstrate strong generalizability across diverse routes and fleet sizes, suggesting potential for widespread application with minimal retraining. These insights could guide the selection and implementation of practical RL deployment for public transit agencies.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Reinforcement Learning for Bus Bunching Mitigation: A Systematic Evaluation of Configurations and Performances


    Contributors:
    Xu, Zhandong (author) / Wang, Chao (author) / Shen, Minyu (author) / Li, Chaojing (author) / Liu, Xiaobo (author)


    Publication date :

    2025-07-01


    Size :

    2300385 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Mitigating Bus Bunching via Hierarchical Multi-Agent Reinforcement Learning

    Yu, Mengdi / Yang, Tao / Li, Chunxiao et al. | IEEE | 2024


    Reducing Bus Bunching with Asynchronous Multi-Agent Reinforcement Learning

    Wang, Jiawei / Sun, Lijun | ArXiv | 2021

    Free access

    Bilevel Optimization for Bunching Mitigation and Eco-Driving of Electric Bus Lines

    Lacombe, Remi / Gros, Sebastien / Murgovski, Nikolce et al. | IEEE | 2022


    Traffic flow and bunching

    Underwood, R.T. | Engineering Index Backfile | 1963