The bus system is a critical component of sustainable urban transportation. However, due to the significant uncertainties in passenger demand and traffic conditions, bus operation is unstable in nature and bus bunching has become a common phenomenon that undermines the reliability and efficiency of bus services. Despite recent advances in multi-agent reinforcement learning (MARL) on traffic control, little research has focused on bus fleet control due to the tricky asynchronous characteristic -- control actions only happen when a bus arrives at a bus stop and thus agents do not act simultaneously. In this study, we formulate route-level bus fleet control as an asynchronous multi-agent reinforcement learning (ASMR) problem and extend the classical actor-critic architecture to handle the asynchronous issue. Specifically, we design a novel critic network to effectively approximate the marginal contribution for other agents, in which graph attention neural network is used to conduct inductive learning for policy evaluation. The critic structure also helps the ego agent optimize its policy more efficiently. We evaluate the proposed framework on real-world bus services and actual passenger demand derived from smart card data. Our results show that the proposed model outperforms both traditional headway-based control methods and existing MARL methods.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Reducing Bus Bunching with Asynchronous Multi-Agent Reinforcement Learning


    Beteiligte:
    Wang, Jiawei (Autor:in) / Sun, Lijun (Autor:in)

    Erscheinungsdatum :

    2021


    Anmerkungen:

    IJCAI-2021



    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Mitigating Bus Bunching via Hierarchical Multi-Agent Reinforcement Learning

    Yu, Mengdi / Yang, Tao / Li, Chunxiao et al. | IEEE | 2024



    Reducing bunching with bus-to-bus cooperation

    Daganzo, Carlos F. | Online Contents | 2011


    Multi-Intersection Signal Control Based on Asynchronous Reinforcement Learning

    Jixiang Wang / Siqi Chen / Jing Wei et al. | DOAJ | 2025

    Freier Zugriff

    Experience generalization for multi-agent reinforcement learning

    Pegoraro, Renê / Costa, AHR / Ribeiro, CHC | BASE | 2001

    Freier Zugriff