Metro networks necessitate continuous expansion, either extending existing lines or constructing new ones. Optimizing this process, however, presents multifaceted challenges due to complex spatial and demographic relationships, dynamic travel patterns, and a vast solution space with non-linearities and multiple objectives. Existing approaches often fall short, either relying heavily on subjective expert knowledge or limiting their scope to isolated corridors. This paper introduces MetroZero, a deep reinforcement learning (DRL) framework designed to overcome these limitations. We formulate the optimization as a Markov Decision Process (MDP) and leverage a Monte Carlo Tree Search (MCTS) algorithm guided by an actor-critic agent. This powerful combination identifies the optimal sequence of expansion stations within budgetary constraints. To effectively learn network representations, we develop a multiplex graph encoder powered by attentive message passing. A graph attention network (GAT) and a feasibility mask are employed to prioritize high-potential expansion locations and navigate the search space. Inspired by AlphaZero, we train MetroZero through simulated self-play expansion games. Extensive experiments on real-world datasets from Beijing and Changsha demonstrate MetroZero’s effectiveness and superiority. In a complex expansion scenario, it achieves remarkable improvements of 19.6% and 20.4% over the second-best model. Further experiments across varied urban contexts underscore MetorZero’s scalability and adaptability.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    MetroZero: Deep Reinforcement Learning and Monte Carlo Tree Search for Optimized Metro Network Expansion


    Contributors:


    Publication date :

    2025-01-01


    Size :

    8781976 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Monte Carlo Tree Search With Reinforcement Learning for Motion Planning

    Weingertner, Philippe / Ho, Minnie / Timofeev, Andrey et al. | IEEE | 2020


    Safe Reinforcement Learning for Autonomous Vehicle Using Monte Carlo Tree Search

    Mo, Shuojie / Pei, Xiaofei / Wu, Chaoxian | IEEE | 2022


    Maximum Entropy Inverse Reinforcement Learning Using Monte Carlo Tree Search for Autonomous Driving

    Rodrigues da Silva, Junior Anderson / Grassi, Valdir / Wolf, Denis Fernando | IEEE | 2024