The world’s largest coal export operation is located in New South Wales, Australia. The state has more than 87% of the coal transportation done through railways, and one of the strategies to increase throughput is the use of sophisticated computational techniques for rail traffic optimisation. The current state of the art shows a lack of practical applications, thus making scalability, decentralisation and real-world commitment three key research directions. Towards that, this research presents a simulation-based machine learning approach for the railway traffic management problem, in the context of the Hunter Valley Coal Chain (HVCC). We modelled trains, load points and terminals as autonomous intelligent agents that interact, learn and act independently—thus constituting a multi-agent system (MAS). The MAS is implemented on top of a rail network simulation model currently in use at the HVCC. The model is adapted as a decentralised partially-observed Markov decision process environment that allows multi-agent learning via a genetic algorithm. We present experiments with scenarios based on the actual rail network data, which show that the MAS outperforms the heuristic approach embedded in the HVCC simulation tool by up to 81% (in terms of the schedule’s total dwell time). Further to those experiments, a comparison analysis evaluates the relevance of specific state features (e.g. track length, train conflicts, etc.). Finally, an important outcome was that the agents have learned to overcome very complex traffic situations that appear in train scheduling operations and that sometimes result in unnecessarily long dwell times. This type of high level learning represents a significant step forward in the use of complex computational techniques for rail transportation problems.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A decentralised multi-agent system for rail freight traffic management


    Weitere Titelangaben:

    Ann Oper Res


    Beteiligte:

    Erschienen in:

    Erscheinungsdatum :

    01.01.2023


    Format / Umfang :

    31 pages




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Freight train scheduling via decentralised multi-agent deep reinforcement learning

    Bretas, Allan / Mendes, Alexandre / Chalup, Stephan K. | TIBKAT | 2021

    Freier Zugriff

    Decentralised Organisation of Rail Transport by Multi Agent Systems

    Konig, S. / Braun, I. / Schnieder, E. et al. | British Library Conference Proceedings | 2003


    Rail freight traffic assignment

    Lansdowne, Zachary F. | Elsevier | 1980


    Rail without frontiers : (freight traffic)

    International Union of Railways | SLUB | 1991


    New rail freight traffic for 2015

    Siegmann, Jürgen / Stuhr, Helge | IuD Bahn | 2008