The single train trajectory optimization, also known as speed profile optimization (SPO), is a traditional problem to minimize the traction energy consumption of trains. As a kind of optimal method, reinforcement learning (RL) has been used to solve the SPO problem. In the learning process of a common RL algorithm, a soft constraint (punishment) is always used to keep the agent away from unsafe states. However, a soft constraint can not guarantee and explain the safety of the result. For the SPO problem, it means that the optimized speed profile obtained by a simple RL may break the speed limit which is unacceptable in reality. This paper proposes a protection mechanism called Shield and constructs a Shield SARSA ( ${S}$ -SARSA) algorithm to protect the learning process of the high-speed train. Four different reward functions are used to compare the protective efficacy between the proposed algorithm and the soft constraint. The numerical experiments based on the line data from Wuxi East to Suzhou North verify the protective efficacy and effectiveness.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Safe Reinforcement Learning for Single Train Trajectory Optimization via Shield SARSA


    Beteiligte:
    Zhao, Zicong (Autor:in) / Xun, Jing (Autor:in) / Wen, Xuguang (Autor:in) / Chen, Jianqiu (Autor:in)


    Erscheinungsdatum :

    01.01.2023


    Format / Umfang :

    5384452 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Single-Train Trajectory Optimization

    Lu, S | Online Contents | 2013


    Single-Train Trajectory Optimization

    Lu, Shaofeng / Hillmansen, Stuart / Ho, Tin Kin et al. | IEEE | 2013



    Hierarchical Sarsa Learning Based Route Guidance Algorithm

    Feng Wen / Xingqiao Wang / Xiaowei Xu | DOAJ | 2019

    Freier Zugriff

    Intelligent Control Strategy of Urban Rail Train Based on Sarsa(λ) Algorithm

    Jiang, Xiaoyi / Shi, Kun / Liu, Yatong et al. | IEEE | 2024