Real-time emergency event processing for mega-constellation management requires an approach that can quickly obtain a satisfactory satellite range rescheduling scheme. In this article, a deep reinforcement learning (DRL) approach is proposed for rapid rescheduling on the basis of established satellite range scheduling schemes. Three rescheduling principles with different impacts on established scheduling schemes are first analyzed. A mathematical model for both maximizing the completion profits of dynamic missions and minimizing their impacts on scheduled missions is formulated. An efficient DRL-based approach to satellite range rescheduling is then developed. A mask processing mechanism is integrated into the reinforcement learning framework to effectively eliminate the conflicts accurately expressed by the conflict space, and a modified pointer network (Ptr-Net) based on the mask processing mechanism is employed to approximate the action-value function for optimal decision-making. Experimental results show that the proposed approach significantly outperforms the rule-based heuristic and another DRL-based method in terms of computational efficiency and optimization performance, and the total time spent during the training and testing phases of the proposed approach is approximately 13% of the total running time required by the search-based methods.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A Fast Approach to Satellite Range Rescheduling Using Deep Reinforcement Learning


    Contributors:
    Liang, Jun (author) / Liu, Jian-Ping (author) / Sun, Qing (author) / Zhu, Yue-He (author) / Zhang, Yi-Chuan (author) / Song, Jian-Guo (author) / He, Bo-Yong (author)


    Publication date :

    2023-12-01


    Size :

    3033425 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Reinforcement Learning in Railway Timetable Rescheduling

    Zhu, Yongqiu / Wang, Hongrui / Goverde, Rob M.P. | IEEE | 2020





    Reinforcement Learning Based Train Rescheduling on Event Graphs

    Gorsane, Rihab / Mestiri, Khalil Gorsan / Martinez, Daniel Tapia et al. | IEEE | 2023