https://orcid.org/0000-0002-3765-162X
https://orcid.org/0000-0001-6630-2675
https://orcid.org/0009-0005-9647-882X
https://orcid.org/0000-0002-1702-7440
https://orcid.org/0000-0002-3647-0245
https://orcid.org/0009-0007-6114-6168
https://orcid.org/0000-0002-4399-0986
https://orcid.org/0000-0002-3765-162X
https://orcid.org/0000-0001-6630-2675
https://orcid.org/0009-0005-9647-882X
https://orcid.org/0000-0002-1702-7440
https://orcid.org/0000-0002-3647-0245
https://orcid.org/0009-0007-6114-6168
https://orcid.org/0000-0002-4399-0986
Real-time emergency event processing for mega-constellation management requires an approach that can quickly obtain a satisfactory satellite range rescheduling scheme. In this article, a deep reinforcement learning (DRL) approach is proposed for rapid rescheduling on the basis of established satellite range scheduling schemes. Three rescheduling principles with different impacts on established scheduling schemes are first analyzed. A mathematical model for both maximizing the completion profits of dynamic missions and minimizing their impacts on scheduled missions is formulated. An efficient DRL-based approach to satellite range rescheduling is then developed. A mask processing mechanism is integrated into the reinforcement learning framework to effectively eliminate the conflicts accurately expressed by the conflict space, and a modified pointer network (Ptr-Net) based on the mask processing mechanism is employed to approximate the action-value function for optimal decision-making. Experimental results show that the proposed approach significantly outperforms the rule-based heuristic and another DRL-based method in terms of computational efficiency and optimization performance, and the total time spent during the training and testing phases of the proposed approach is approximately 13% of the total running time required by the search-based methods.
A Fast Approach to Satellite Range Rescheduling Using Deep Reinforcement Learning
IEEE Transactions on Aerospace and Electronic Systems ; 59 , 6 ; 9390-9403
2023-12-01
3033425 byte
Article (Journal)
Electronic Resource
English
Reinforcement Learning in Railway Timetable Rescheduling
| IEEE | 2020
Reinforcement learning approach for train rescheduling on a single-track railway
| Online Contents | 2016