This paper presents a semi-Markov decision process (SMDP) formulation of the satellite task scheduling problem. This formulation can consider multiple operational objectives simultaneously and plan transitions between distinct functional modes. We consider the problem of scheduling image collections, ground contacts, sun-pointed periods for battery recharging, and data recorder management for an agile, resource-constrained Earth-observing spacecraft. By considering multiple mission objectives simultaneously, the algorithm is able to find optimized task schedule that satisfies all operational constraints in a single planning step, thus reducing the operational complexity and number of steps involved in mission planning. We present two solution approaches based on forward search and Monte Carlo Tree search. We baseline against rule-based, graph search, and mixed-integer-linear programming approaches. The SMDP formulation is evaluated in both single-objective and multi-objective scenarios. The SMDP solution is found to perform comparably with the baseline methods at greatly increased speed in single-objective scenarios and greater schedule reward in multi-objective.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Markov Decision Processes For Multi-Objective Satellite Task Planning


    Contributors:


    Publication date :

    2020-03-01


    Size :

    798304 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Planning using hierarchical constrained Markov decision processes

    Feyzabadi, S. | British Library Online Contents | 2017


    Multi-task multi-objective optimization decision planning processing method and system in automatic driving

    DANG DONGFANG / XU WEI / CHEN CAIXIA et al. | European Patent Office | 2024

    Free access

    Ground Delay Program Planning Using Markov Decision Processes

    Cox, Jonathan / Kochenderfer, Mykel J. | AIAA | 2016


    Health-Aware Multi-UAV Planning using Decentralized Partially Observable Semi-Markov Decision Processes

    Omidshafiei, Shayegan / Agha-mohammadi, Ali-akbar / Amato, Christopher et al. | AIAA | 2016


    Contingency Planning Using Bi-level Markov Decision Processes for Space Missions

    Banerjee, Somrita / Balaban, Edward / Shirley, Mark et al. | IEEE | 2024