The escalating prevalence of formation flights in space missions has led researchers to intensify their focus on designing optimal control systems for satellite formation motion along reference orbits, with the aim of reducing tracking error and energy consumption. However, conventional controllers typically excel at optimizing only one of these objectives, and the manual parameter tuning of such controllers proves to be a challenging task. In this paper, we introduce a novel approach, the twin delayed deep deterministic policy gradient-based model predictive control (TD3-MPC) method. To tackle the multiobjective formation-keeping challenge, a linear model predictive controller based on the satellite’s dynamics had been developed. Subsequently, a cost function is formulated to facilitate the optimization of multiple objectives, specifically tracking error and fuel consumption. In addressing the intricate issue of controller parameter tuning, we employ reinforcement learning and design a reward function reflective of the TD3 algorithm’s controller performance. Simulation results underscore the superior performance of the proposed TD3-MPC algorithm compared to the linear model predictive controller, achieving a notable 27.83% reduction in tracking error and a substantial 48.30% decrease in fuel consumption under large error condition and 3.67% reduction in tracking error and a substantial 22.27% decrease in fuel consumption under small error condition. By effectively combining the strengths of reinforcement learning and model predictive control, TD3-MPC enhances the satellite’s ability to adhere more precisely to its intended trajectory, thereby ensuring the stability and desired operational performance of the satellite formation.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    TD3-Based Model Predictive Control for Satellite Formation-Keeping


    Additional title:

    J. Aerosp. Eng.


    Contributors:
    Hu, Xing (author) / Zhai, Zhi (author) / Liu, Jinxin (author) / Wang, Chenxi (author) / Liu, Naijin (author) / Chen, Xuefeng (author)

    Published in:

    Publication date :

    2024-11-01




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English





    Research on the Model Predictive Control Approach for Satellite Formation Keeping

    Cao, X.B. / He, D.L. / Zhang, J.X. et al. | British Library Conference Proceedings | 2008


    Optimal Control for Satellite Formation Keeping

    Wang, Danwei / Wu, Baolin / Poh, Eng Kee | Springer Verlag | 2016


    GNSS Based Lane Keeping Assist System via Model Predictive Control

    Kitano, Hiroaki / Berntorp, Karl / Tominaga, Kenta et al. | SAE Technical Papers | 2019


    Track-Keeping on Waterways Using Model Predictive Control

    Wahl, A. / Gilles, E.-D. / International Federation of Automatic Control | British Library Conference Proceedings | 1999