Multi-Reward Proximal Policy Optimization (MRPPO) is a multi-objective reinforcement learning algorithm used to construct low-thrust transfers between periodic orbits in multi-body systems. Previous implementations of MRPPO have relied on a predefined reference transfer to successfully train each policy. In this paper, an algorithmic modification labeled the ‘moving reference’, is introduced to autonomously construct these reference trajectories during training. With this modification, MRPPO is used to recover various low-thrust transfers between two periodic orbits in the Earth-Moon circular restricted three-body problem to solve a multi-objective optimization problem. These results are then compared with the solutions recovered via a gradient descent optimization scheme to validate the performance of MRPPO with the moving reference modification.


    Access

    Access via TIB

    Check availability in my library


    Export, share and cite



    Title :

    MULTI-OBJECTIVE REINFORCEMENT LEARNING FOR LOW-THRUST TRANSFER DESIGN BETWEEN LIBRATION POINT ORBITS



    Conference:

    2021 AAS/AIAA Astrodynamics Specialist Conference ; 2021 ; Virtual, US


    Type of media :

    Conference paper


    Type of material :

    No indication


    Language :

    English




    Multi-objective Reinforcement Learning for Low-thrust Transfer Design Between Libration Point Orbits

    Anderson, Rodney L / Mashiku, Alinda / Bosanac, Natasha et al. | NTRS | 2021


    MULTI-OBJECTIVE REINFORCEMENT LEARNING FOR LOW-THRUST TRANSFER DESIGN BETWEEN LIBRATION POINT ORBITS

    Christopher J Sullivan / Natasha Bosanac / Alinda K Mashiku et al. | NTRS


    MULTI-OBJECTIVE REINFORCEMENT LEARNING FOR LOW-THRUST TRANSFER DESIGN BETWEEN LIBRATION POINT ORBITS

    Christopher John Sullivan / Natasha Bosanac / Alinda Kenyana Mashiku et al. | NTRS


    Multi-Objective Reinforcement Learning for Low-Thrust Transfer Design between Periodic Orbits

    Christopher J Sullivan / Natasha Bosanac / Alinda K Mashiku et al. | NTRS


    Optimization of low-thrust transfers to libration point orbits

    Li, Weipeng / Huang, Hai | Emerald Group Publishing | 2016