This paper introduces a collection of non-cooperative game environments that are intended to spur development and act as proving grounds for autonomous and AI decision-makers in the orbital domain. SpaceGym comprises two distinct suites of game environments: OrbitDefender2D (OD2D) and the Ker-bal Space Program Differential Games suite (KSPDG). OrbitDe-fender2D consists of discrete, chess-like, two-player gridworld games. OD2D game mechanics are loosely based on orbital motion and players compete to maintain control of orbital slots. The KSPDG suite consists of multi-agent pursuit-evasion differential games constructed within the Kerbal Space Program (KSP) game engine. In comparison to the very limited set of comparable environments in the existing literature, KSPDG represents a much more configurable, extensible, and higher-fidelity aerospace environment suite that leverages a mature game engine to incorporate physics models for phenomenon such as collision mechanics, kinematic chains for deformable bodies, atmospheric drag, variable-mass propulsion, solar irradiance, and thermal models. Both the discrete and differential game suites are built with standardized input/output interfaces based on OpenAI Gym and PettingZoo specifications. This standardization enables-but does not enforce-the use of rein-forcement learning agents within the SpaceGym environments. As a comparison point for future research, we provide baseline agents that employ techniques of model predictive control, numerical differential game solvers, and reinforcement learning-along with their respective performance metrics-for a subset of the SpaceGym environments. The SpaceGym software libraries can be found at https://github.com/mit-II/spacegym-od2d and https://github.com/mit-II/spacegym-kspdg.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    SpaceGym: Discrete and Differential Games in Non-Cooperative Space Operations


    Contributors:


    Publication date :

    2023-03-04


    Size :

    2839642 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Elliptical Orbit Proximity Operations Differential Games

    Prince, Eric R. / Hess, Joshuah A. / Cobb, Richard G. et al. | AIAA | 2019


    Control-space properties of cooperative games

    Leitmann, G. / Vincent, T. L. | NTRS | 1970


    Cooperative 2-On-1 Bounded-Control Linear Differential Games

    Hayoun, Shmuel Y. / Shima, Tal | Springer Verlag | 2015


    Cooperative 2-On-1 Bounded-Control Linear Differential Games

    Hayoun, Shmuel / Shima, Tal | British Library Conference Proceedings | 2015


    Human-Robotic Cooperative Teams for Advanced Space Operations

    Akin, D. L. / American Society of Civil Engineers | British Library Conference Proceedings | 2004