This work presents a new framework for model-based continuous-time reinforcement learning (CT-RL) control of hypersonic vehicles (HSVs). The predominant classes of CT-RL methods for general nonlinear systems in adaptive dynamic programming (ADP) and deep RL tend to either present substantial theoretical results but lack practical synthesis capability (ADP) or show empirical promise without offering theoretical guarantees (deep RL). Meanwhile, RL control frameworks developed directly for HSVs tend to require a simplified model and complicated control structure, and they lack the substantial numerical evaluations essential for real-world flight implementation. To directly address these challenges, we propose a new decentralized excitable integral reinforcement learning framework within which the reference input-based exploration improves persistence of excitation. Together with new insights on prescaling and established decentralized control structure for HSVs, we demonstrate the resulting controller for significant performance improvement over classical Linear Quadratic Regulator (LQR) and feedback linearization methods. Additionally, we provide convergence, optimality, and closed-loop stability guarantees of the proposed method. We demonstrate these performance guarantees over a set of substantial and systematic numerical evaluations on an unstable, nonminimum phase HSV model subject to varying modeling errors and initial conditions.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Reinforcement Learning Control of Hypersonic Vehicles and Performance Evaluations


    Contributors:

    Published in:

    Publication date :

    2024-12-01




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English





    Reinforcement learning based optimized backstepping control for hypersonic vehicles with disturbance observer

    CHENG, Haoyu / LIU, Xin / LIANG, Xiaoxi et al. | Elsevier | 2025

    Free access

    Deep reinforcement learning based trajectory real-time planning for hypersonic gliding vehicles

    Li, Jianfeng / Song, Shenmin / Shi, Xiaoping | SAGE Publications | 2024


    Hypersonic Vehicle Control Based on Deep Reinforcement Learning

    Ma, Xianlong / Hu, Weijun / Gao, Zhiqiang | Springer Verlag | 2023


    Attitude Control of Hypersonic Vehicle based on Reinforcement Learning

    Liu, Jingwen / Fan, Hongdong / Fan, Yonghua et al. | IEEE | 2024