Ducted-fan tail-sitter unmanned aerial vehicles (UAVs) provide versatility and unique benefits, attracting significant attention in various applications. This study focuses on developing a safe reinforcement learning method for back-transition control between level flight mode and hover mode for ducted-fan tail-sitter UAVs. Our method enables transition control with a minimal altitude change and transition time while adhering to the velocity constraint. We employ the Trust Region Policy Optimization, Proximal Policy Optimization with Lagrangian, and Constrained Policy Optimization (CPO) algorithms for controller training, showcasing the superiority of the CPO algorithm and the necessity of the velocity constraint. The transition trajectory achieved using the CPO algorithm closely resembles the optimal trajectory obtained via the well-known GPOPS-II software with the SNOPT solver. Meanwhile, the CPO algorithm also exhibits strong robustness under unknown perturbations of UAV model parameters and wind disturbance.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Safe Reinforcement Learning for Transition Control of Ducted-Fan UAVs


    Beteiligte:
    Yanbo Fu (Autor:in) / Wenjie Zhao (Autor:in) / Liu Liu (Autor:in)


    Erscheinungsdatum :

    2023




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt




    Parameter Identification and Attitude Control of Ducted Fan UAVs

    Nan, Yi ;Wang, Chang Hong ;Yi, Guo Xing | Trans Tech Publications | 2014


    Improving Control System Effectiveness for Ducted Fan VTOL UAVs Operating in Crosswinds

    Fleming, Jonathan / Jones, Troy / Ng, Wing et al. | AIAA | 2003


    IMPROVING CONTROL SYSTEM EFFECTIVENESS FOR DUCTED FAN VTOL UAVS OPERATING IN CROSSWINDS

    Fleming, J. / Jones, T. / Ng, W. et al. | British Library Conference Proceedings | 2003


    A Geometric Modeler for the Conceptual Design of Ducted Fan UAVs

    Zhang, Xinyu / Myklebust, Arvid / Gelhausen, Paul | AIAA | 2004


    Fan Angular Momentum Analysis for Ducted Fan UAVs During Conceptual Design

    Stiltner, B. / Ohanian, O. / American Institute of Aeronautics and Astronautics | British Library Conference Proceedings | 2012