Unmanned aerial vehicles (UAVs) play an vital role in modern air combats, where manned fighter (leader) can better perform air combat with the assisting of UAVs. The key technology for cooperative air warfare between UAVs and manned aircraft is UAV autonomous maneuver strategy. In this paper, an autonomous maneuver strategy of UAV wingman to assist leader in air combat is proposed. Firstly, based on the mission scenario and process of cooperative air combat, the UAV-assisted leader air combat model is established. Second, a two-level maneuver strategy method of UAV based on hierarchical reinforcement learning is designed, where the low-level agents control the game with enemy and manned fighter collaboration, and they are selected by a high-level agent. The reward functions of each agent are designed according to the relative situation to leader and enemy. Finally, the simulation experiment shows that the UAV can assist leader to strike enemy, proving the effectiveness of the proposed maneuver strategy.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Autonomous Maneuver Strategy of UAV Wingman Air Combat Based on Hierarchical Reinforcement Learning


    Weitere Titelangaben:

    Lect. Notes Electrical Eng.


    Beteiligte:
    Qu, Yi (Herausgeber:in) / Gu, Mancang (Herausgeber:in) / Niu, Yifeng (Herausgeber:in) / Fu, Wenxing (Herausgeber:in) / Hu, Jinwen (Autor:in) / Guo, Kun (Autor:in) / Xu, Zhao (Autor:in) / Xu, Gang (Autor:in)

    Kongress:

    International Conference on Autonomous Unmanned Systems ; 2023 ; Nanjing, China September 09, 2023 - September 11, 2023



    Erscheinungsdatum :

    26.04.2024


    Format / Umfang :

    10 pages





    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Loyal wingman task execution for future aerial combat: A hierarchical prior-based reinforcement learning approach

    ZHANG, Jiandong / WANG, Dinghan / YANG, Qiming et al. | Elsevier | 2024

    Freier Zugriff

    Autonomous maneuver strategy of swarm air combat based on DDPG

    Wang, Luhe / Hu, Jinwen / Xu, Zhao et al. | Springer Verlag | 2021

    Freier Zugriff


    Autonomous Maneuver Decision of UAV in Air Combat Based on Scenario-Transfer Deep Reinforcement Learning

    Jin, Quan / Gao, Xianzhong / Guo, Zheng et al. | British Library Conference Proceedings | 2022


    Autonomous Maneuver Decision of UAV in Air Combat Based on Scenario-Transfer Deep Reinforcement Learning

    Jin, Quan / Gao, Xianzhong / Guo, Zheng et al. | Springer Verlag | 2022