The UAV pursuit-evasion strategy based on Deep Deterministic Policy Gradient (DDPG) algorithm is a current research hotspot. However, this algorithm has the defect of low efficiency in sample exploration. To solve this problem, this paper uses the imitation learning (IL) to improve the DDPG exploration strategy. A kind of quasiproportional guidance control law is designed to generate effective learning samples, which are used as the data of the initial experience pool of DDPG algorithm. The UAV pursuit-evasion strategy based on DDPG and imitation learning (IL-DDPG) is proposed, and the algorithm obtains the data from the experience pool for experience playback learning, which improves the exploration efficiency of the algorithm in the initial stage of training and avoids the problem of too many useless exploration in the training process. The simulation results show that the trained pursuit-UAV can flexibly adjust the flight speed and flight attitude to pursuit the evasion-UAV quickly. It also verifies that the improved DDPG algorithm is more effective than the basic DDPG algorithm to improve the training efficiency.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    A UAV Pursuit-Evasion Strategy Based on DDPG and Imitation Learning


    Beteiligte:
    Xiaowei Fu (Autor:in) / Jindong Zhu (Autor:in) / Zhaoying Wei (Autor:in) / Hui Wang (Autor:in) / Sili Li (Autor:in)


    Erscheinungsdatum :

    2022




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt




    Scientific Machine Learning Based Pursuit-Evasion Strategy in Unmanned Surface Vessel Defense Tactics

    Celik, Ugurcan / Uzun, Mevlut / Inalhan, Gokhan et al. | IEEE | 2024


    Pursuit/evasion in orbit

    Kelley, H. J. / Cliff, E. M. / Lutze, F. H. | NTRS | 1981


    Noisy satellite pursuit-evasion

    MERZ, A. | AIAA | 1987


    Range-Limited Pursuit-Evasion

    Weintraub, Isaac E. / Von Moll, Alexander / Pachter, Meir | IEEE | 2023


    Autopilot Strategy Based on Improved DDPG Algorithm

    Zuo, Xiaochao / Li, Xiaoning / Tian, Zhewen | SAE Technical Papers | 2019