The UAV pursuit-evasion strategy based on Deep Deterministic Policy Gradient (DDPG) algorithm is a current research hotspot. However, this algorithm has the defect of low efficiency in sample exploration. To solve this problem, this paper uses the imitation learning (IL) to improve the DDPG exploration strategy. A kind of quasiproportional guidance control law is designed to generate effective learning samples, which are used as the data of the initial experience pool of DDPG algorithm. The UAV pursuit-evasion strategy based on DDPG and imitation learning (IL-DDPG) is proposed, and the algorithm obtains the data from the experience pool for experience playback learning, which improves the exploration efficiency of the algorithm in the initial stage of training and avoids the problem of too many useless exploration in the training process. The simulation results show that the trained pursuit-UAV can flexibly adjust the flight speed and flight attitude to pursuit the evasion-UAV quickly. It also verifies that the improved DDPG algorithm is more effective than the basic DDPG algorithm to improve the training efficiency.


    Access

    Download


    Export, share and cite



    Title :

    A UAV Pursuit-Evasion Strategy Based on DDPG and Imitation Learning


    Contributors:
    Xiaowei Fu (author) / Jindong Zhu (author) / Zhaoying Wei (author) / Hui Wang (author) / Sili Li (author)


    Publication date :

    2022




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Scientific Machine Learning Based Pursuit-Evasion Strategy in Unmanned Surface Vessel Defense Tactics

    Celik, Ugurcan / Uzun, Mevlut / Inalhan, Gokhan et al. | IEEE | 2024


    Range-Limited Pursuit-Evasion

    Weintraub, Isaac E. / Von Moll, Alexander / Pachter, Meir | IEEE | 2023


    Pursuit/evasion in orbit

    Kelley, H. J. / Cliff, E. M. / Lutze, F. H. | NTRS | 1981


    Noisy satellite pursuit-evasion

    MERZ, A. | AIAA | 1987


    Autopilot Strategy Based on Improved DDPG Algorithm

    Zuo, Xiaochao / Li, Xiaoning / Tian, Zhewen | SAE Technical Papers | 2019