Traditional UAV air warfare decision methods lack innovative maneuvering behavior. In this paper, we proposed an autonomous decision-making for UAVs based on deep reinforcement learning to solve the maneuvering decision-making problem in air warfare. Firstly, the air combat situation can be effectively calculated via Bayesian inference theory. Then, the UAV state transfer equation is established based on the its three-degree-of-freedom model. Specifically, the aerial combat situation affects the distribution of rewards. And the rewards are comprehensively designed by angle, distance, speed, and altitude. Thus, with Bayesian inference, the situation is calculated for changing the weights of rewards. Besides, the Ornstein-Uhlenbeck (OU) random noise, is introduced to improve the algorithm's exploratory performance during the training process. The aerial combat simulation results demonstrate the effectiveness of the proposed method, with the moving average reward values ultimately converging within the range of 120-130.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Reinforcement Learning of Aerial Combat Maneuver Decisions Based on UAVs Situation


    Contributors:


    Publication date :

    2023-09-22


    Size :

    992342 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    UAVs Maneuver Decision-Making Method Based on Transfer Reinforcement Learning

    Jindong Zhu / Xiaowei Fu / Zhe Qiao | DOAJ | 2022

    Free access



    Autonomous Maneuver Decision of UAV in Air Combat Based on Scenario-Transfer Deep Reinforcement Learning

    Jin, Quan / Gao, Xianzhong / Guo, Zheng et al. | British Library Conference Proceedings | 2022


    Autonomous Maneuver Decision of UAV in Air Combat Based on Scenario-Transfer Deep Reinforcement Learning

    Jin, Quan / Gao, Xianzhong / Guo, Zheng et al. | Springer Verlag | 2022