Traditional UAV air warfare decision methods lack innovative maneuvering behavior. In this paper, we proposed an autonomous decision-making for UAVs based on deep reinforcement learning to solve the maneuvering decision-making problem in air warfare. Firstly, the air combat situation can be effectively calculated via Bayesian inference theory. Then, the UAV state transfer equation is established based on the its three-degree-of-freedom model. Specifically, the aerial combat situation affects the distribution of rewards. And the rewards are comprehensively designed by angle, distance, speed, and altitude. Thus, with Bayesian inference, the situation is calculated for changing the weights of rewards. Besides, the Ornstein-Uhlenbeck (OU) random noise, is introduced to improve the algorithm's exploratory performance during the training process. The aerial combat simulation results demonstrate the effectiveness of the proposed method, with the moving average reward values ultimately converging within the range of 120-130.
Reinforcement Learning of Aerial Combat Maneuver Decisions Based on UAVs Situation
2023-09-22
992342 byte
Conference paper
Electronic Resource
English
UAVs Maneuver Decision-Making Method Based on Transfer Reinforcement Learning
DOAJ | 2022
|Autonomous Maneuver Strategy of UAV Wingman Air Combat Based on Hierarchical Reinforcement Learning
Springer Verlag | 2024
|British Library Conference Proceedings | 2022
|