Most literature has extensively discussed reinforcement learning (RL) for controlling rotorcraft drones during flight for traversal tasks. However, most studies lack adequate details regarding the design of reward and punishment mechanisms, and there is a limited exploration of the feasibility of applying reinforcement learning in actual flight control following simulation experiments. Consequently, this study focuses on the exploration of reward and punishment design and state input for RL. The simulation environment is constructed using AirSim and Unreal Engine, with onboard camera footage serving as the state input for reinforcement learning. The research investigates three RL algorithms suitable for discrete action training. The Deep Q Network (DQN), Advantage Actor–Critic (A2C), and Proximal Policy Optimization (PPO) were combined with three different reward and punishment design mechanisms for training and testing. The results indicate that employing the PPO algorithm along with a continuous return method as the reward mechanism allows for effective convergence during the training process, achieving a target traversal rate of 71% in the testing environment. Furthermore, this study proposes integrating the YOLOv7-tiny object detection (OD) system to assess the applicability of reinforcement learning in real-world settings. Unifying the state inputs of simulated and OD environments and replacing the original simulated image inputs with a maximum dual-target approach, the experimental simulation achieved a target traversal rate of 52% ultimately. In summary, this research formulates a set of logical frameworks for an RL reward and punishment design deployed with real-time Yolo’s OD implementation synergized as a useful aid for related RL studies.


    Access

    Download


    Export, share and cite



    Title :

    Application of Reinforcement Learning in Controlling Quadrotor UAV Flight Actions


    Contributors:


    Publication date :

    2024




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Reinforcement Learning Applied to a Quadrotor Guidance Law in Autonomous Flight

    Junell, Jaime L. / Van Kampen, Erik-Jan / de Visser, Coen C. et al. | AIAA | 2015


    Reinforcement Learning Applied to a Quadrotor Guidance Law in Autonomous Flight (AIAA 2015-1990)

    Junell, Jaime L. / Van Kampen, Erik-Jan / De Visser, Coen C. et al. | British Library Conference Proceedings | 2015


    Autonomous Quadrotor Landing using Deep Reinforcement Learning

    Polvara, Riccardo / Patacchiola, Massimiliano / Sharma, Sanjay et al. | ArXiv | 2017

    Free access

    Attitude Control Based on Reinforcement Learning for Quadrotor

    Wang, Yao / Zhang, Weiping / Mou, Jiawang et al. | TIBKAT | 2022


    Controller design for quadrotor UAVs using reinforcement learning

    Bou-Ammar, H. / Voos, H. / Ertel, W. | Tema Archive | 2010