This paper presents a new reward function that can be used for deep reinforcement learning in unmanned aerial vehicle (UAV) control and navigation problems. The reward function is based on the construction and estimation of the time of simplified trajectories to the target, which are third-order Bezier curves. This reward function can be applied unchanged to solve problems in both two-dimensional and three-dimensional virtual environments. The effectiveness of the reward function was tested in a newly developed virtual environment, namely, a simplified two-dimensional environment describing the dynamics of UAV control and flight, taking into account the forces of thrust, inertia, gravity, and aerodynamic drag. In this formulation, three tasks of UAV control and navigation were successfully solved: UAV flight to a given point in space, avoidance of interception by another UAV, and organization of interception of one UAV by another. The three most relevant modern deep reinforcement learning algorithms, Soft actor-critic, Deep Deterministic Policy Gradient, and Twin Delayed Deep Deterministic Policy Gradient were used. All three algorithms performed well, indicating the effectiveness of the selected reward function.


    Access

    Download


    Export, share and cite



    Title :

    Reinforcement learning reward function in unmanned aerial vehicle control tasks


    Contributors:

    Publication date :

    2022


    Remarks:

    J. Phys.: Conf. Ser. 2308 012004 (2022)



    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Unmanned aerial vehicle remote control algorithm based on sectional reinforcement learning

    LIAO YANGZHI / ZOU YING / CHEN ZUGUO et al. | European Patent Office | 2024

    Free access

    Autonomous Navigation of Unmanned Aerial Vehicle Using Reinforcement Learning

    Bansal, Payal / Joshi, Jyotsna / Hans, Surender et al. | Wiley | 2024



    UNMANNED AERIAL VEHICLE, UNMANNED AERIAL VEHICLE CONTROL SYSTEM, AND UNMANNED AERIAL VEHICLE CONTROL METHOD

    ISHIKAWA NAOHIRO / TESHIMA TAKESHI | European Patent Office | 2024

    Free access

    Demonstration Shaped Reward Machine for Robot Assembly Reinforcement Learning Tasks

    Xiao, Ruihong / Zhan, Hong / Jiang, Yiming et al. | Springer Verlag | 2023