This paper presents a new reward function that can be used for deep reinforcement learning in unmanned aerial vehicle (UAV) control and navigation problems. The reward function is based on the construction and estimation of the time of simplified trajectories to the target, which are third-order Bezier curves. This reward function can be applied unchanged to solve problems in both two-dimensional and three-dimensional virtual environments. The effectiveness of the reward function was tested in a newly developed virtual environment, namely, a simplified two-dimensional environment describing the dynamics of UAV control and flight, taking into account the forces of thrust, inertia, gravity, and aerodynamic drag. In this formulation, three tasks of UAV control and navigation were successfully solved: UAV flight to a given point in space, avoidance of interception by another UAV, and organization of interception of one UAV by another. The three most relevant modern deep reinforcement learning algorithms, Soft actor-critic, Deep Deterministic Policy Gradient, and Twin Delayed Deep Deterministic Policy Gradient were used. All three algorithms performed well, indicating the effectiveness of the selected reward function.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Reinforcement learning reward function in unmanned aerial vehicle control tasks


    Beteiligte:

    Erscheinungsdatum :

    2022


    Anmerkungen:

    J. Phys.: Conf. Ser. 2308 012004 (2022)



    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Unmanned aerial vehicle remote control algorithm based on sectional reinforcement learning

    LIAO YANGZHI / ZOU YING / CHEN ZUGUO et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Autonomous Navigation of Unmanned Aerial Vehicle Using Reinforcement Learning

    Bansal, Payal / Joshi, Jyotsna / Hans, Surender et al. | Wiley | 2024



    Demonstration Shaped Reward Machine for Robot Assembly Reinforcement Learning Tasks

    Xiao, Ruihong / Zhan, Hong / Jiang, Yiming et al. | Springer Verlag | 2023


    Unmanned aerial vehicle hangar with unmanned aerial vehicle centering function

    HUANG WEI / DENG SHIYUN / SHI JUNXIAN et al. | Europäisches Patentamt | 2025

    Freier Zugriff