Autonomously tracking a dynamic unmanned ground vehicle (UGV) with an unmanned aerial vehicle (UAV) is challenging due to the difficulty for the UAV to track the UGV’s real-time state and adjust its policy accordingly. In this paper, we propose a deep reinforcement learning approach for a quadrotor UAV to track a moving UGV without knowing its motion dynamics. The proposed learning framework consists of two main systems: a Tracking Vision System (TVS) utilizing deep learning and a Tracking Control System (TCS) utilizing deep reinforcement learning. The TVS recognizes the UGV by analyzing images captured by the UAV, and then it provides the TCS with input data that is used to fulfill Markov Decision Process (MDP) in the TCS. The TCS generates optimal landing policies learned through simulated training. Moreover, we propose an Expert Knowledge Transfer (EKT) algorithm that allows human intervention in the UAV’s action space, which can speed up the training process. We demonstrate the effectiveness of the proposed method in simulation experiments.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A Deep Reinforcement Learning-Based Approach for Autonomous Quadrotor Tracking Control


    Additional title:

    Lect. Notes Electrical Eng.


    Contributors:
    Qu, Yi (editor) / Gu, Mancang (editor) / Niu, Yifeng (editor) / Fu, Wenxing (editor) / Deng, Lan (author) / Wang, Jiaqing (author) / Jiang, Shuang (author) / Guo, Shuang (author) / Peng, Ao (author)

    Conference:

    International Conference on Autonomous Unmanned Systems ; 2023 ; Nanjing, China September 09, 2023 - September 11, 2023



    Publication date :

    2024-04-23


    Size :

    10 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Autonomous Quadrotor Landing using Deep Reinforcement Learning

    Polvara, Riccardo / Patacchiola, Massimiliano / Sharma, Sanjay et al. | ArXiv | 2017

    Free access


    A Reinforcement Learning Approach for Autonomous Control and Landing of a Quadrotor

    Vankadari, Madhu Babu / Das, Kaushik / Shinde, Chinmay et al. | IEEE | 2018



    Attitude Control Based on Reinforcement Learning for Quadrotor

    Wang, Yao / Zhang, Weiping / Mou, Jiawang et al. | TIBKAT | 2022