Visual servoing is a control method that utilizes image feedback to control robot motion, and it has been widely applied in unmanned aerial vehicle (UAV) motion control. However, due to field-of-view (FOV) constraints, visual servoing still faces challenges, such as easy target loss and low control efficiency. To address these issues, visual servoing control for UAVs based on the deep reinforcement learning (DRL) method is proposed, which dynamically adjusts the servo gain in real time to avoid target loss and improve control efficiency. Firstly, a Markov model of visual servoing control for a UAV under field-of-view constraints is established, which consists ofquintuplet and considers the improvement of the control efficiency. Secondly, an improved deep Q-network (DQN) algorithm with a target network and experience replay is designed to solve the Markov model. In addition, two independent agents are designed to adjust the linear and angular velocity servo gains in order to enhance the control performance, respectively. In the simulation environment, the effectiveness of the proposed method was verified using a monocular camera.


    Access

    Download


    Export, share and cite



    Title :

    Deep Reinforcement Learning for the Visual Servoing Control of UAVs with FOV Constraint


    Contributors:
    Gui Fu (author) / Hongyu Chu (author) / Liwen Liu (author) / Linyi Fang (author) / Xinyu Zhu (author)


    Publication date :

    2023




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Nonlinear Visual Servoing Control for VTOL UAVs with Field of View Constraint

    de Plinval, Henry / Burlion, Laurent | Springer Verlag | 2015


    Adaptive visual servoing of UAVs using a virtual camera

    Hui Xie / Fink, Geoff / Lynch, Alan F. et al. | IEEE | 2016


    Dynamic output feedback image-based visual servoing of rotorcraft UAVs

    Xie, Hui / Li, Jianan / Low, K.H. | IEEE | 2017


    Visual Servoing NMPC Applied to UAVs for Photovoltaic Array Inspection

    Velasco-Sánchez, Edison P. / Recalde, Luis F. / Guevara, Bryan S. et al. | ArXiv | 2023

    Free access

    Deep Reinforcement Learning Attitude Control of Fixed-Wing UAVs

    Zhen, Yan / Hao, Mingrui / Sun, Wendi | IEEE | 2020