The paper proposes a novel visual navigation framework to address the challenges encountered by unmanned aerial vehicles (UAVs) when operating in indoor environments, including insufficient image feature extraction and poor exploration. The framework utilizes depth images, flight state data, and relative orientation information to guide the UAV towards the intended destination in an end-to-end manner. In addition, we have designed a Convolutional Block Attention Module (CBAM) with a non-sparse reward mechanism to enhance the efficiency of visual feature extraction, thereby improving the UAV’s exploratory capabilities. We have deployed the algorithm in an AirSim-based simulation environment, characterized by ever-changing obstacles, to validate its effectiveness. The results demonstrate that our algorithm enables the UAV to avoid obstacles and reach the destination effectively in unfamiliar indoor environments. This solution has significant implications for the effective deployment of UAVs in indoor settings, particularly in applications such as search and rescue, inspection, and surveillance.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Vision-Based Indoor UAV Navigation with Deep Reinforcement Learning


    Additional title:

    Lect. Notes Electrical Eng.


    Contributors:
    Liu, Lianqing (editor) / Niu, Yifeng (editor) / Fu, Wenxing (editor) / Qu, Yi (editor) / Guo, Yuxuan (author) / Tang, Lei (author) / Zhou, Xin (author) / Zhang, Junzhe (author) / Chen, Longbin (author)

    Conference:

    International Conference on Autonomous Unmanned Systems ; 2024 ; Shenyang, China September 19, 2024 - September 21, 2024



    Publication date :

    2025-03-22


    Size :

    12 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Indoor Point-to-Point Navigation with Deep Reinforcement Learning and Ultra-Wideband

    Chiaberge, Marcello / Fantin, Giovanni / Salvetti, Francesco et al. | BASE | 2021

    Free access

    A Deep Reinforcement Learning Framework for UAV Navigation in Indoor Environments

    Walker, Ory / Vanegas, Fernando / Gonzalez, Felipe et al. | IEEE | 2019


    Vision-Based Deep Reinforcement Learning of UAV Autonomous Navigation Using Privileged Information

    Wang, Junqiao / Yu, Zhongliang / Zhou, Dong et al. | ArXiv | 2024

    Free access

    Vision-based Distributed Multi-UAV Collision Avoidance via Deep Reinforcement Learning for Navigation

    Huang, Huaxing / Zhu, Guijie / Fan, Zhun et al. | ArXiv | 2022

    Free access

    Automatic navigation using deep reinforcement learning

    BALAKRISHNAN KAUSHIK / NARAYANAN PRAVEEN / LAKEHAL-AYAT MOHSEN | European Patent Office | 2023

    Free access