Considering the widespread integration of aerial robots in inspection, search and rescue, and monitoring tasks, there is a growing demand to design intuitive human-drone interfaces. These aim to streamline and enhance the user interaction and collaboration process during drone navigation, ultimately expediting mission success and accommodating users' inputs. In this paper, we present a novel human-drone mixed reality interface that aims to (a) increase human-drone spatial awareness by sharing relevant spatial information and representations between the human equipped with a Head Mounted Display (HMD) and the robot and (b) enable safer and intuitive human-drone interactive and collaborative navigation in unknown environments beyond the simple command and control or teleoperation paradigm. We validate our framework through extensive user studies and experiments in a simulated post-disaster scenario, comparing its performance against a traditional First-Person View (FPV) control systems. Furthermore, multiple tests on several users underscore the advantages of the proposed solution, which offers intuitive and natural interaction with the system. This demonstrates the solution's ability to assist humans during a drone navigation mission, ensuring its safe and effective execution.


    Access

    Download


    Export, share and cite



    Title :

    Intuitive Human-Drone Collaborative Navigation in Unknown Environments through Mixed Reality


    Contributors:

    Publication date :

    2025


    Remarks:

    Approved at ICUAS 25
    2025 International Conference on Unmanned Aircraft Systems (ICUAS 25)


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Intuitive Human-Drone Collaborative Navigation in Unknown Environments Through Mixed Reality

    Salunkhe, Sanket A. / Nedunghat, Pranav / Morando, Luca et al. | IEEE | 2025


    Development of a Virtual Reality Environment (VRE) for Intuitive Drone Operations

    Whitman, Eric / Gao, Joseph / Anderson, Nicholas et al. | SAE Technical Papers | 2017


    Development of a Virtual Reality Environment (VRE) for Intuitive Drone Operations

    Anderson, Nicholas / Gao, Joseph / Whitman, Eric et al. | British Library Conference Proceedings | 2017


    Intuitive and Safe Interaction in Multi-User Human Robot Collaboration Environments through Augmented Reality Displays

    Georgios Tsamis / Georgios Chantziaras / Dimitrios Giakoumis et al. | BASE | 2021

    Free access

    Human-inspired Robot Navigation in Unknown Dynamic Environments

    Pradeep, Yazhini C. / Ming, Zhu / Rosario, Manuel Del et al. | British Library Conference Proceedings | 2016