Harnessing human movements to command an Unmanned Aerial Vehicle (UAV) holds the potential to revolutionize their deployment, rendering it more intuitive and user-centric. In this research, we introduce a novel methodology adept at classifying three-dimensional human actions, leveraging them to coordinate on-field with a UAV. Utilizing a stereo camera, we derive both RGB and depth data, subsequently extracting three-dimensional human poses from the continuous video feed. This data is then processed through our proposed k-nearest neighbour classifier, the results of which dictate the behaviour of the UAV. It also includes mechanisms ensuring the robot perpetually maintains the human within its visual purview, adeptly tracking user movements. We subjected our approach to rigorous testing involving multiple tests with real robots. The ensuing results, coupled with comprehensive analysis, underscore the efficacy and inherent advantages of our proposed methodology.


    Access

    Download


    Export, share and cite



    Title :

    Intuitive Human-Robot Interface: A 3-Dimensional Action Recognition and UAV Collaboration Framework


    Contributors:

    Publication date :

    2024


    Remarks:

    Accepted in International Conference on Informatics in Control, Automation and Robotics (ICINCO) 2024


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    SYSTEM FOR INTUITIVE HUMAN-MACHINE INTERFACE

    HUNG HUNG-YUAN | European Patent Office | 2022

    Free access

    Legible Action Selection in Human-Robot Collaboration

    Zhu, Huaijiang / Gabler, Volker / Wollherr, Dirk | BASE | 2017

    Free access

    Intuitive and Safe Interaction in Multi-User Human Robot Collaboration Environments through Augmented Reality Displays

    Georgios Tsamis / Georgios Chantziaras / Dimitrios Giakoumis et al. | BASE | 2021

    Free access

    INTUITIVE PRECONDITIONING INTERFACE

    OCHOCINSKI CHRISTOPHER ADAM / PORRAS ANGEL FERNANDO / BOLGER BRYAN MICHAEL et al. | European Patent Office | 2017

    Free access

    Harmonization of Human Machine Interface - Intuitive Approach

    Graham, R. V. / IEEE / AIAA | British Library Conference Proceedings | 1997