As the number of viable applications for unmanned aerial vehicle (UAV) systems increases at an exponential rate, interfaces that reduce the reliance on highly skilled engineers and pilots must be developed. Recent work aims to make use of common human communication modalities such as speech and gesture. This paper explores a multimodal natural language interface that uses a combination of speech and gesture input modalities to build complex UAV flight paths by defining trajectory segment primitives. Gesture inputs are used to define the general shape of a segment while speech inputs provide additional geometric information needed to fully characterize a trajectory segment. A user study is conducted in order to evaluate the efficacy of the multimodal interface.


    Access

    Access via TIB

    Check availability in my library


    Export, share and cite



    Title :

    Natural Language Based Multimodal Interface for UAV Mission Planning


    Contributors:

    Conference:

    Human Factors and Ergonomics Society (HFES) International Annual Meeting 2017 ; 2017 ; Austin, TX, United States


    Publication date :

    2017-10-09


    Type of media :

    Conference paper


    Type of material :

    No indication


    Language :

    English




    Natural language mission planning and interface

    CHEREPINSKY IGOR / SAHAY PRATEEK / WARD MARK D et al. | European Patent Office | 2020

    Free access

    NATURAL LANGUAGE MISSION PLANNING AND INTERFACE

    CHEREPINSKY IGOR / SAHAY PRATEEK / WARD MARK D et al. | European Patent Office | 2018

    Free access

    'Fly Like This': Natural Language Interface for UAV Mission Planning

    Chandarana, Meghan / Meszaros, Erica L. / Trujillo, Anna et al. | NTRS | 2017


    MISSION PLANNING INTERFACE FOR ACCESSING VEHICLE RESOURCES

    KHAZAN ROGER / PETCHER ADAM SHAWN / UTIN DANIIL M | European Patent Office | 2018

    Free access

    Django as a Mission Planning Tool Interface for the CYGNSS Mission

    Ewing, Tim / Redfern, Jillian / Alexander, Amanda et al. | IEEE | 2021