As the number of viable applications for unmanned aerial vehicle (UAV) systems increases at an exponential rate, interfaces that reduce the reliance on highly skilled engineers and pilots must be developed. Recent work aims to make use of common human communication modalities such as speech and gesture. This paper explores a multimodal natural language interface that uses a combination of speech and gesture input modalities to build complex UAV flight paths by defining trajectory segment primitives. Gesture inputs are used to define the general shape of a segment while speech inputs provide additional geometric information needed to fully characterize a trajectory segment. A user study is conducted in order to evaluate the efficacy of the multimodal interface.


    Zugriff

    Zugriff über TIB

    Verfügbarkeit in meiner Bibliothek prüfen


    Exportieren, teilen und zitieren



    Titel :

    Natural Language Based Multimodal Interface for UAV Mission Planning


    Beteiligte:

    Kongress:

    Human Factors and Ergonomics Society (HFES) International Annual Meeting 2017 ; 2017 ; Austin, TX, United States


    Erscheinungsdatum :

    09.10.2017


    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Keine Angabe


    Sprache :

    Englisch




    Natural language mission planning and interface

    CHEREPINSKY IGOR / SAHAY PRATEEK / WARD MARK D et al. | Europäisches Patentamt | 2020

    Freier Zugriff

    NATURAL LANGUAGE MISSION PLANNING AND INTERFACE

    CHEREPINSKY IGOR / SAHAY PRATEEK / WARD MARK D et al. | Europäisches Patentamt | 2018

    Freier Zugriff

    'Fly Like This': Natural Language Interface for UAV Mission Planning

    Chandarana, Meghan / Meszaros, Erica L. / Trujillo, Anna et al. | NTRS | 2017


    MISSION PLANNING INTERFACE FOR ACCESSING VEHICLE RESOURCES

    KHAZAN ROGER / PETCHER ADAM SHAWN / UTIN DANIIL M | Europäisches Patentamt | 2018

    Freier Zugriff

    Improving Information Search Using Natural Language and Direct Manipulation Tools in a Multimodal Interface

    Miller, S. L. / Trafton, J. G. / Human Factors and Ergonomics Society | British Library Conference Proceedings | 1999