With the thriving development of communication systems and the ubiquity of commodity WiFi devices, wireless intelligent sensing has attracted increasingly attention owing to its importance in Human-Computer Interaction (HCI) where hand gesture recognition has been widely studied these years. However, most of gesture recognition approaches have a limited performance owing to the background noises. In this paper, we present a multimodal fusion-Gaussian mixed model (GMM) based gesture recognition scheme by exploiting channel state information (CSI) of WiFi signals. To this end, we firstly design two theoretical underpinnings, including a sensing model and a recognition model. Firstly, the sensing model is established to investigate the impact of gestures on the propagation properties of WiFi signals and quantify the correlation between the CSI dynamics and various gestures. Secondly, the recognition model is used to exploit physical gesture-induced signal changes to infer potential gestures information. Then, we implement the proposed scheme on a set of WiFi devices and evaluate it in both laboratory and corridor environments. The experiment results show that the proposed scheme can achieve average recognition accuracies of 96% and 94% in these two scenarios, respectively. This shows promise for future ubiquitous hands-free gesture-based interaction with mobile devices.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multimodal Fusion-GMM based Gesture Recognition for Smart Home by WiFi Sensing


    Contributors:
    Ding, Jianyang (author) / Wang, Yong (author) / Si, Hongyan (author) / Ma, Jiannan (author) / He, Jingwen (author) / Liang, Kai (author) / Fu, Shaozhong (author)


    Publication date :

    2022-06-01


    Size :

    1773401 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    WiFi-Based Low-Complexity Gesture Recognition Using Categorization

    Kim, Ji Soo / Jeon, Wha Sook / Jeong, Dong Geun | IEEE | 2022


    Gesture Recognition in Robotic Surgery with Multimodal Attention

    Van Amsterdam, B / Funke, I / Edwards, E et al. | BASE | 2022

    Free access

    Multimodal Fusion of Voice and Gesture Data for UAV Control

    Xiaojia Xiang / Qin Tan / Han Zhou et al. | DOAJ | 2022

    Free access

    VEHICLE SENSING GESTURE RECOGNITION SYSTEM AND METHOD IN VEHICLE WITH SMART HELMET

    BENZUN PIOUS WISELY BABU / REN LIU / SHABNAM GHAFFARZADEGAN et al. | European Patent Office | 2021

    Free access

    A Classification-Based Occupant Detection Method for Smart Home Using Multiple-WiFi Sniffers

    Wang, Ping / Cao, Huaqian / Chen, Si et al. | Springer Verlag | 2019