Computacional recognition of sign languages aims to allow a greater social and digital inclusion of deaf people through interpretation of their language by computer. This article presents a model of recognition of two of global parameters from sign languages; hand configurations and hand movements. Hand motion is captured through an infrared technology and its joints are built into a virtual three-dimensional space. A Multilayer Perceptron Neural Network (MLP) was used to classify hand configurations and Dynamic Time Warping (DWT) recognizes hand motion. Beyond of the method of sign recognition, we provide a dataset of hand configurations and motion capture built with help of fluent professionals in sign languages. Despite this technology can be used to translate any sign from any signs dictionary, Brazilian Sign Language (Libras) was used as case study. Finally, the model presented in this paper achieved a recognition rate of 80.4%.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    A Motion Dictionary to Real-Time Recognition of Sign Language Alphabet Using Dynamic Time Warping and Artificial Neural Network


    Beteiligte:
    Marcio Leal (Autor:in) / Marta Villamil (Autor:in)

    Erscheinungsdatum :

    01.11.2018


    Anmerkungen:

    oai:zenodo.org:2363175
    International Journal of Electrical, Electronic and Communication Sciences 12.0(12)



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    DDC:    629 / 410




    Speech Recognition using Dynamic Time Warping

    Amin, Talal Bin / Mahmood, Iftekhar | IEEE | 2008


    Randomized time warping for motion recognition

    Suryanto, C. H. / Xue, J. H. / Fukui, K. | British Library Online Contents | 2016


    Real-Time Dynamic Gesture Recognition based on Boundary-Constraint Dynamic Time Warping

    Cheng, Chunling / Liu, Yangjunwu / Yang, Jian et al. | IEEE | 2019


    Voice-Assisted Real-Time Traffic Sign Recognition System Using Convolutional Neural Network

    Manawadu, Mayura / Wijenayake, Udaya | ArXiv | 2024

    Freier Zugriff

    Real-Time Traffic Sign Recognition Using Convolutional Neural Networks

    Rao, Aditya / Motwani, Rahul / Sarguroh, Naveed et al. | Springer Verlag | 2021