In this paper, a story-telling social robot is proposed. The robot is able to modify the evolution of the story considering the emotions the audience is feeling. To do that, the robot uses the user’s emotion from his/her face. We have used a deep learning-based model to identify the emotion. This model was trained and tested on state of the art dataset. We also demonstrate that involving generated, realistic samples in the training process as a way of data augmentation does not benefit the model at all. The mentioned samples are generated by a state of the art GAN, which is able to translate neutral faces to a range of emotions.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A Story-Telling Social Robot with Emotion Recognition Capabilities for the Intellectually Challenged


    Additional title:

    Advs in Intelligent Syst., Computing



    Conference:

    Iberian Robotics conference ; 2019 ; Porto, Portugal November 20, 2019 - November 22, 2019



    Publication date :

    2019-11-20


    Size :

    11 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    A Story-Telling Social Robot with Emotion Recognition Capabilities for the Intellectually Challenged

    Azuar, David / Gallud, Guillermo / Escalona, Felix et al. | TIBKAT | 2020


    Geoffrey: An Automated Schedule System on a Social Robot for the Intellectually Challenged

    Rangel, José Carlos / Cruz, Edmanuel / Escalona, Félix et al. | BASE | 2020

    Free access

    Unternehmenspotenziale mit "Story Telling" aufdecken und nutzen

    Hesser, Erwin / Thier, Karin | IuD Bahn | 2007


    Design story - Nissan GT-R, European supercars challenged

    Gandini, Marzia | Online Contents | 2008


    MPISTE: A Mobile, Personalised, Interactive Story Telling Environment

    Delgado-Mata, C / Velazquez, R / Pooley, R J et al. | IEEE | 2010