We present a real-time algorithm for emotion-aware navigation of a robot among pedestrians. Our approach estimates time-varying emotional behaviors of pedestrians from their faces and trajectories using a combination of Bayesian-inference, CNN-based learning, and the PAD (Pleasure-Arousal-Dominance) model from psychology. These PAD characteristics are used for long-term path prediction and generating proxemic constraints for each pedestrian. We use a multi-channel model to classify pedestrian characteristics into four emotion categories (happy, sad, angry, neutral). In our validation results, we observe an emotion detection accuracy of 85.33%. We formulate emotion-based proxemic constraints to perform socially-aware robot navigation in low- to medium-density environments. We demonstrate the benefits of our algorithm in simulated environments with tens of pedestrians as well as in a real-world setting with Pepper, a social humanoid robot.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    The Emotionally Intelligent Robot: Improving Social Navigation in Crowded Environments


    Beteiligte:
    Bera, Aniket (Autor:in) / Randhavane, Tanmay (Autor:in) / Prinja, Rohan (Autor:in) / Kapsaskis, Kyra (Autor:in) / Wang, Austin (Autor:in) / Gray, Kurt (Autor:in) / Manocha, Dinesh (Autor:in)

    Erscheinungsdatum :

    2019


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Robot companion: a social-force based approach with human awareness-navigation in crowded environments

    Ferrer Mínguez, Gonzalo / Garrell Zulueta, Anais / Sanfeliu Cortés, Alberto | BASE | 2013

    Freier Zugriff

    Dynamic trajectory planning for mobile robot navigation in crowded environments

    PRIMATESTA, STEFANO / RUSSO, LUDOVICO ORLANDO / BONA, Basilio | BASE | 2016

    Freier Zugriff

    Robot companion: A social-force based approach with human awareness-navigation in crowded environments

    Ferrer, Gonzalo / Garrell, Anaís / Sanfeliu, Alberto | BASE | 2013

    Freier Zugriff