Affective Brain-Computer Interfaces (BCI) harness Neuroscience knowledge to develop affective interaction from first principles. In this paper, we explore affective engagement with a virtual agent through Neurofeedback (NF). We report an experiment where subjects engage with a virtual agent by expressing positive attitudes towards her under a NF paradigm. We use for affective input the asymmetric activity in the dorsolateral prefrontal cortex (DL-PFC), which has been previously found to be related to the high-level affective-motivational dimension of approach/avoidance. The magnitude of left-asymmetric DL-PFC activity, measured using fNIRS and treated as a proxy for approach, is mapped onto a control mechanism for the virtual agent’s facial expressions, in which Action Units are activated through a neural network. We carried out an experiment with 18 subjects, which demonstrated that subjects are able to successfully engage with the virtual agent by controlling their mental disposition through NF, and that they perceived the agent’s responses as realistic and consistent with their projected mental disposition. This interaction paradigm is particularly relevant in the case of affective BCI as it facilitates the volitional activation of specific areas normally not under conscious control. Overall, our contribution reconciles a model of affect derived from brain metabolic data with an ecologically valid, yet computationally controllable, virtual affective communication environment.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Affective Interaction with a Virtual Character through an fNIRS Brain-Computer Interface


    Beteiligte:
    Aranyi, Gabor (Autor:in) / Pecune, Florian (Autor:in) / Charles, Fred (Autor:in) / Pelachaud, Catherine (Autor:in) / Cavazza, Marc (Autor:in)

    Erscheinungsdatum :

    12.07.2016


    Anmerkungen:

    Aranyi , G , Pecune , F , Charles , F , Pelachaud , C & Cavazza , M 2016 , ' Affective Interaction with a Virtual Character through an fNIRS Brain-Computer Interface ' , Frontiers in Computational Neuroscience , pp. - . https://doi.org/10.3389/fncom.2016.00070



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    DDC:    629



    Brain Activity Recognition with a Wearable fNIRS Using Neural Networks

    Huve, Gauvain / Takahashi, Kazuhiko / Hashimoto, Masafumi | British Library Conference Proceedings | 2017


    The Effect of Spatial Consistence on Character Recognition of Brain-Computer Interface

    Yang, Jingjing / Wu, Qi / Dong, Xiao et al. | British Library Conference Proceedings | 2019


    Functional Brain Imaging of Train Driver by Functional Near-Infrared Spectroscopy (FNIRS)

    Kojima, T. / Tsunashima, H. / Shiozawa, T.Y. et al. | British Library Conference Proceedings | 2006


    Measurement of Train Driver’s Brain Activity by Functional Near-Infrared Spectroscopy (fNIRS)

    Kojima, T. / Tsunashima, H. / Shiozawa, T. et al. | British Library Online Contents | 2005


    Measurement of train driver's brain activity by functional near-infrared spectroscopy (fNIRS)

    Kojima, T. / Tsunashima, H. / Shiozawa, T. Y. | British Library Conference Proceedings | 2006