Hybrid Model of Emotions Inference - An Approach based on Fusion of Physical and Cognitive Informations

Ernani Gottardo, Andrey Ricardo Pimentel

2018

Abstract

Adapting to users’ affective state is a key feature for building a new generation of more user-friendly, engaging and interactive software. In the educational context this feature is especially important considering the intrinsic relationship between emotions and learning. So, this paper presents as its main contribution the proposal of a hybrid model of learning related emotion inference. The model combines physical and cognitive elements involved in the process of generation and control of emotions. In this model, the facial expressions are used to identify students’ physical emotional reactions, while events occurring in the software interface provide information for the cognitive component. Initial results obtained with the model execution demonstrate the feasibility of this proposal and also indicate some promising results. In a first experiment with eight students an overall emotion inference accuracy rate of 60% was achieved while students used a game based educational software. Furthermore, using the model’s inferences it was possible to build a pattern of students’ learning related affective states. This pattern should be used to guide automatic tutorial intervention or application of specific pedagogical techniques to soften negative learning states like frustration or boredom, trying to keep the student engaged on the activity

Paper Citation

in Harvard Style

Gottardo E. and Ricardo Pimentel A. (2018). Hybrid Model of Emotions Inference - An Approach based on Fusion of Physical and Cognitive Informations.In Proceedings of the 20th International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 978-989-758-298-1, pages 441-450. DOI: 10.5220/0006684004410450

in Bibtex Style

@conference{iceis18,
author={Ernani Gottardo and Andrey Ricardo Pimentel},
title={Hybrid Model of Emotions Inference - An Approach based on Fusion of Physical and Cognitive Informations},
booktitle={Proceedings of the 20th International Conference on Enterprise Information Systems - Volume 2: ICEIS,},
year={2018},
pages={441-450},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006684004410450},
isbn={978-989-758-298-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 20th International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - Hybrid Model of Emotions Inference - An Approach based on Fusion of Physical and Cognitive Informations
SN - 978-989-758-298-1
AU - Gottardo E.
AU - Ricardo Pimentel A.
PY - 2018
SP - 441
EP - 450
DO - 10.5220/0006684004410450