Limitations of Emotion Recognition from Facial Expressions in e-Learning Context

Agnieszka Landowska, Grzegorz Brodny, Michal R. Wrobel

2017

Abstract

The paper concerns technology of automatic emotion recognition applied in e-learning environment. During a study of e-learning process the authors applied facial expressions observation via multiple video cameras. Preliminary analysis of the facial expressions using automatic emotion recognition tools revealed several unexpected results, including unavailability of recognition due to face coverage and significant inconsistency between the results obtained from two cameras. The paper presents the experiment on e-learning process and summarizes the observations that constitute limitations of emotion recognition from facial expressions applied in e-learning context. The paper might be of interest to researchers and practitioners who consider automatic emotion recognition as an option in monitoring e-learning processes.

References

  1. Bailenson, J.N., Pontikakis, E.D., Mauss, I.B., Gross, J.J., Jabon, M.E., Hutcherson, C.A., Nass, C. and John, O., 2008. Real-time classification of evoked emotions using facial feature tracking and physiological responses. International Journal of Human-Computer Studies, 66(5), pp.303-317.
  2. Binali, H., Wu, C. and Potdar, V., 2010. Computational approaches for emotion detection in text. In 4th IEEE International Conference on Digital Ecosystems and Technologies. IEEE, pp. 172-177.
  3. Gunes, H. and Piccardi, M., 2005. Affect Recognition from Face and Body: Early Fusion vs. Late Fusion. In 2005 IEEE International Conference on Systems, Man and Cybernetics. IEEE, pp. 3437-3443.
  4. Gunes, H. and Schuller, B., Categorical and dimensional affect analysis in continuous input: Current trends and future directions. Image and Vision Computing, 31(2), pp.120-136.
  5. Wang, J., Yin, L., Wei, X. and Sun, Y., 2006. 3D Facial Expression Recognition Based on Primitive Surface Feature Distribution. In 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2 (CVPR'06). IEEE, pp. 1399- 1406.
  6. El Kaliouby, R. and Robinson, P., 2005. Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures. In 2004 Conference on Computer Vision and Pattern Recognition Workshop. IEEE, pp. 154-154.
  7. Kolakowska, A., 2015. Recognizing emotions on the basis of keystroke dynamics. In Human System Interactions (HSI), 2015 8th International Conference on. pp. 291- 297.
  8. Kolakowska, A., Landowska, A., Szwoch, M., Szwoch, W. and Wróbel, M.R., 2013. Emotion Recognition and its Application in Software Engineering. 6th International Conference on Human System Interaction, pp.532-539.
  9. Kolakowska, A., Landowska, A., Szwoch, M., Szwoch, W. and Wróbel, M.R., 2015. Modeling emotions for affect-aware applications. In Information Systems Development and Applications. Faculty of Management, University of Gdansk, pp. 55--69.
  10. Landowska, A., 2015a. Emotion monitor-concept, construction and lessons learned. In Computer Science and Information Systems (FedCSIS), 2015 Federated Conference on. pp. 75-80.
  11. Landowska, A., 2015b. Towards Emotion Acquisition in IT Usability Evaluation Context. In Proceedings of the Mulitimedia, Interaction, Design and Innnovation on ZZZ - MIDI 7815. New York, New York, USA: ACM Press, pp. 1-9.
  12. Landowska, A. and Miler, J., 2016. Limitations of Emotion Recognition in Software User Experience Evaluation Context. In Proceedings of the 2016 Federated Conference on Computer Science and Information Systems. pp. 1631-1640.
  13. Neviarouskaya, A., Prendinger, H. and Ishizuka, M., 2009. Compositionality Principle in Recognition of FineGrained Emotions from Text. In Proceedings of the Third International ICWSM Conference (2009). pp. 278-281.
  14. Picard, R.W. and Daily, S.B., 2005. Evaluating affective interactions: Alternatives to asking what users feel. In CHI Workshop on Evaluating Affective Interfaces: Innovative Approaches. pp. 2119-2122.
  15. Sayette, M.A., Cohn, J.F., Wertz, J.M., Perrott, M.A. and Parrott, D.J., 2001. A Psychometric Evaluation of the Facial Action Coding System for Assessing Spontaneous Expression. Journal of Nonverbal Behavior, 25(3), pp.167-185.
  16. Szwoch, M. and Pieniazek, P., 2015. Facial emotion recognition using depth data. In 2015 8th International Conference on Human System Interaction (HSI). IEEE, pp. 271-277.
  17. Vizer, L.M., Zhou, L. and Sears, A., 2009. Automated stress detection using keystroke and linguistic features: An exploratory study. International Journal of Human-Computer Studies, 67(10), pp.870-886.
  18. Zeng, Z., Pantic, M., Roisman, G.I. and Huang, T.S., 2009. A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 31(1), pp.39-58.
  19. Zimmermann, P., Gomez, P., Danuser, B. and Schär, S., 2006. Extending usability: putting affect into the userexperience. Proceedings of NordiCHI'06, pp.27-32.
Download


Paper Citation


in Harvard Style

Landowska A., Brodny G. and Wrobel M. (2017). Limitations of Emotion Recognition from Facial Expressions in e-Learning Context . In Proceedings of the 9th International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-758-240-0, pages 383-389. DOI: 10.5220/0006357903830389


in Bibtex Style

@conference{csedu17,
author={Agnieszka Landowska and Grzegorz Brodny and Michal R. Wrobel},
title={Limitations of Emotion Recognition from Facial Expressions in e-Learning Context},
booktitle={Proceedings of the 9th International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2017},
pages={383-389},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006357903830389},
isbn={978-989-758-240-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - Limitations of Emotion Recognition from Facial Expressions in e-Learning Context
SN - 978-989-758-240-0
AU - Landowska A.
AU - Brodny G.
AU - Wrobel M.
PY - 2017
SP - 383
EP - 389
DO - 10.5220/0006357903830389