Identifying Psychophysiological Correlates of Boredom and Negative Mood Induced During HCI

Dimitris Giakoumis, Athanasios Vogiannou, Illka Kosunen, Kostantinos Moustakas, Dimitrios Tzovaras, George Hassapis

2010

Abstract

This paper presents work conducted towards the automatic recognition of negative emotions like boredom and frustration, induced due to the subject’s loss of interest during HCI. Focus was on the basic pre-requisite for the future development of systems utilizing an “affective loop”, namely effective recognition of the human affective state. Based on the concept of “repetition that causes loss of interest”, an experiment for the monitoring and analysis of biosignals during repetitive HCI tasks was deployed. During this experiment, subjects were asked to play a simple labyrinth-based 3D video game repeatedly, while biosignals from different modalities were monitored. Twenty one different subjects participated in the experiment, allowing for a rich biosignals database to be populated. Statistically significant correlations were identified between features extracted from two of the modalities used in the experiment (ECG and GSR) and the actual affective state of the subjects.

References

  1. Cornelius, R.R., 1996. The Science of Emotion. Prentice-Hall, Upper Saddle River, NJ
  2. Picard, R. W., Vyzas, E., and Healey, J. (2001). Toward machine emotional intelligence: Analysis of affective physiological state. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(10),1175-1191
  3. Kim, J. and Andre, E. (2008). Emotion recognition based on physiological changes in music listening. IEEE Transactions on Pattern Analysis Machine Intelligence, 30(12):2067-2083
  4. K. H. Kim, S. W. Bang, and S. R. Kim, "Emotion recognition system using short-term monitoring of physiological signals" Medical & Biological Engineering & Computing, vol. 42, pp. 419-427, May 2004
  5. Wagner, J.,Kim, J.,André, E. , 2005. From physiological signals to emotions: implementing and comparing selected methods for features extraction and classification. In: IEEE International Conference on Multimedia & Expo
  6. Haag, A., Goronzy, S., Schaich, P., Williams, J., 2004. Emotion recognition using biosensors: first step toward an automatic system. In: Affective Dialog Systems: Tutorial and Research Workshop, Kloster Irsee, Germany
  7. M. Benovoy, J. R. Cooperstock, and J. Deitcher. Biosignals analysis and its application in a performance setting - towards the development of an emotional-imaging generator. In P. Encarnação and A. Veloso, editors, BIOSIGNALS (1), pages 253-258. INSTICC, 2008
  8. Sundström, P. (2005), Exploring the Affective Loop, PhD thesis, Stockholm University
  9. Chanel, G.,Rebetez,C.,Bétrancourt, M.,Pun,T.,2008. Boredom, engagement and anxiety as indicators for adaptation to difficulty in games. In: 12th International Mind Trek Conference: Entertainment and Media in the Ubiquitous Era. ACM, Tampere, Finland
  10. Task force of the European society of cardiology and the North American society of pacing and electrophysiology. Heart rate variability - standards of measurement, physiological interpretation, and clinical use. Circulation, 93(5):1043-1065, March 1996
  11. Rainville, P., Bechara, A., Naqvi, N., Damasio, A.R., 2006. Basic emotions are associated with distinct patterns of cardiorespiratory activity. International Journal of Psychophysiology 61 (1), 5-18
  12. G.G. Berntson, J.T. Bigger Jr., D.L. Eckberg, P. Grossman, P.G. Kaufmann, M. Malik, H.N. Nagaraja, S.W. Porges, J.P. Saul, P.H. Stone, and M.W. Van Der Molen. Heart rate variability: Origins, methods, and interpretive caveats. Psychophysiol, 34:623-648, 1997
  13. Andreassi, J. L. (1995). Psychophysiology: human behavior and physiological response. Hillsdale, N.J., Lawrence Erlbaum Associates
  14. Schwartz, M. S. (1995). Biofeedback: A Practioner's Guide. New York: Guilford Press
  15. Chanel, G., Kronegg, J., Grandjean, D., Pun, T., 2006. Emotion assessment: arousal evaluation using EEG's and peripheral physiolo- gical signals. In: Gunsel, B., Tekalp, A.M., Jain, A.K., Sankur, B. (Eds.), Multimedia Content Representation Classification and Security. Springer Lecture Notes in Computer Sciences, vol. 4105, pp. 530-537.
  16. Mandryk, R. L., & Atkins, M. S. (2007). A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. International Journal of Human-Computer Studies, 65, 329-347
Download


Paper Citation


in Harvard Style

Giakoumis D., Vogiannou A., Kosunen I., Moustakas K., Tzovaras D. and Hassapis G. (2010). Identifying Psychophysiological Correlates of Boredom and Negative Mood Induced During HCI . In Proceedings of the 1st International Workshop on Bio-inspired Human-Machine Interfaces and Healthcare Applications - Volume 1: B-Interface, (BIOSTEC 2010) ISBN 978-989-674-020-7, pages 3-12. DOI: 10.5220/0002812600030012


in Bibtex Style

@conference{b-interface10,
author={Dimitris Giakoumis and Athanasios Vogiannou and Illka Kosunen and Kostantinos Moustakas and Dimitrios Tzovaras and George Hassapis},
title={Identifying Psychophysiological Correlates of Boredom and Negative Mood Induced During HCI},
booktitle={Proceedings of the 1st International Workshop on Bio-inspired Human-Machine Interfaces and Healthcare Applications - Volume 1: B-Interface, (BIOSTEC 2010)},
year={2010},
pages={3-12},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002812600030012},
isbn={978-989-674-020-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 1st International Workshop on Bio-inspired Human-Machine Interfaces and Healthcare Applications - Volume 1: B-Interface, (BIOSTEC 2010)
TI - Identifying Psychophysiological Correlates of Boredom and Negative Mood Induced During HCI
SN - 978-989-674-020-7
AU - Giakoumis D.
AU - Vogiannou A.
AU - Kosunen I.
AU - Moustakas K.
AU - Tzovaras D.
AU - Hassapis G.
PY - 2010
SP - 3
EP - 12
DO - 10.5220/0002812600030012