Seven Principles to Mine Flexible Behavior from Physiological Signals for Effective Emotion Recognition and Description in Affective Interactions

Rui Henriques, Ana Paiva

Abstract

Measuring affective interactions using physiological signals has become a critical step to understand engagements with human and artificial agents. However, traditional methods for signal analysis are not yet able to effectively deal with the differences of responses across individuals and with flexible sequential behavior. In this work, we rely on empirical results to define seven principles for a robust mining of physiological signals to recognize and characterize affective states. The majority of these principles are novel and driven from advanced pre-processing techniques and temporal data mining methods. A methodology that integrates these principles is proposed and validated using electrodermal signals collected during human-to-human and human-to-robot affective interactions.

References

  1. Andreassi, J. (2007). Psychophysiology: Human Behavior And Physiological Response. Lawrence Erlbaum.
  2. Bishop, C. M. (2006). Pattern Recognition and Machine Learning (Inf. Science and Stat.). Springer-Verlag New York, Inc., Secaucus, NJ, USA.
  3. Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., and Witten, I. H. (2009). The WEKA data mining software: an update. SIGKDD Explor. Newsl., 11(1):10-18.
  4. Jerritta, S., Murugappan, M., Nagarajan, R., and Wan, K. (2011). Physiological signals based human emotion recognition: a review. In CSPA, 2011 IEEE 7th International Colloquium on, pages 410 -415.
  5. Kulic, D. and Croft, E. A. (2007). Affective state estimation for human-robot interaction. Trans. Rob., 23(5):991- 1000.
  6. Leite, I., Henriques, R., Martinho, C., and Paiva, A. (2013). Sensors in the wild: Exploring electrodermal activity in child-robot interaction. In HRI, pages 41-48. ACM/IEEE.
  7. Lessard, C. S. (2006). Signal Processing of Random Physiological Signals. S.Lectures on Biomedical Eng. Morgan and Claypool Publishers.
  8. Lin, J., Keogh, E., Lonardi, S., and Chiu, B. (2003a). A symbolic representation of time series, with implications for streaming algorithms. In ACM SIGMOD workshop on DMKD, pages 2-11, NY, USA. ACM.
  9. Lin, J., Keogh, E. J., Lonardi, S., and chi Chiu, B. Y. (2003b). A symbolic representation of time series, with implications for streaming algorithms. In Zaki, M. J. and Aggarwal, C. C., editors, DMKD, pages 2- 11. ACM.
  10. Murphy, K. (2002). Dynamic Bayesian Networks: Representation, Inference and Learning. PhD thesis, UC Berkeley, CS Division.
  11. Picard, R. W., Vyzas, E., and Healey, J. (2001). Toward machine emotional intelligence: Analysis of affective physiological state. IEEE Trans. Pattern Anal. Mach. Intell., 23(10):1175-1191.
  12. Rani, P., Liu, C., Sarkar, N., and Vanman, E. (2006). An empirical study of machine learning techniques for affect recognition in human-robot interaction. Pattern Anal. Appl., 9(1):58-69.
  13. Wagner, J., Kim, J., and Andre, E. (2005). From physiological signals to emotions: Implementing and comparing selected methods for feature extraction and classification. In ICME, pages 940 -943. IEEE.
  14. Wu, C.-K., Chung, P.-C., and Wang, C.-J. (2011). Extracting coherent emotion elicited segments from physiological signals. In WACI, pages 1-6. IEEE.
Download


Paper Citation


in Harvard Style

Henriques R. and Paiva A. (2014). Seven Principles to Mine Flexible Behavior from Physiological Signals for Effective Emotion Recognition and Description in Affective Interactions . In Proceedings of the International Conference on Physiological Computing Systems - Volume 1: PhyCS, ISBN 978-989-758-006-2, pages 75-82. DOI: 10.5220/0004666400750082


in Bibtex Style

@conference{phycs14,
author={Rui Henriques and Ana Paiva},
title={Seven Principles to Mine Flexible Behavior from Physiological Signals for Effective Emotion Recognition and Description in Affective Interactions},
booktitle={Proceedings of the International Conference on Physiological Computing Systems - Volume 1: PhyCS,},
year={2014},
pages={75-82},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004666400750082},
isbn={978-989-758-006-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Physiological Computing Systems - Volume 1: PhyCS,
TI - Seven Principles to Mine Flexible Behavior from Physiological Signals for Effective Emotion Recognition and Description in Affective Interactions
SN - 978-989-758-006-2
AU - Henriques R.
AU - Paiva A.
PY - 2014
SP - 75
EP - 82
DO - 10.5220/0004666400750082