Addressing Signals Asynchronicity during Psychophysiological Inference - A Temporal Construction Method

François Courtemanche, Aude Dufresne, Elise L. LeMoyne, Esma Aimeur

2014

Abstract

Predicting the psychological state of the user using physiological measures is one of the main objectives of physiological computing. While numerous works have addressed this task with great success, a large number of challenges remain to be solved in order to develop recognition approaches that can precisely and reliably feed human-computer interaction systems. This paper focuses on one of these challenges which is the temporal asynchrony between different physiological signals within one recognition model. The paper proposes a flexible and suitable method for feature extraction based on empirical optimisation of windows’ latency and duration. The approach is described within the theoretical framework of the psychophysiological inference and its common implementation using machine learning. The method has been experimentally validated (46 subjects) and results are presented. Empirically optimised values for the extraction windows are provided.

References

  1. Allanson, J. & Fairclough, S. H. 2004. A research agenda for physiological computing. Interacting with Computers, 16, 857-878.
  2. Anttonen, J. & Surakka, V. 2005. Emotions and heart rate while sitting on a chair. SIGCHI conference on Human factors in computing systems. Portland, Oregon, USA: ACM.
  3. Bamidis, P., Frantzidis, C., Konstantinidis, E., Luneski, A., Lithari, C., Klados, M., Bratsas, C., Papadelis, C. & Pappas, C. 2009. An Integrated Approach to Emotion Recognition for Advanced Emotional Intelligence. In: JACKO, J. (ed.) Human-Computer Interaction. Ambient, Ubiquitous and Intelligent Interaction. Springer Berlin / Heidelberg.
  4. Bradley, M. M. & Lang, P. J. 1994. Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25, 49-59.
  5. Bradley, M. M. & Lang, P. J. 2007. The International affective digitized sounds (2nd Edition; IADS-2): Affective Ratings of Sounds and Instruction Manual. Technical report B-3. University of Florida, Gainesville, FI.
  6. Cacioppo, J. T. & Tassinary, L. G. 1990. Inferring psychological significance from physiological signals. American Psychologist, 45, 16-28.
  7. Cacioppo, J. T., Tassinary, L. T. & Berntson, G. 2007. Handbook of Psychophysiology, New York: Cambridge university Press.
  8. Chanel, G., Kierkels, J. J. M., Soleymani, M. & Pun, T. 2009. Short-term emotion assessment in a recall paradigm. International Journal of Human-Computer Studies, 67, 607-627.
  9. Christie, I. C. & Friedman, B. H. 2004. Autonomic specificity of discrete emotion and dimensions of affective space: a multivariate approach. International Journal of Psychophysiology, 51, 143-153.
  10. Coan, J. A. & Allen, J. J. B. 2004. Frontal EEG asymmetry as a moderator and mediator of emotion. Biological Psychology, 67, 7-50.
  11. Cowie, R., Douglas-Cowie, E., Mcrorie, M., Sneddon, I., Devillers, L. & Amir, N. 2011. Issues in Data Collection. In: COWIE, R., PELACHAUD, C. & PETTA, P. (eds.) Emotion-Oriented Systems. Springer Berlin Heidelberg.
  12. Ellsworth, P. C. 1994. William James and emotion: Is a century of fame worth a century of misunderstanding? Psychological Review, 101, 222-229.
  13. Gunes, H. & Pantic, M. 2010. Automatic Measurement of Affect in Dimensional and Continuous Spaces: Why, What, and How? In: SPINK, A. J., GRIECO, F., KRIPS, O. E., LOIJENS, L. W. S., NOLDUS, L. P. J. J. & ZIMMERMAN, P. H. (eds.) 7th International Conference on Methods and Techniques in Behavioral Research, Measuring Behavior 2010. Eindhoven, the Netherlands: Noldus.
  14. Guyon, I. & Elisseeff, A. 2003. An introduction to variable and feature selection. The Journal of Machine Learning Research, 3, 1157-1182.
  15. Haag, A., Goronzy, S., Schaich, P. & Williams, J. 2004. Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System. In: ANDRÉ, E., DYBKJAE R, L., MINKER, W. & HEISTERKAMP, P. (eds.) Affective dialogue systems. Springer Berlin / Heidelberg.
  16. Jennings, L. R. & Gianaros, P. J. 2007. Methodology. In: CACIOPPO, J. T., TASSINARY, L. G. & BERNSTON, G. G. (eds.) Handbook of Psychophysiology. Third ed. New York: Cambride University Press.
  17. Kolodyazhniy, V., Kreibig, S. D., Gross, J. J., Roth, W. T. & Wilhelm, F. H. 2011. An affective computing approach to physiological emotion specificity: Toward subject-independent and stimulus-independent classification of film-induced emotions. Psychophysiology, 48, 908-922.
  18. Kreibig, S. D. 2010. Autonomic nervous system activity in emotion: A review. Biological Psychology, 84, 394- 421.
  19. Lang, P. J., Bradley, M. M. & Cuthbert, B. N. 2008. International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical report B-3. University of Florida, Gainesville, FI.
  20. Mühl, C. & Heylen, D. 2009. Cross-modal Elicitation of Affective Experience. International Conference on Affective Computing and Intelligent Interaction and Workshops, ACII 2009, Workshop on Affective BrainComputer Interfaces. Amsterdam, The Netherlands.
  21. Picard, R. W., Vyzas, E. & Healey, J. 2001. Toward Machine Emotional Intelligence: Analysis of Affective Physiological State. IEEE Transactions on Pattern Analysis & Machine Intelligence, 23, 1175.
  22. Van Den Broek, E. 2011. Ubiquitous emotion-aware computing. Personal and Ubiquitous Computing, 1- 15.
  23. Van Den Broek, E., Janssen, J., Westerink, J. & Healey, J. Prerequisites for Affective Signal Processing (ASP). In: ENCARNAÇÃO, P. & VELOSO, A., eds. International Conference on Bio-inspired Systems and Signal Processing, 2009 Porto, Portugal. INSTICC Press, 426-433.
  24. Van Den Broek, E., Janssen, J. H., Zwaag Van Der, M. D. & Healey, J. A. Prerequisites for Affective Signal Processing (ASP) - Part III. Third International Conference on Bio-Inspired Systems and Signal Processing, Biosignals 2010, 2010a Valencia, Spain.
  25. Van Den Broek, E., Van Der Zwaag, M. D., Healey, J. A., Janssen, J. H. & Westerink, J. H. D. M. 2010b. Prerequisites for Affective Signal Processing (ASP) - Part IV. 1st International Workshop on Bio-inspired Human-Machine Interfaces and Healthcare Applications - B-Interface 2010. Valencia, Spain.
  26. Van Der Zwaag, M. D., Van Den Broek, E. & Janssen, J. H. Guidelines for biosignal driven HCI. ACM CHI2010 workshop - Brain, Body, and Bytes: Physiological user interaction, 2010 Atlanta, GA, USA., 77-80.
  27. Verhoef, T., Lisetti, C., Barreto, A., Ortega, F., Van Der Zant, T. & Cnossen, F. 2009. Bio-sensing for Emotional Characterization without Word Labels. In: JACKO, J. (ed.) Human-Computer Interaction. Ambient, Ubiquitous and Intelligent Interaction. Springer Berlin / Heidelberg.
  28. Wilder, J. 1958. Modern psychophysiology and the law of initial value. American Journal of Psychotherapy, 12, 199-221.
Download


Paper Citation


in Harvard Style

Courtemanche F., Dufresne A., L. LeMoyne E. and Aimeur E. (2014). Addressing Signals Asynchronicity during Psychophysiological Inference - A Temporal Construction Method . In Proceedings of the International Conference on Physiological Computing Systems - Volume 1: PhyCS, ISBN 978-989-758-006-2, pages 119-127. DOI: 10.5220/0004726801190127


in Bibtex Style

@conference{phycs14,
author={François Courtemanche and Aude Dufresne and Elise L. LeMoyne and Esma Aimeur},
title={Addressing Signals Asynchronicity during Psychophysiological Inference - A Temporal Construction Method},
booktitle={Proceedings of the International Conference on Physiological Computing Systems - Volume 1: PhyCS,},
year={2014},
pages={119-127},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004726801190127},
isbn={978-989-758-006-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Physiological Computing Systems - Volume 1: PhyCS,
TI - Addressing Signals Asynchronicity during Psychophysiological Inference - A Temporal Construction Method
SN - 978-989-758-006-2
AU - Courtemanche F.
AU - Dufresne A.
AU - L. LeMoyne E.
AU - Aimeur E.
PY - 2014
SP - 119
EP - 127
DO - 10.5220/0004726801190127