Revealing Psychophysiology and Emotions through Thermal Infrared Imaging

Arcangelo Merla

2014

Abstract

Thermal infrared imaging has been proposed as a tool for the non-invasive and contact-less evaluation of vital signs, psychophysiological responses and states. Several applications have been so far developed in many diversified fields, like social and developmental psychology, psychometrics, human-computer interaction, continuous monitoring of vital signs, stress and, even, deception detection. Thermal infrared imaging has been poorly exploited in the field of human-robot interaction. Therefore, the state of the art of thermal infrared imaging in computational physiology and psychophysiology is discussed in order to provide insights about its potentialities and limits for human-robot interaction and applications with affective robots.

References

  1. Buddharaju, P., Dowdall, J., Tsiamyrtzis, P., Shastri, D., Pavlidis, I., Frank, M.G., 2005. Automatic Thermal Monitoring System (ATHEMOS) for Deception Detection, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2: 1179.
  2. Calvin, K.L., Duffy, V.G., 2007. Development of a facial skin temperature-based methodology for non-intrusive mental workload measurement, Occupational Ergonomics, 7, 83-94.
  3. Coli, M., Fontanella, L., Ippoliti, L., Merla A., 2007. Multiresolution KLE of psycho-physiological signals, In: Proceedings of S.Co.2007 Venice, Sept, 6-8, PADOVA, Book of Short Papers, 116-121.
  4. Dowdall, J., Pavlidis, I., Tsiamyrtzis, P., 2006, Coalitional tracking in facial infrared imaging and beyond, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2006, Category numberP2597; Article number 1640579.
  5. Ebisch, S. J., Aureli, T., Bafunno, D., Cardone, D., Romani, G.L., Merla, A., 2012. Mother and child in synchrony: thermal facial imprints of autonomic contagion, Biological Psychology, 89, 123-129
  6. Fujimasa, I., 1998. Pathophysiological expression and analysis of far infrared thermal images, IEEE Eng Med Biol Mag., 17(4), 34-42.
  7. Gane, L., Power, S., Kushki, A., Chau, T., 2011. Thermal Imaging of the Periorbital regions during the Presentation of an Auditory Startle Stimulus. PLOS One, 11: e27268. doi:10.1371/journal.pone.0027268.
  8. Garbey, M., Sun, N., Merla, A., Pavlidis, I., 2007. Contact-free measurement of cardiac pulse based on the analysis of thermal imagery, IEEE Transactions on Biomedical Engineering, 54(8), 1418-1426.
  9. Hahn, A. C., Whitehead R. D., Albrecht, M., Lefevre C. E., Perret D. I., 2012. Hot or not? Thermal reactions to social contact, Biology letters, 1-4. doi: 10.1098/rsbl.2012.0338.
  10. Ioannou, S., Ebisch, S. J., Aureli, T., Bafunno, D., Ioannides, H. A., Cardone, D., Manini, B., Romani, G. L., Gallese, V., Merla, A., 2013. The autonomic signature of guilt in children: A Thermal Infrared Imaging Study. Plos One, 1-18 (In Press).
  11. Kang, J., McGinley, J. A., McFadyen G., Babski-Reeves K., 2006. Determining Learning level and effective training times, Proceeding of the 25th Army Science Conference, 27-30.
  12. Kistler, A., Mariazouls, C., Berlepsch, V. K., 1998. Fingertip temperature as an indicator for sympathetic responses. International Journal of Psychophysiology, 29, 35-41.
  13. Lewis, G.F., Gatto, R.G., Porges, S.W., 2011. A novel method for extracting respiration rate and relative tidal volume from infrared thermography, Psychophysiology, 48(7):877-87.
  14. Manini B., Cardone D., Ebisch S. J. H., Bafunno D., Aureli T., Merla A., 2013. Mom feels what her child feels: thermal signatures of vicarious autonomic response while watching children in a stressful situation. Frontiers in Human Neuroscience, 7 (299), 1-10. doi: 10.3389/fnhum.2013.00299.
  15. Merla, A., Di Donato, L., Rossini, P.M., Romani, G.L., 2004. Emotion detection through Functional Infrared Imaging: preliminary results, Biomedizinische Technick, 48, 284-286.
  16. Merla, A., Romani, G.L., 2007a. Thermal Signatures of Emotional Arousal: A Functional Infrared Imaging Study, in Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, p. 247-249.
  17. Merla A., 2007b. Computational physiology in a thermal image setting, Proceedings of S.Co.2007, Fifth Conference on Complex Models and Computational Intensive Methods for Estimation and Prediction, Book of Short Papers, 338 - 343.
  18. Merla, A., Di Donato, L., Romani, G. L., Proietti, M., Salsano F., 2008. Comparison of thermal infrared and laser Doppler imaging in the assessment of cutaneous tissue perfusion in healthy controls and scleroderma patients. International Journal of Immunopathology and Pharmacology, 3, 679-686.
  19. Merla, A., Cardone, D., Di Carlo, L., Di Donato, L., Ragnoni, A., Visconti, A., Romani, G.L., 2011. Noninvasive system for monitoring driver's physical state, Proceedings of the 11th AITA Advanced Infrared Technology and Applications, Abstract book, 21.
  20. Merla, A., 2013, Method and system for the control of the residual efficiency of the interaction man-vehicle, European Patent EP13425145.
  21. Mizukami, K., Kobayashi, N., Ishii, T., & Iwata, H., 1990. First selective attachment begins in early infancy: A study using telethermography, Infant Behavior and Development, 13, 257-271.
  22. Murthy R., Pavlidis I., 2006. Noncontact measurement of breathing function, IEEE Engineering in Medicine and Biology Magazine, 25(3), 57-67.
  23. Murthy, J. N., van Jaarsveld, J., Fei, J., Pavlidis, I., Harrykissoon, R., Lucke, J. F., et al., 2009. Thermal infrared imaging: A novel method to monitor airflow during polysomnography, Sleep, 32, 1521-1527.
  24. Nhan, B. R., and Chau, T., (2010). Classifying Affective States Using Thermal Infrared Imaging of the Human Face. IEEE Transaction on Biomedical Engineeiring, 57 (4), 979-987.
  25. Pavlidis, I., Levine, J., Baukol, P., 2001. Thermal imaging for anxiety detection. IEEE Engineering in Medicine and Biology Magazine, 2, 315-318.
  26. Pavlidis, I., Levine, J., 2002. Thermal image analysis for polygraph testing. Engineering in Medicine and Biology Magazine, 21(6), 56-64.
  27. Pavlidis, I., Eberhardt, N.L., Levine, J.A., 2002. Seeing through the face of deception, Nature, 3, 415(6867):35. Erratum in: Nature, 7;415(6872):602.
  28. Pavlidis, I., Dowdall, J., Sun, N., Puri, C., Fei, J., Garbey, M., 2007, Interacting with human physiology, Computer Vision and Image Understanding, 108(1-2), 150-70.
  29. Pavlidis, I., Tsiamyrtzis, P. ,Shastri, D., Wesley, A., Zhou, Y., Lindner, P., Buddharaju, P., Joseph, R., Mandapati, A., Dunkin, B., Bas, B., 2012, Fast by Nature - How Stress Patterns Define Human Experience and Performance in Dexterous Tasks, Scientific Reports, 2, 1-9.
  30. Puri, C., Olson, L., Pavlidis, I., Levine, J., and Starren, J., 2005. Stress-cam: Non-contact measurement of users' emotional states through thermal imaging. In Proceedings of the 2005 ACM Conference on Human Factors in Computing Systems, 1725-1728.
  31. Shastri, D., Merla, A., Tsiamyrtzis, P., and Pavlidis, I., 2009. Imaging facial signs of neurophysiological responses, IEEE Transactions on Biomedical Engineering, 56(2), 477-84.
  32. Sun, N., Garbey, M., Merla, A., Pavlidis, I., 2007. Imaging the Cardiovascular pulse, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2, 416-421.
  33. Tsiamyrtzis, P., Dowdall, J., Shastri, D., Pavlidis, I., Frank, M., and Ekman, P., 2006. Imaging facial physiology for the detection of deceit, International Journal of Computer Vision, 71(2), 197-214.
  34. Zhu, Z., Tsiamyrtzis, P., Pavlidis, I., 2008. Forehead Thermal Signature Extraction in Lie Detection, IEEE Engineering in Medicine and Biological Society, 243 - 246.
  35. Zhou, Y., Tsiamyrtzis, P., Pavlidis, I., 2009. Tissue tracking in thermo-physiological imagery through spatio-temporal smoothing, Med. Image Comput. Comput. Assist. Interv., 12(Pt 2):1092-9.
  36. Buddharaju, P., Dowdall, J., Tsiamyrtzis, P., Shastri, D., Pavlidis, I., Frank, M.G., 2005. Automatic Thermal Monitoring System (ATHEMOS) for Deception Detection, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2: 1179.
Download


Paper Citation


in Harvard Style

Merla A. (2014). Revealing Psychophysiology and Emotions through Thermal Infrared Imaging . In Proceedings of the International Conference on Physiological Computing Systems - Volume 1: OASIS, (PhyCS 2014) ISBN 978-989-758-006-2, pages 368-377. DOI: 10.5220/0004900803680377


in Bibtex Style

@conference{oasis14,
author={Arcangelo Merla},
title={Revealing Psychophysiology and Emotions through Thermal Infrared Imaging},
booktitle={Proceedings of the International Conference on Physiological Computing Systems - Volume 1: OASIS, (PhyCS 2014)},
year={2014},
pages={368-377},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004900803680377},
isbn={978-989-758-006-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Physiological Computing Systems - Volume 1: OASIS, (PhyCS 2014)
TI - Revealing Psychophysiology and Emotions through Thermal Infrared Imaging
SN - 978-989-758-006-2
AU - Merla A.
PY - 2014
SP - 368
EP - 377
DO - 10.5220/0004900803680377