![](bg6.png)
Figure 5: The Proposed Human Machine Interaction Sys-
tem.
marker for assessing the psychophysiological state of
the operator. Furthermore, the combination of the
facial temperature and other well-known biomarkers
can significantly increase the robustness of the system
and the precision of the prediction, as the facial tem-
perature measurement requires no body contact and
is more sensitive to the changes within the low men-
tal stress states.
REFERENCES
Barrett, L. F. (2006). Solving the emotion paradox: Cate-
gorization and the experience of emotion. Personality
and social psychology review, 10(1):20–46.
Barrett, L. F., Mesquita, B., Ochsner, K. N., and Gross, J. J.
(2007). The experience of emotion. Annu. Rev. Psy-
chol., 58:373–403.
Bernardi, L., Wdowczyk-Szulc, J., Valenti, C., Castoldi, S.,
Passino, C., Spadacini, G., and Sleight, P. (2000). Ef-
fects of controlled breathing, mental activity and men-
tal stress with or without verbalization on heart rate
variability. Journal of the American College of Cardi-
ology, 35(6):1462–1469.
Brengelmann, G. L. (2000). Body surface temperature:
Manifestation of complex anatomy and physiology of
the cutaneous vasculature. In Engineering in Medicine
and Biology Society, 2000. Proceedings of the 22nd
Annual International Conference of the IEEE, vol-
ume 3, pages 1927–1930. IEEE.
Charkoudian, N. (2003). Skin blood flow in adult human
thermoregulation: how it works, when it does not, and
why. In Mayo Clinic Proceedings, volume 78, pages
603–612. Elsevier.
Clay-Warner, J. and Robinson, D. T. (2015). Infrared ther-
mography as a measure of emotion response. Emotion
Review, 7(2):157–162.
Dowdall, J., Pavlidis, I. T., and Tsiamyrtzis, P. (2007).
Coalitional tracking. Computer Vision and Image Un-
derstanding, 106(2):205–219.
Driessen, H. and Boers, Y. (2008). Map estimation in parti-
cle filter tracking.
El-Samahy, E., Mahfouf, M., Torres-Salomao, L., and
Anzurez-Marin, J. (2015). A new computer con-
trol system for mental stress management using fuzzy
logic. In Evolving and Adaptive Intelligent Sys-
tems (EAIS), 2015 IEEE International Conference on,
pages 1–7. IEEE.
Garde, A., Laursen, B., Jørgensen, A., and Jensen, B.
(2002). Effects of mental and physical demands on
heart rate variability during computer work. European
journal of applied physiology, 87(4-5):456–461.
Gevins, A. and Smith, M. E. (2003). Neurophysiologi-
cal measures of cognitive workload during human-
computer interaction. Theoretical Issues in Er-
gonomics Science, 4(1-2):113–131.
Hjortskov, N., Riss
´
en, D., Blangsted, A. K., Fallentin, N.,
Lundberg, U., and Søgaard, K. (2004). The effect of
mental stress on heart rate variability and blood pres-
sure during computer work. European journal of ap-
plied physiology, 92(1-2):84–89.
Hong, K. and Hong, S. (2016). Real-time stress assess-
ment using thermal imaging. The Visual Computer,
32(11):1369–1377.
Houdas, Y. and Ring, E. (2013). Human body temperature:
its measurement and regulation. Springer Science &
Business Media.
Inzlicht, M., Bartholow, B. D., and Hirsh, J. B. (2015).
Emotional foundations of cognitive control. Trends
in cognitive sciences, 19(3):126–132.
Kuriyagawa, Y. and Kageyama, I. (1999). A model-
ing of heart rate variability to estimate mental work
load. In Systems, Man, and Cybernetics, 1999. IEEE
SMC’99 Conference Proceedings. 1999 IEEE Inter-
national Conference on, volume 2, pages 294–299.
IEEE.
Levin, A., Lischinski, D., and Weiss, Y. (2008). A closed-
form solution to natural image matting. IEEE Trans-
actions on Pattern Analysis and Machine Intelligence,
30(2):228–242.
Mahfouf, M., Zhang, J., Linkens, D. A., Nassef, A., Nickel,
P., Hockey, G. R. J., and Roberts, A. C. (2007). Adap-
tive fuzzy approaches to modelling operator func-
tional states in a human-machine process control sys-
tem. In Fuzzy Systems Conference, 2007. FUZZ-IEEE
2007. IEEE International, pages 1–6. IEEE.
Nassef, A., Mahfouf, M., Ting, C.-H., El-Samahy, E.,
Linkens, D. A., and Dena
¨
ı, M. A. (2010). Hybrid
physiological modeling of subjects undergoing cyclic
physical loading. In Biosignals, pages 252–257.
Nhan, B. and Chau, T. (2009). Infrared thermal imaging as a
physiological access pathway: a study of the baseline
characteristics of facial skin temperatures. Physiolog-
ical measurement, 30(4):N23.
Nhan, B. R. and Chau, T. (2010). Classifying affective
states using thermal infrared imaging of the human
face. IEEE Transactions on Biomedical Engineering,
57(4):979–987.
Nozawa, A. and Tacano, M. (2009). Correlation analysis on
alpha attenuation and nasal skin temperature. Jour-
nal of Statistical Mechanics: Theory and Experiment,
2009(01):P01007.
Smith, M. E., Gevins, A., Brown, H., Karnik, A., and Du, R.
(2001). Monitoring task loading with multivariate eeg
ICINCO 2018 - 15th International Conference on Informatics in Control, Automation and Robotics
26