Continuous Real-time Heart Rate Monitoring from Face Images

Tatsuya Mori, Daisuke Uchida, Masato Sakata, Takuro Oya, Yasuyuki Nakata, Kazuho Maeda, Yoshinori Yaginuma, Akihiro Inomata

2016

Abstract

A real-time monitoring method of heart rate (HR) from face images using Real-time Pulse Extraction Method (RPEM) is described and corroborated for the theoretical efficacy by investigating fundamental mechanisms through three kinds of experiments; (i) measurement of light reflection from face covered by copper film, (ii) spectroscopy measurement and (iii) simultaneous measurement of face images and laser speckle images. The investigation indicated the main causes of brightness change are both the green light absorption variation by the blood volume changes and the face surface reflection variation by pulsatory face movements. RPEM removes the motion noise from the green light absorption variation and the effectiveness is ensured by comparing with the pulse wave of the ear photoplethysmography. We also applied RPEM to continuous real-time HR monitoring of seven participants during office work under non-controlled condition, and achieved HR measured rate of 44 % to the number of referential ECG beats while face is detected, with RMSE = 6.7 bpm as an average result of five days.

References

  1. Pantelopoulos, A., Bourbakis, N. G., 2010, “A Survey on Wearable Sensor-Based Systems for Health Monitoring and Prognosis”, IEEE Trans. Syst., Man, Cybern.-Part C: Applications and Reviews, 40 (1), pp. 1-12.
  2. Inomata, A., Yaginuma, Y., 2014, “Hassle-free Sensing Technologies for Monitoring Daily Health Changes”, Fujitsu Sci. Tech. J., 50 (1), pp. 78-83.
  3. Uchida, D., Nakata, Y., Inomata, A., Shiotsu, S., Yaginuma, Y., 2015, “Hassle-free Sensing Technologies for Human Health Monitoring”, Proceedings of the IEICE general conference / the Institute of Electronics, Information and Communication Engineers, S-16.
  4. Dyer, A. R., Persky, V., Stamler, J., Paul, O., Shekelle, R. B., Berkson, D. M., Lepper, M., Schoenberger, J. A., Lindberg H. A., 1980, “Heart rate as a prognostic factor for coronary heart disease and mortality: findings in three Chicago epidemiologic studies”, Am. J. Epidemio., 112, pp. 736-49.
  5. Jensen, M. T., Suadicani, P., Hein, H. O., Gyntelberg, F., 2013, “Elevated resting heart rate, physical fitness and all-cause mortality: a 16-year follow-up in the Copenhagen Male Study”, Heart, 99 (12), pp. 882- 887.
  6. Takano, C., Ohta, Y., 2007, “Heart rate measurement based on a time-lapse image”. Medical Engineering and Physics, 29, pp. 853-857.
  7. Poh, MZ., McDuff, D. J., Picard, R. W., 2010, “Noncontact, automated cardiac pulse measurements using video imaging and blind source separation.”, OPTICS EXPRESS, 18 (10), pp. 10762-10774.
  8. Poh, MZ., McDuff, D. J., Picard, R. W., 2011, “Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam”, IEEE Trans. Biomed. Engineering, 58 (1), pp. 7-11.
  9. Kwon, S., Kim, H., Park, S., 2012, “Validation of heart rate extraction using video imaging on a built-in camera system of a smartphone”, Proceedings of the Ann. Intl Conf. of the IEEE Eng. in Medicine and Biology Soc. (EMBC), pp. 2174-2177.
  10. Balakrishnan, G., Durand, F., Guttag, J., 2013, “Detecting Pulse from Head Motions in Video”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3430-3437.
  11. Li, X., Chen, J., Zhao, G., Pietikainen, M., 2014, “Remote Heart Rate Measurement From Face Videos Under Realistic Situations”, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 4321-4328.
  12. Sakata, M., Uchida, D., Inomata, A., Yaginuma, Y., 2013, “Continuous Non-contact Heart Rate Measurement Using Face Imaging”, Proceedings of the IEICE general conference / the Institute of Electronics, Information and Communication Engineers, 1 (73).
  13. Steknke, J. M., Shephered, A. P., 1992, “Effects of Temperature on Optical Absorbance Spectra of Oxy-, Carboxy-, and Deoxyhemoglobin”, Clin. Chem., 38 (7), pp. 1360-1364.
  14. Forrester, K. R., Tulip, J., Leonard, C., Stewart, C., Bray, R. C., 2004, “A Laser Speckle Imaging Technique for Measuring Tissue Perfusion”, IEEE Trans. Biomed. Engineering, 51 (11), pp. 2074-2084.
Download


Paper Citation


in Harvard Style

Mori T., Uchida D., Sakata M., Oya T., Nakata Y., Maeda K., Yaginuma Y. and Inomata A. (2016). Continuous Real-time Heart Rate Monitoring from Face Images . In Proceedings of the 9th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 4: BIOSIGNALS, (BIOSTEC 2016) ISBN 978-989-758-170-0, pages 52-56. DOI: 10.5220/0005682400520056


in Bibtex Style

@conference{biosignals16,
author={Tatsuya Mori and Daisuke Uchida and Masato Sakata and Takuro Oya and Yasuyuki Nakata and Kazuho Maeda and Yoshinori Yaginuma and Akihiro Inomata},
title={Continuous Real-time Heart Rate Monitoring from Face Images},
booktitle={Proceedings of the 9th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 4: BIOSIGNALS, (BIOSTEC 2016)},
year={2016},
pages={52-56},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005682400520056},
isbn={978-989-758-170-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 4: BIOSIGNALS, (BIOSTEC 2016)
TI - Continuous Real-time Heart Rate Monitoring from Face Images
SN - 978-989-758-170-0
AU - Mori T.
AU - Uchida D.
AU - Sakata M.
AU - Oya T.
AU - Nakata Y.
AU - Maeda K.
AU - Yaginuma Y.
AU - Inomata A.
PY - 2016
SP - 52
EP - 56
DO - 10.5220/0005682400520056