Automatic ROI for Remote Photoplethysmography using PPG and Color Features

Elisa Calvo-Gallego, Gerard de Haan

2015

Abstract

Remote photoplethysmography (rPPG) enables contact-less monitoring of the blood volume pulse using a regular camera, thus providing valuable information about the cardiovascular system. However, the quality of the acquired rPPG signal is strongly affected by the region of skin where the analysis is carried out and, therefore, to be confident of obtaining valid information, a pre-selection of the region-of-interest (ROI) for the PPG analysis is necessary. In this paper, we propose a method for the automatic extraction of this ROI combining the local characteristics of the PPG-signal with the color information using fuzzy logic. Results of the quality of the ROI extraction and its application on pulse rate detection are provided.

References

  1. Hertzman, A. B. (1937) Photoelectric plethysmography of the fingers and toes in man, Exp. Biol. Med., vol. 37, no. 3, pp. 529-534, 1937
  2. Allen, J. (2007), Photoplethysmography and its application in clinical physiological measurement, Physiological Measurement, vol. 28, no. 3, pp. R1R39
  3. Huelsbusch, M. and Blazek, V. (2002). Contactless mapping of rhythmical phenomena in tissue perfusion using PPGI, Proc. SPIE, vol. 4683, pp. 110-117
  4. Takano, C. and Ohta, Y. (2007), Heart rate measurement based on a time-lapse image, Med. Eng. Phys., vol. 29, pp. 853-857
  5. Verkruysse, W. and Svaasand, L.O. and Nelson, J.S. (2008), Remote plethysmographic imaging using ambient light, Opt. Exp., vol. 16, no. 26, pp. 21434/5
  6. Glass, K.A., Frishkoff, G.A., Frank, R.M. Davey, C. Dien, J. Malony, A.D. and Tucker, D.M. (2004), A framework for evaluating ICA methods of artefact removal from multichannel EEG, Proc. 5th Int. Conf. ICA 2004, Spain, Sept.
  7. Hülsbusch, M. (2008), An image-based functional method for opto-electronic detection of skin-perfusion, PhD Thesis, RWTH Aachen, Depart. of EE, (in German)
  8. Lewandowska, M. and Ruminski, J. and Kocejko, T. and Nowak, J. (2011), Measuring pulse rate with a webcam - A non-contact method for evaluating cardiac activity, Proc. Federated Conf. Comput. Sci. Inform. Syst., pp. 405-410
  9. Poh, M.Z. and McDuff, D.J. and Picard, R.W. (2010), Noncontact, automated cardiac pulse measurements using video imaging and blind source separation, Optics Express, vol. 18, no. 10, pp. 10762-10774
  10. De Haan, G. and Jeanne, V. (2013), Robust Pulse Rate From Chrominance-Based rPPG IEEE Transactions on Biomedical Engineering, vol. 60, no. 10, pp. 2878/86
  11. Lempe, G. and Zaunseder, S. and Wirthgen, T. and Zipser, S. and Malberg, H. (2013), ROI Selection for Remote Photoplethysmography Bildverarbeitung fr die Medizin, Springer Berlin Heidelberg
  12. De Haan, G. and Biezen, P.W. (1994), Sub-pixel motion estimation with 3-D recursive search block-matching. Signal Processing: Image Communication, vol. 6, n. 3
  13. De Haan, G. (2010), Chapter 10: Motion compensation. Digital Video Post Processing, Eindhoven, pp. 225/27
  14. Kelly, W. and Donnellan, A. and Molloy, D. (2008), Screening for Objectionable Images: A Review of Skin Detection Techniques IEEE International Machine Vision and Image Processing Conference
  15. Vezhnevets, V. and Sazonov, V. and Andreeva, A. (2003), A survey on pixel-based skin color detection techniques. Proc. Graphicon, vol. 3, pp. 8592
  16. Kakumanu, P. and Makrogiannis, S. and Bourbakis, N. (2007), A survey of skin-color modeling and detection methods. Pattern Recognition, vol. 40, no. 3
  17. Xfuzzy [Online] http://www2.imse-cnm.csic.es/Xfuzzy/
  18. Oberti, F. and Teschioni, A. and Regazzoni, C.S. (1999), ROC curves for performance evaluation of video sequences processing systems for surveillance applications. Proceedings International Conference on Image Processing, ICIP, vol. 2, pp. 949-953
  19. Schmitz, G.L.L.H. (2010) Video camera based photoplethysmography using ambient light Master graduation paper, Electrical Engineering, Publ. of TUE
  20. Jeanne, V. and De Bruijn, F.J. and Vlutters, R. and Cennini, G. and Chestakov, D (2010) Processing images of at least one living being US Patent 8,542,877
  21. Gibert, G. and DAlessandro, D. and Lance, F. (2013), Face detection method based on photoplethysmography. 10th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS)
Download


Paper Citation


in Harvard Style

Calvo-Gallego E. and de Haan G. (2015). Automatic ROI for Remote Photoplethysmography using PPG and Color Features . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-089-5, pages 357-364. DOI: 10.5220/0005259003570364


in Bibtex Style

@conference{visapp15,
author={Elisa Calvo-Gallego and Gerard de Haan},
title={Automatic ROI for Remote Photoplethysmography using PPG and Color Features},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={357-364},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005259003570364},
isbn={978-989-758-089-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)
TI - Automatic ROI for Remote Photoplethysmography using PPG and Color Features
SN - 978-989-758-089-5
AU - Calvo-Gallego E.
AU - de Haan G.
PY - 2015
SP - 357
EP - 364
DO - 10.5220/0005259003570364