Hand Waving Gesture Detection using a Far-infrared Sensor Array with Thermo-spatial Region of Interest

Chisato Toriyama, Yasutomo Kawanishi, Tomokazu Takahashi, Daisuke Deguchi, Ichiro Ide, Hiroshi Murase, Tomoyoshi Aizawa, Masato Kawade

2016

Abstract

We propose a method of hand waving gesture detection using a far-infrared sensor array. The far-infrared sensor array captures the spatial distribution of temperature as a thermal image by detecting far-infrared waves emitted from heat sources. The advantage of the sensor is that it can capture human position and movement while protecting the privacy of the target individual. In addition, it works even at night-time without any light source. However, it is difficult to detect a gesture from a thermal image sequence captured by the sensor due to its low-resolution and noise. The problem is that the noise appears as a similar pattern as the gesture. Therefore, we introduce “Spatial Region of Interest (SRoI)” to focus on the region with motion. Also, to suppress the influence of other heat sources, we introduce “Thermal Region of Interest (TRoI)” to focus on the range of the human body temperature. In this paper, we demonstrate the effectiveness of the method through an experiment and discuss its result.

References

  1. Alsheakhali, M., Skaik, A., Aldahdouh, M., and Alhelou, M. (2011). Hand gesture recognition system. In Proc. Int. Conf. on Information & Communication Systems 2011, pages 132-136.
  2. Cutler, R. and Davis, L. (1998). View-based detection and analysis of periodic motion. In Proc. 14th Int. Conf. on Pattern Recognition, volume 1, pages 495-500.
  3. Fujii, T., Lee, J. H., and Okamoto, S. (2014). Gesture recognition system for human-robot interaction and its application to robotic service task. In Proc. Int. MultiConf. of Engineers and Computer Scientists 2014, volume 1, pages 63-68.
  4. Hosono, T., Takahashi, T., Deguchi, D., Ide, I., Murase, H., Aizawa, T., and Kawade, M. (2015). Human tracking using a far-infrared sensor array and a thermo-spatial sensitive histogram. In Jawahar, C. and Shan, S., editors, Computer Vision - ACCV 2014 Workshops, volume 9009 of Lecture Notes in Computer Science, pages 262-274. Springer International Publishing.
  5. Jing, L., Zhou, Y., Cheng, Z., and Huang, T. (2012). Magic ring: A finger-worn device for multiple appliances control using static finger gestures. Sensors, 12(5):5775-5790.
  6. Lee, H.-K. and Kim, J. H. (1999). An HMM-based threshold model approach for gesture recognition. IEEE Trans. on Pattern Analysis and Machine Intelligence, 21(10):961-973.
  7. Mahbub, U., Imtiaz, H., Roy, T., Rahman, M. S., and Ahad, M. R. (2013). A template matching approach of oneshot-learning gesture recognition. Pattern Recognition Letters, 34(15):1780-1788.
  8. Ohira, M., Koyama, Y., Aita, F., Sasaki, S., Oba, M., Takahata, T., Shimoyama, I., and Kimata, M. (2011). Micro mirror arrays for improved sensitivity of thermopile infrared sensors. In Proc. 24th IEEE Int. Conf. on Micro Electro Mechanical Systems, pages 708- 711.
  9. Shotton, J., Girshick, R., Fitzgibbon, A., Sharp, T., Cook, M., Finocchio, M., Moore, R., Kohli, P., Criminisi, A., Kipman, A., and Blake, A. (2013). Efficient human pose estimation from single depth images. IEEE Trans. on Pattern Analysis and Machine Intelligence, 35(12):2821-2840.
  10. Takahashi, M., Irie, K., Terabayashi, K., and Umeda, K. (2010). Gesture recognition based on the detection of periodic motion. In Proc. Int. Symposium on Optomechatronic Technologies, pages 1-6.
Download


Paper Citation


in Harvard Style

Toriyama C., Kawanishi Y., Takahashi T., Deguchi D., Ide I., Murase H., Aizawa T. and Kawade M. (2016). Hand Waving Gesture Detection using a Far-infrared Sensor Array with Thermo-spatial Region of Interest . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 545-551. DOI: 10.5220/0005718105450551


in Bibtex Style

@conference{visapp16,
author={Chisato Toriyama and Yasutomo Kawanishi and Tomokazu Takahashi and Daisuke Deguchi and Ichiro Ide and Hiroshi Murase and Tomoyoshi Aizawa and Masato Kawade},
title={Hand Waving Gesture Detection using a Far-infrared Sensor Array with Thermo-spatial Region of Interest},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={545-551},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005718105450551},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)
TI - Hand Waving Gesture Detection using a Far-infrared Sensor Array with Thermo-spatial Region of Interest
SN - 978-989-758-175-5
AU - Toriyama C.
AU - Kawanishi Y.
AU - Takahashi T.
AU - Deguchi D.
AU - Ide I.
AU - Murase H.
AU - Aizawa T.
AU - Kawade M.
PY - 2016
SP - 545
EP - 551
DO - 10.5220/0005718105450551