VISION-BASED HAND GESTURE RECOGNITION FOR HUMAN-ROBOT INTERACTION

Md. Hasanuzzaman, M. A. Bhuiyan, V. Ampornaramveth, T. Zhang, Y. Shirai, H. Ueno

2004

Abstract

This paper presents a vision-based hand gesture recognition system for interaction between human and robot. A real-time two hands gestures recognition system has been developed by combining three larger components analysis based on skin-color segmentation and multiple features based template-matching techniques. Gesture commands are generated and issued whenever the combinations of three skin-like regions at a particular frame match with the predefined gestures. These gesture commands are sent to robots through TCP-IP network for human-robot interaction. A method has also been proposed to detect left hand and right hand relative to face position, as well as, to detect the face and locate its position. The effectiveness of our method has been demonstrated over the interaction with a robot named ROBOVIE.

References

  1. Vladimir I. Pavlovic, 1997. Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review. IEEE PAMI, Vol. 19, No. 7, pp. 677-695.
  2. Watanabe, T., 1996. Real-Time Gesture Recognition Using Maskable Template Model. Proc. of the International Conference on Multimedia Computing and Systems (ICMCS'96), pp. 341-348.
  3. Hongo, H., 2000. Focus of Attention for Face and Hand Gesture Recognition Using Multiple Cameras. AFGR00, IEEE, pp. 156-161.
  4. Matthew, T., 1991. Eigenface for Recognition. Journal of Cognitive Neuroscience, Vol. 3, No.1, pp. 71-86.
  5. Utsumi, A., 2002. Hand Detection and Tracking using Pixel Value Distribution Model for Multiple-CameraBased Gesture Interactions. Proc. of the IEEE workshop on knowledge Media Networking (KMN'02), pp. 31-36.
  6. Bhuiyan, M. A., 2003. Face Detection and Facial Feature Localization for Human-machine Interface. NII Journal. Vol. 5, pp. 25-39.
  7. Huang, Yu, 2002. Two-Hand Gesture Tracking Incorporating Template Warping With Static Segmentation. AFGR'02, IEEE, pp. 260-265.
  8. Bretzner, L., 2002. Hand Gesture Recognition using Multi-Scale Colour Features, Hierarchical Models and Particle Filtering. AFGR'02, IEEE pp. 423-428. Journal of Robotics and Automation, Vol. 19, No. 1, pp. 42-54.
  9. Shimada, N., 1996. 3-D Hand Pose Estimation and Shape Model Refinement from a Monocular Image Sequence. Proc. of VSMM'96 in GIFU, pp.23-428
  10. Grzeszczuk, R., 2000. Stereo Based Gesture Recognition Invariant to 3D pose and lighting. CVPR'00, IEEE, pp. 1826-1833.
  11. Yunato, Cui, 1996. Hand Segmentation Using LearningBased prediction and verification for hand Sign Recognition. Proc. of the Conference on Computer Vision and pattern Recognition (CVPR'96), IEEE, pp. 88-93.
  12. Yoichi Sato, 2000. Fast Tracking of hands and Fingertips in Infrared Images for Augmented Desk Interface. AFGR'00, IEEE, pp. 462-467.
  13. Charles, J., 2001. A Basic Hand Gesture Control System for PC Applications. Proc. of the 30th Applied Imagery Pattern Recognition Workshop (AIPR'01), IEEE, pp. 74-79
  14. Dong, Guo, 1998. Vision-Based Hand Gesture Recognition for Human-Vehicle Interaction. Proc. of the International conference on Control, Automation and Computer Vision, Vol. 1, pp. 151-155.
Download


Paper Citation


in Harvard Style

Hasanuzzaman M., A. Bhuiyan M., Ampornaramveth V., Zhang T., Shirai Y. and Ueno H. (2004). VISION-BASED HAND GESTURE RECOGNITION FOR HUMAN-ROBOT INTERACTION . In Proceedings of the First International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 972-8865-12-0, pages 440-445. DOI: 10.5220/0001137904400445


in Bibtex Style

@conference{icinco04,
author={Md. Hasanuzzaman and M. A. Bhuiyan and V. Ampornaramveth and T. Zhang and Y. Shirai and H. Ueno},
title={VISION-BASED HAND GESTURE RECOGNITION FOR HUMAN-ROBOT INTERACTION},
booktitle={Proceedings of the First International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},
year={2004},
pages={440-445},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001137904400445},
isbn={972-8865-12-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the First International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - VISION-BASED HAND GESTURE RECOGNITION FOR HUMAN-ROBOT INTERACTION
SN - 972-8865-12-0
AU - Hasanuzzaman M.
AU - A. Bhuiyan M.
AU - Ampornaramveth V.
AU - Zhang T.
AU - Shirai Y.
AU - Ueno H.
PY - 2004
SP - 440
EP - 445
DO - 10.5220/0001137904400445