Rule-based Hand Posture Recognition using Qualitative Finger Configurations Acquired with the Kinect

Lieven Billiet, Jose Oramas, McElory Hoffmann, Wannes Meert, Laura Antanas

Abstract

Gesture recognition systems exhibit failures when faced with large hand posture vocabularies or relatively new hand poses. One main reason is that 2D and 3D appearance-based approaches require significant amounts of training data. We address this problem by introducing a new 2D model-based approach to recognize hand postures. The model captures a high-level rule-based representation of the hand expressed in terms of finger poses and their qualitative configuration. The available 3D information is used to first segment the hand. We evaluate our approach on a Kinect dataset and report superior results while using less training data when comparing to state-of-the-art 3D SURF descriptor.

References

  1. Altun, O. and Albayrak, S. (2011). Turkish fingerspelling recognition system using generalized hough transform, interest regions, and local descriptors. Pattern Recognition Letters, 32(13):1626-1632.
  2. Barczak, A. L. C. and Dadgostar, F. (2005). Real-time hand tracking using a set of cooperative classifiers based on haar-like features. In Research Letters in the Information and Mathematical Sciences, pages 29-42.
  3. Breiman, L., Friedman, J. H., Olshen, R. A., and Stone, C. J. (1984). Classification and Regression Trees. Wadsworth.
  4. Darom, T. and Keller, Y. (2012). Scale-invariant features for 3-d mesh models. IEEE Transactions on Image Processing, 21(5):2758 -2769.
  5. Erol, A., Bebis, G., Nicolescu, M., Boyle, R. D., and Twombly, X. (2007). Vision-based hand pose estimation: A review. CVIU, 108(1-2):52-73.
  6. Guyon, I. and Athitsos, V. (2011). Demonstrations and live evaluation for the gesture recognition challenge. In ICCV Workshops, pages 461-462.
  7. Guyon, I., Athitsos, V., Jangyodsuk, P., Hamner, B., and Escalante, H. J. (2012). Chalearn gesture challenge: Design and first results. In CVPR Workshop on Gesture Recognition and Kinect Demonstration Competition.
  8. Holt, B., Ong, E.-J., Cooper, H., and Bowden, R. (2011). Putting the pieces together: Connected Poselets for Human Pose Estimation. In Workshop on Consumer Depth Cameras for Computer Vision.
  9. Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., and Fitzgibbon, A. (2011). Kinectfusion: real-time 3d reconstruction and interaction using a moving depth camera. In ACM symposium on User interface software and technology, UIST.
  10. Keskin, C., Kira, F., Kara, Y. E., and Akarun, L. (2011). Real time hand pose estimation using depth sensors. In Computational Methods for the Innovative Design of Electrical Devices, pages 1228-1234.
  11. Knopp, J., Prasad, M., Willems, G., Timofte, R., and Van Gool, L. (2010). Hough transform and 3d surf for robust three dimensional classification. In ECCV.
  12. Liwicki, S. and Everingham, M. (2009). Automatic recognition of fingerspelled words in British sign language. In IEEE Workshop for Human Communicative Behavior Analysis, pages 50-57.
  13. Mo, Z. and Neumann, U. (2006). Real-time Hand Pose Recognition Using Low-Resolution Depth Images. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2(c):1499-1505.
  14. Pugeault, N. and Bowden, R. (2011). Spelling It Out: RealTime ASL Fingerspelling Recognition. In Workshop on Consumer Depth Cameras for Computer Vision.
  15. Ren, Z., Meng, J., Yuan, J., and Zhang, Z. (2011a). Robust hand gesture recognition with kinect sensor. In ACM, MM, pages 759-760, New York, NY, USA. ACM.
  16. Ren, Z., Yuan, J., and Zhang, Z. (2011b). Robust hand gesture recognition based on finger-earth mover's distance with a commodity depth camera. In ACM, MM, pages 1093-1096, New York, NY, USA. ACM.
  17. Suryanarayan, P., Subramanian, A., and Mandalapu, D. (2010). Dynamic hand pose recognition using depth data. In ICPR, pages 3105-3108.
  18. Van den Bergh, M. and Van Gool, L. J. (2011). Combining rgb and tof cameras for real-time 3d hand gesture interaction. In WACV, pages 66-72.
Download


Paper Citation


in Harvard Style

Billiet L., Oramas J., Hoffmann M., Meert W. and Antanas L. (2013). Rule-based Hand Posture Recognition using Qualitative Finger Configurations Acquired with the Kinect . In Proceedings of the 2nd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-8565-41-9, pages 539-542. DOI: 10.5220/0004230805390542


in Bibtex Style

@conference{icpram13,
author={Lieven Billiet and Jose Oramas and McElory Hoffmann and Wannes Meert and Laura Antanas},
title={Rule-based Hand Posture Recognition using Qualitative Finger Configurations Acquired with the Kinect},
booktitle={Proceedings of the 2nd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2013},
pages={539-542},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004230805390542},
isbn={978-989-8565-41-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Rule-based Hand Posture Recognition using Qualitative Finger Configurations Acquired with the Kinect
SN - 978-989-8565-41-9
AU - Billiet L.
AU - Oramas J.
AU - Hoffmann M.
AU - Meert W.
AU - Antanas L.
PY - 2013
SP - 539
EP - 542
DO - 10.5220/0004230805390542