USER INDEPENDENT SYSTEM FOR RECOGNITION OF HAND POSTURES USED IN SIGN LANGUAGE

Dahmani Djamila, Benchikh Soumia, Slimane Larabi

Abstract

A new signer independent method of recognition of hand postures of sign language alphabet is presented in this paper. We propose a new geometric hand postures features derived from the convex hull enclosing the hand’s shape. These features are combined with the discrete orthogonal Tchebichef moments, and the Hu moments. The Tchebichef moments are applied on the external and internal edges of the hand’s shape. Experiments, based on two different hand posture data sets, show that our method is robust at recognizing hand postures independent of the person performing them. The system obtains a good recognition rates, and also performs well compared to other hand user independent posture recognition systems.

References

  1. Al-Jarrah, O., Halawani, A., 2001. Recognition of gestures in Arabic sign language using neuro-fuzzy systems. Artif. Intell. 133 (1-2), 117-138. ISSN 0004-3702.
  2. Al-Roussan, M., Hussain M., 2001 Automatic Recognition of Arabic Sign Language Finger spelling. In International Journal of computers and their applications (IJCA). Special issue on Fuzzy Systems 8(2) pages 80-88.
  3. Aran, O., Burger, T., Caplier, A. Akarun, L., 2009. A belief-based sequential fusion approach for fusing manual signs and non-manual signals, Pattern Recognition 42, 812-822.
  4. Assalaeh, K., Al-Roussan, M. 2005. Recognition of Arabic Sgn Language Alphabet using Polynomial Classifier. In EURASIP journal on Applied Signal Processing 13 pages 2136-2145.
  5. Dreuw, P., Stein, D., Desealers, T., Rybach, D., Zahedi, M., Ney, H. 2008: Spoken Language Processing Techniques for Sign Language Recognition and Translation, In Technology and Disability. Vol 20. Amesterdam.
  6. Erdelyi, W., Magnus, F., Oberthtingger, F., Tricomi, F., 1953 Higher Transcendental functions, Vol 2 McGraw-Hill, New York, USA.
  7. Hu, M.-K., 1962. Visual pattern recognition by moment invariants, information theory. IEEE Trans. 8 (2), 179-187. ISSN 0018-9448.
  8. Just, A., Rodriguez, Y., Marcel, S., 2006. Hand posture classification and recognition using the modified census transform. In: 7th Internat. Conf. on Automatic Face and Gesture Recognition, FGR, pp. 351-356. doi: 10.1109/FGR.2006.62.
  9. Kadous, M. W. 1995: Recognition of Australian Sign Language Using Instrumented Gloves. Bachelor's thesis, University of New South Wales.
  10. Kelly, D., McDonald, J., Markham, C. 2010: A person independent system for recognition of hand postures used in sign language. In Pattern Recognition Lett. 31.1359-1368.
  11. Mukundan, R., Ong, S. H., Lee, P. A., 2001. Image analysis by Tchebichef moments. In IEEE Trans.on image processing 10(9) 01357-1364.
  12. Starner, T., Pentland, A. 1996: Real-Time American Sign language Recognition from video Using Hidden Markov Models. In MIT Media Laboratory Perceptual Computing Section Technical Report N°375.
  13. Triesch, J., Von der malsuburg, C. 2002: Classification of hand postures against complex backgrounds using elastic graph matching. In Image Vision Comput. 20 (13-14), 937-943.
Download


Paper Citation


in Harvard Style

Djamila D., Soumia B. and Larabi S. (2012). USER INDEPENDENT SYSTEM FOR RECOGNITION OF HAND POSTURES USED IN SIGN LANGUAGE . In Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM, ISBN 978-989-8425-99-7, pages 581-584. DOI: 10.5220/0003785005810584


in Bibtex Style

@conference{icpram12,
author={Dahmani Djamila and Benchikh Soumia and Slimane Larabi},
title={USER INDEPENDENT SYSTEM FOR RECOGNITION OF HAND POSTURES USED IN SIGN LANGUAGE},
booktitle={Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM,},
year={2012},
pages={581-584},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003785005810584},
isbn={978-989-8425-99-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM,
TI - USER INDEPENDENT SYSTEM FOR RECOGNITION OF HAND POSTURES USED IN SIGN LANGUAGE
SN - 978-989-8425-99-7
AU - Djamila D.
AU - Soumia B.
AU - Larabi S.
PY - 2012
SP - 581
EP - 584
DO - 10.5220/0003785005810584