CUED SPEECH HAND SHAPE RECOGNITION - Belief Functions as a Formalism to Fuse SVMs & Expert Systems

Thomas Burger, Alexandra Urankar, Oya Aran, Lale Akarun, Alice Caplier

Abstract

As part of our work on hand gesture interpretation, we present our results on hand shape recognition. Our method is based on attribute extraction and multiple binary SVM classification. The novelty lies in the fashion the fusion of all the partial classification results are performed. This fusion is (1) more efficient in terms of information theory and leads to more accurate result, (2) general enough to allow other source of information to be taken into account: Each SVM output is transformed to a belief function, and all the corresponding functions are fused together with some other external evidential sources of information.

References

  1. Aran, O., Keskin, C., Akarun, L., 2005. Sign Language Tutoring Tool, EUSIPCO'05, Antalya, Turkey.
  2. Burger , T., Aran, O., and Caplier, A., 2006. Modeling hesitation and conflict: A belief-based approach, In Proc. ICMLA.
  3. Boser, B., Guyon, I., and Vapnik, V., 1995. A training algorithm for optimal margin classifiers, In Proc. Fifth Annual Workshop on Computational Learning Theory.
  4. Capelle, A. S., Colot, O., Fernandez-Maloigne, C., 2004. Evidential segmentation scheme of multi-echo MR images for the detection of brain tumors using neighborhood information. Information Fusion, Volume 5, Number 3, pages 203-216.
  5. Caplier, A., Bonnaud, L., Malassiotis, S., and Strintzis, M., 2004. Comparison of 2D and 3D analysis for automated Cued Speech gesture recognition, SPECOM, St Petersburg, Russia.
  6. Chang , C.-C., and Lin, C.-J., 2001. LIBSVM: a library for support vector machines. Software available at http://www.csie.ntu.edu.tw/cjlin/libsvm
  7. Cornett, R. O., 1967. Cued Speech, American Annals of the Deaf.
  8. Cortes, C., and Vapnik, V., 1995. Support-vector network, Machine Learning 20, 273-297.
  9. Denoeux, T., 2000. Modeling vague beliefs using fuzzyvalued belief structures. Fuzzy Sets and Systems, 116(2):167-199.
  10. Derpanis, K. G., 2004. A review on vision-based hand gestures, internal report.
  11. Hsu, C.-W., and Lin, C.-J., 2002. A comparison of methods for multi-class support vector machines, IEEE Transactions on Neural Networks, Vol. 13, pp. 415-425.
  12. Norkin, C.C., and Levangie , P.K., 1992. Joint structure and function. (2nd ed.). Philadelphia: F.A. Davis.
  13. Ong, S.C.W. and Ranganath, S., 2005. Automatic Sign Language Analysis: A Survey and the Future beyond Lexical Meaning, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, pp. 873- 891.
  14. Pavlovic, V., Sharma ,R. and Huang , T. S., 1997. Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, n. 7, p. 677-695.
  15. Quost, B., Denoeux, T., and Masson, M.-H., 2007. Pairwise classifier combination using belief functions. To appear in Pattern Recognition Letters.
  16. Shafer, G., 1976. A Mathematical Theory of Evidence, Princeton University Press.
  17. Smets, P., and Kennes, R., 1994. The transferable belief model. Artificial Intelligence, 66(2): 191-234.
  18. Wu, Y., Huang, T.S., 2001. Hand modeling, analysis, and recognition for vision based Human-Computer Interaction, IEEE Signal Processing Magazine, v.21, p.51-60.
  19. Zhang, D., and Lu, G., 2003. Evaluation of MPEG-7 shape descriptors against other shape descriptors, Multimedia Systems, vol. 9, issue 1.
Download


Paper Citation


in Harvard Style

Burger T., Urankar A., Aran O., Akarun L. and Caplier A. (2007). CUED SPEECH HAND SHAPE RECOGNITION - Belief Functions as a Formalism to Fuse SVMs & Expert Systems . In Proceedings of the Second International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, ISBN 978-972-8865-74-0, pages 5-12. DOI: 10.5220/0002041700050012


in Bibtex Style

@conference{visapp07,
author={Thomas Burger and Alexandra Urankar and Oya Aran and Lale Akarun and Alice Caplier},
title={CUED SPEECH HAND SHAPE RECOGNITION - Belief Functions as a Formalism to Fuse SVMs & Expert Systems},
booktitle={Proceedings of the Second International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,},
year={2007},
pages={5-12},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002041700050012},
isbn={978-972-8865-74-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Second International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,
TI - CUED SPEECH HAND SHAPE RECOGNITION - Belief Functions as a Formalism to Fuse SVMs & Expert Systems
SN - 978-972-8865-74-0
AU - Burger T.
AU - Urankar A.
AU - Aran O.
AU - Akarun L.
AU - Caplier A.
PY - 2007
SP - 5
EP - 12
DO - 10.5220/0002041700050012