Virtual Avatars Signing in Real Time for Deaf Students

Lucía Vera, Inmaculada Coma, Julio Campos, Bibiana Martínez, Marcos Fernández

Abstract

This paper describes a speech and text translator from Spanish into Spanish Sign Language, that tries to solve some of the problems that deaf people find when they access and attend specific training courses. In addition to the translator system, a set of real-time avatar animations representing the signs are used. The creation process of such avatars is also described. The system can be used in courses where deaf and hearing people are sharing the same material and classroom, which contributes to improve the integration of this group of people to specific academic areas. The tool has been tested to obtain direct information with a group of deaf people from the Deaf Association of Seville.

References

  1. Akihabara. 2012 NHK introduces Automatic Animated Sign Language Generation System. In Akihabara News webpage. http://en.akihabaranews.com/.
  2. Bangham, J. A., et al., 2000. Virtual Signing: Capture, Animation, Storage and Transmission An Overview of ViSiCAST. In IEE Seminar on Speech and language processing for disabled and elderly people.
  3. Elliot, R. , Glauert, J. R. W. , Kennaway, J. R. , Marshall, I., 2000. The Development of Language Processing Support for the ViSiCAST Project. In ASSETS 2000.
  4. Kato, N., Kaneko, H., Inoue, S., 2011. Machine translation to Sign Language with CG-animation. In Tehcnical Review. No. 245.
  5. Kipp, M. Heloir, A. , Nguyen, Q. 2011. Sign Language Avatars: Animation and Comprehensibility.IVA 2011, LNAI 6895, pp. 113-126.
  6. Kuroda,T., Sato, K., Chihara, K., 1998. S-TEL: An avatar based sign language telecommunication system. In The International Journal of Virtual Reality. Vol 3, No.4.
  7. Liang,R. , Ouhyoung, M. ,1998. A real-time continuous gesture recognition system for sign language. In Automatic Face and Gesture Recognition, Proc. Third IEEE International Conference on pp.558-567.
  8. Sagawa, H. and Takeuchi, M. , 2000. A Method for Recognizing a Sequence of Sign Language Words Represented in a Japanese Sign Language Sentence. In Proc. of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000 (FG 7800). IEEE Computer Society,
  9. San Segundo et al, 2012. Design, Development and Field Evaluation of a Spanish into Sign Language Translation System. In Pattern Analysis and Applications: Volume 15, Issue 2 (May 2012), Page 203-224,
  10. Verlinden, M. , Tijsseling,C. , Frowein H. ,2001. A Signing Avatar on the WWW. In International Gesture Workshop 2001.
  11. Verlinden, M., Zwitserlood, I., Frowein, H. , 2005. Multimedia with Animated Sign Language for Deaf Learners. In World Conference on Educational Multimedia,Hypermedia & Telecommunications, pp. 4759-4764.
  12. Zwiterslood, I. , Verlinden, M. , Ros, J. , van der Schoot, S. ,2004. Synthetic Signing for the Deaf: eSIGN. In Proc. of the Conf. and Workshop on Assistive Technologies for Vision and Hearing Impairment, CVHI 2004, 29
Download


Paper Citation


in Harvard Style

Vera L., Coma I., Campos J., Martínez B. and Fernández M. (2013). Virtual Avatars Signing in Real Time for Deaf Students . In Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2013) ISBN 978-989-8565-46-4, pages 261-266. DOI: 10.5220/0004293102610266


in Bibtex Style

@conference{grapp13,
author={Lucía Vera and Inmaculada Coma and Julio Campos and Bibiana Martínez and Marcos Fernández},
title={Virtual Avatars Signing in Real Time for Deaf Students},
booktitle={Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2013)},
year={2013},
pages={261-266},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004293102610266},
isbn={978-989-8565-46-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2013)
TI - Virtual Avatars Signing in Real Time for Deaf Students
SN - 978-989-8565-46-4
AU - Vera L.
AU - Coma I.
AU - Campos J.
AU - Martínez B.
AU - Fernández M.
PY - 2013
SP - 261
EP - 266
DO - 10.5220/0004293102610266