Providing Accessibility to Hearing-disabled by a Basque to Sign Language Translation System

María del Puy Carretero, Miren Urteaga, Aitor Ardanza, Mikel Eizagirre, Sara García, David Oyarzun

2014

Abstract

Translation between spoken languages and Sign Languages is especially weak regarding minority languages; hence, audiovisual material in these languages is usually out of reach for people with a hearing impairment. This paper presents a domain-specific Basque text to Spanish Sign Language (LSE) translation system. It has a modular architecture with (1) a text-to-Sign Language translation module using a Rule- Based translation approach, (2) a gesture capture system combining two motion capture system to create an internal (3) sign dictionary, (4) an animation engine and a (5) rendering module. The result of the translation is performed by a virtual interpreter that executes the concatenation of the signs according to the grammatical rules in LSE; for a better LSE interpretation, its face and body expressions change according to the emotion to be expressed. A first prototype has been tested by LSE experts with preliminary satisfactory results.

References

  1. Arana, E., Azpillaga, P., Narbaiza, B., 2007. Linguistic Normalisation and Local Television in the Basque Country. In Minority Laguage Media: Concepts, Critiques and Case Studies. Multilingual Matters. Noth York, 2007.
  2. Baldassarri, S., Cerezo, E., Royo-Santas, F., 2009 Automatic Translation System to Spanish Sign Language with a Virtual Interpreter. In Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I, Uppsala, Sweden: Springer-Verlag, 2009, pp. 196-199.
  3. CESyA. 2010. Ley General Audiovisual. Available at: http://www.cesya.es/es/normativa/legislacion/ley_gene ral_audiovisual (accessed September 11, 2013).
  4. Dam, E., Koch, M., Lillholm, M., 1998. Quaternions, Interpolation and Animation, Technical Report DIKUTR-98/5, Department of Computer Science, Univ. Copenhagen, Denmark.
  5. Ekman, P., 1993. Facial expression and emotion. In American Psychologist, Vol. 48(4) pp 384-392.
  6. Efthimiou, E., Sapountzaki, G., Karpouzis, K. Fotinea, SE., 2004. Developing an e-Learning platform for the Greek Sign Language. In Lecture Notes in Computer Science (LNCS) , in K. Miesenberger, J. Klaus, W. Zagler, D. Burger, Springer (eds), Vol. 3118, 2004, 1107-1113.
  7. Efthimiou E., Fotinea S., Hanke T., Glauert J., Bowden R., Braffort A., Collet C., Maragos P., Goudenove F. 2010. DICTA-SIGN: Sign Language Recognition, Generation and Modelling with application in Deaf Communication. In 4th Workshop on the Representation and Processing of Sign Languages: Corpora and Sign Language Technologies (CSLT 2010), Valletta, Malta, May 2010. pp 80-84.
  8. Francik J. and Fabian, P., 2002. Animating Sign Language in the Real Time. In 20th IASTED International MultiConference on Applied Informatics AI 2002, Innsbruck, Austria, pp. 276-281.
  9. Huenerfauth, M., Zhou, L, Gu, E., Allbeck, J., 2008. Evaluation of American Sign Language generation by native ASL signers. In ACM Trans. Access. Comput. 1, 1, Article 3.
  10. Kipp, M., Haleoir, A. and Nguyen, Q., 2011. Sign Language Avatars: Animation and Comprehensibility. In Proceedings of 11th International Conference on Intelligent Virtual Agents (IVA). Springer.
  11. Lombardo, V., Battaglino, C., Damiano, R. and Nunnari, F., 2011. An avatar-based interface for the Italian Sign Language. In International Conference on Complex, Intelligent, and Software Intensive Systems.
  12. Lopez, V., San-Segundo, R., Martin, R., Lucas, J.M., Echeverry, J.D., 2010 Spanish generation from Spanish Sign Language using a phrase-based translation system. In VI Jornadas en Tecnología del Habla and II Iberian SLTech Workshop, Vigo, España.
  13. San-Segundo, R., Barra, R., D'Haro, L.F., Montero, J.M., Córdoba, R., Ferreiros. J., 2006. A Spanish Speech to Sign Language Translation System. In Proceedings of Interspeech 2006 Pittsburgh, PA.
  14. Smith, R., Morrissey, S., and Somers, H., 2010. HCI for the Deaf community: Developing human-like avatars for sign language synthesis. In Irish Human Computer Interaction Conference'10, September 2-3, Dublin, Ireland.
  15. Vera, L., Coma, I., Campos, J., Martínez, B., Fernández, M. Virtual Avatars Signing in Real Time for Deaf Students. In GRAPP 2013 - The 8th International Conference on Computer Graphics Theory and Applications.
  16. Verlinden, M., Tijsseling, C., Frowein, H., 2001. A Signing Avatar on the WWW. In Proceedings of the 18th International Symposium on Human Factors in Telecommunication, Bergen, Norway. K. Nordby, (ed.).
  17. Zwiterslood, I., Verlinden, M., Ros, J., van der Schoot. S., 2004. Synthetic signing for the deaf: Esign. In Proceedings of the Conference and Workshop on Assistive Technologies for Vision and Hearing Impairment, Granada, Spain, July 2004.
Download


Paper Citation


in Harvard Style

Carretero M., Urteaga M., Ardanza A., Eizagirre M., García S. and Oyarzun D. (2014). Providing Accessibility to Hearing-disabled by a Basque to Sign Language Translation System . In Proceedings of the 6th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-758-015-4, pages 256-263. DOI: 10.5220/0004748502560263


in Bibtex Style

@conference{icaart14,
author={María del Puy Carretero and Miren Urteaga and Aitor Ardanza and Mikel Eizagirre and Sara García and David Oyarzun},
title={Providing Accessibility to Hearing-disabled by a Basque to Sign Language Translation System},
booktitle={Proceedings of the 6th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2014},
pages={256-263},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004748502560263},
isbn={978-989-758-015-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 6th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - Providing Accessibility to Hearing-disabled by a Basque to Sign Language Translation System
SN - 978-989-758-015-4
AU - Carretero M.
AU - Urteaga M.
AU - Ardanza A.
AU - Eizagirre M.
AU - García S.
AU - Oyarzun D.
PY - 2014
SP - 256
EP - 263
DO - 10.5220/0004748502560263