Domain Specific Sign Language Animation for Virtual Characters

Marco Romeo, Alun Evans, Daniel Pacheco, Josep Blat

2014

Abstract

This paper describes the design, implementation and results of a system to animate a virtual character to sign in International Sign (IS) By automatically parsing the input data, the system blends animations smoothly together in order to create a coherent and understandable presentation in sign language, with equal importance assigned to both hand and facial animation. Following the blending step, a video is rendered in a variety of formats suitable for distribution. The system was created in collaboration with groups of people with impaired hearing who were fluent in IS, and who were able to validate the results. We present a test case of the system in the shape of ‘Borja’, a virtual character who signed biweekly updates of the Barcelona World Race sailing regatta 2010/2011.

References

  1. Abadia, J. et al., 2009. Assisted animated production creation and programme generation. In Proceedings of the International Conference on Advances in Computer Enterntainment Technology ACE 09. ACM Press, p. 207.
  2. Baylor, A. & Ebbers, S., 2003. The Pedagogical Agent Split-Persona Effect: When Two Agents are Better than One. In World Conference on Educational Multimedia, Hypermedia and Telecommunications. pp. 459-462.
  3. Dehn, D.M. & Van Mulken, S., 2000. The impact of animated interface agents: a review of empirical research. International Journal of Human-Computer Studies, 52(1), pp.1-22.
  4. Elliott, R. et al., 2007. Linguistic modelling and languageprocessing technologies for Avatar-based sign language presentation. Universal Access in the Information Society, 6(4), pp.375-391.
  5. Fallows, D., 2004. The Internet and Daily Life. Pew Research Center's Internet & American Life Project. Available at: http://www.pewinternet.org/Reports/ 2004/The-Internet-and-Daily-Life.aspx.[Accessed July 24, 2013]
  6. Hanke, T., 2004. HamNoSys - representing sign language data in language resources and language processing contexts. In LREC 2004, Workshop proceedings?: Representation and processing of sign languages. pp. 1-6.
  7. Johnson, W.L. & Rickel, J., 1997. Steve: an Animated Pedagogical Agent for Procedural training in virtual environments. ACM SIGART Bulletin, 8(1-4), pp.16- 21.
  8. Kennaway, J.R., Glauert, J.R.W. & Zwitserlood, I., 2007. Providing signed content on the Internet by synthesized animation. ACM Transactions on Computer-Human Interaction, 14(3), p.15-es.
  9. Miesenberger, K. et al. eds., 2010. Computers Helping People with Special Needs, Berlin, Heidelberg: Springer Berlin Heidelberg.
  10. Moundridou, M. & Virvou, M., 2002. Evaluating the persona effect of an interface agent in a tutoring system. Journal of Computer Assisted Learning, 18(3), pp.253-261.
  11. Van Mulken, S., André, E. & Müller, J., 1998. The Persona Effect: How Substantial Is It? People and Computers, XIII, pp.53-66.
  12. Newman, A.J. et al., 2010. Prosodic and narrative processing in American Sign Language: an fMRI study. NeuroImage, 52(2), pp.669-76.
  13. Othman, A., El Ghoul, O. & Jemni, M., 2010. SportSign: A Service to Make Sports News Accessible to Deaf Persons in Sign Languages. Lecture Notes in Computer Science, 6180, pp.169-176.
  14. Weise, T. et al., 2011. Realtime performance-based facial animation. In ACM SIGGRAPH 2011 papers on - SIGGRAPH 7811. New York, New York, USA: ACM Press, p. 1.
  15. Williams, R., 1957. The Animator's Survival Kit, Faber and Faber Inc.
  16. World Federation for the Deaf, 2013. Human Rights. Available at: http://wfdeaf.org/human-rights [Accessed July 24, 2013].
Download


Paper Citation


in Harvard Style

Romeo M., Evans A., Pacheco D. and Blat J. (2014). Domain Specific Sign Language Animation for Virtual Characters . In Proceedings of the 9th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2014) ISBN 978-989-758-002-4, pages 487-494. DOI: 10.5220/0004688104870494


in Bibtex Style

@conference{grapp14,
author={Marco Romeo and Alun Evans and Daniel Pacheco and Josep Blat},
title={Domain Specific Sign Language Animation for Virtual Characters},
booktitle={Proceedings of the 9th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2014)},
year={2014},
pages={487-494},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004688104870494},
isbn={978-989-758-002-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2014)
TI - Domain Specific Sign Language Animation for Virtual Characters
SN - 978-989-758-002-4
AU - Romeo M.
AU - Evans A.
AU - Pacheco D.
AU - Blat J.
PY - 2014
SP - 487
EP - 494
DO - 10.5220/0004688104870494