Virtual Agents and Multi-modality of Interaction in Multimedia Applications for Cultural Heritage - A Case Study

João Neto, Claudia Ribeiro, João Pereira, Maria João Neto

2015

Abstract

Cultural Heritage encompasses a set of traditions and commodities inherited from our ancestors, and it is vital to convey and preserve them for the next generation. Cultural Multimedia applications and Serious Games form an important pedagogical and didactic medium, mainly for a young demography, which can learn while playing. In this paper is presented an innovative platform, named EI2VA (Engine for Immersive Interaction with Virtual Agents), in which a virtual character, endowed with facial, corporal and behavioural animation can be integrated in multimedia applications. These multimedia applications, derived from the Fala Comigo project, which set the example for a possible use of this technology, preserving the historical and cultural contents indispensable for the users, based on a multi-modality of evident interaction. The resulting multimedia applications were used in a case study conduct with three different user groups (experts and nonexperts) in different settings including classroom, museum and scientific conference.

References

  1. Abt, C. (1970). Serious Games. University Press of America.
  2. Anderson, E., McLoughlin, L., Liarokapis, F., Peters, C., Petridis, P., and de Freitas, S. (2010). Developing serious games for cultural heritage: a state-of-the-art review. Virtual Reality, 14(4):255-275.
  3. Antonaci, A., Ott, M., and Pozzi, F. (2013). Virtual museums, cultural heritage education and 21st century skills. Learning & Teaching with Media & Technology, page 185.
  4. Bernsen, N. O. and Dybkjaer, L. (2004). Evaluation of spoken multimodal conversation. In Proceedings of the 6th International Conference on Multimodal Interfaces, ICMI 7804, pages 38-45, New York, NY, USA. ACM.
  5. Fonseca, M., Campos, P., and Gonc¸alves, D. (2012). Introduc¸a˜o ao Design de Interfaces. FCA - Editora de Informática.
  6. Harlen, W. and James, M. (1997). Assessment and learning: differences and relationships between formative and summative assessment. Assessment in Education, 4(3):365-379.
  7. Michael, D. and Chen, S. (2006). Serious games: games that educate, train and inform. Thomson Course Technology.
  8. Petrelli, D., Ciolfi, L., van Dijk, D., Hornecker, E., Not, E., and Schmidt, A. (2013). Integrating material and digital: a new way for cultural heritage. interactions, 20(4):58-63.
  9. Rego, S. (2004). Fala comigo agente virtual conversacional e emocional. Master's thesis, Instituto Superior Técnico, Lisbon, Portugal.
  10. Ribeiro, C., Antunes, T., Monteiro, M., and Pereira, J. (2013). Serious games in formal medical education: An experimental study. In Games and Virtual Worlds for Serious Applications (VS-GAMES), 2013 5th International Conference on, pages 1-8.
  11. Susi, T., Johannesson, M., and Backlund, P. (2007). Serious games - an overview. Technical Report HS-IKI-TR07-001, School of Humanities and Informatics, University of Skövde, Sweden.
  12. Taras, M. (2005). Assessment-summative and formativesome theoretical reflections. British Journal of Educational Studies, 53(4):466-478.
Download


Paper Citation


in Harvard Style

Neto J., Ribeiro C., Pereira J. and Neto M. (2015). Virtual Agents and Multi-modality of Interaction in Multimedia Applications for Cultural Heritage - A Case Study . In Proceedings of the 10th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2015) ISBN 978-989-758-087-1, pages 446-453. DOI: 10.5220/0005312404460453


in Bibtex Style

@conference{grapp15,
author={João Neto and Claudia Ribeiro and João Pereira and Maria João Neto},
title={Virtual Agents and Multi-modality of Interaction in Multimedia Applications for Cultural Heritage - A Case Study},
booktitle={Proceedings of the 10th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2015)},
year={2015},
pages={446-453},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005312404460453},
isbn={978-989-758-087-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2015)
TI - Virtual Agents and Multi-modality of Interaction in Multimedia Applications for Cultural Heritage - A Case Study
SN - 978-989-758-087-1
AU - Neto J.
AU - Ribeiro C.
AU - Pereira J.
AU - Neto M.
PY - 2015
SP - 446
EP - 453
DO - 10.5220/0005312404460453