Gesture Vocabulary for Natural Interaction with Virtual Museums - Case Study: A Process Created and Tested Within a Bilingual Deaf Children School

Lucineide Rodrigues da Silva, Laura Sánchez Garcia, Luciano Silva

2014

Abstract

The research described in this paper aimed at creating a gesture interface for a 3D virtual museum developed by a research group of Image Processing. Faced to the challenge of using sound methodologies in order to create a genuine natural interface, the group joined to a Computer Human Interaction group that has worked for seven years focusing the social inclusion and development of Deaf Communities. In this context, the research investigated the state-of-the-art of Natural Interaction and gestures vocabulary creation in related literature and placed the case study at a bilingual school (Brazilian Sign Language and written Portuguese) for deaf children. The paper reports the results of some specially relevant works from literature and describes the process of developing the vocabulary together with its validation. As the main contributions of this research, we can mention the addition of a previous state – the observation of potential users interacting with the physical scenario that motivates the innovative virtual uses in order to investigate the actions and gestures used n the physical environment – to a well known author’s process that has as its starting point the set of expected functions and the exemplification of a more active way of bringing potential users to the stage of defining the right gestures vocabulary, which brings more help than just interacting with users to get their opinion (asking them to match a feature to the gesture they would like to use to employ it or demonstrating a gesture and seeing what feature users would expect that gesture to trigger). Finally, the paper establishes the limitations of the results and proposes future research.

References

  1. Moore, R., Lopes, J., 1999. Paper templates. In TEMPLATE'06, 1st International Conference on Template Production. SciTePress.
  2. Beurden, M. V., IJsselsteijn, W., and de Kort, Y. 2011. User experience of gesture-based interfaces: A comparison with traditional interaction methods on pragmatic and hedonic qualities. In the 9th International Gesture Workshop: Gesture in Embodied Communication and Human-Computer Interaction, Athens, Greece.
  3. Boulos, M. N. K., Blanchard, B. J.,Walker, C., Montero, J., Tripathy, A., and Gutierrez-Osuna, R. 2011. Web gis in practice x: a microsoft kinect natural user interface for google earth navigation. International Journal of Health Geographics, 10.
  4. Capovilla, F. C. and Raphael, W. D. 2001. Dicionário Enciclopédico Ilustrado Trilíngue da Língua de Sinais Brasileira. EdUSP - Editora da Universidade de São Paulo, 2 edition.
  5. Chino, D. Y. T., Romani, L. A. S., Avalhais, L. P. S., Oliveira, W. D., do Valle Gonçalves, R. R., Jr., C. T., and Traina, A. J. M. 2013. The nina framework - using gesture to improve interaction and collaboration in geographical information systems. In International Conference on Enterprise Information Systems - ICEIS, pages 58-66.
  6. Grandhi, S. A., Joue, G., and Mittelberg, I. 2011. Understanding naturalness and intuitiveness in gesture production: insights for touchless gestural interfaces. In Proceedings of the 2011 annual conference on Human factors in computing systems, CHI, pages 821- 824, New York, NY, USA. ACM.
  7. Imago, G. Museu virtual 3D: Preservação digital de acervos culturais e naturais. http:// www.imago.ufpr.br/museu3d/.
  8. Mendes, C. M. 2010. Visualização 3D interativa aplicada à preservação digital de acervos naturais e culturais. Master's thesis, Universidade Federal do Paraná.
  9. Nielsen, J. 1993. Usability Engineering. Morgan Kaufmann, 1 edition.
  10. Nielsen, J. 2000. “Test with 5 Users”, Alertbox. http://www.useit.com/alertbox/20000319.html [Picked up in May,2003].
  11. Nielsen, J. 2003. Introduction to usability. http://www.useit.com/alertbox/20030825.html.
  12. Nielsen, M., Storring, M., Moeslund, T. B., and Granum, E. 2004. A procedure for developing intuitive and ergonomic gesture interfaces for hci. In Camurri, A. and Volpe, G., editors, Gesture-Based Communication in Human-Computer Interaction, volume 2915 of Lecture Notes in Computer Science, chapter 38, pages 105-106. Springer Berlin / Heidelberg, Berlin, Heidelberg.
  13. Norman, D. A. and Nielsen, J. 2010. Gestural interfaces: a step backward in usability. Interactions, 17(5):46-49.
  14. Saffer, D. 2009. Designing Gestural Interfaces, O'Reilly Media, Inc. Canada.
  15. Vrubel, A., Bellon, O. R. P., and Silva, L. 2009. A 3D reconstruction pipeline for digital preservation. IEEE Conference on Computer Vision and Pattern Recognition, 0:2687-2694.
  16. Wigdor, D. and Wixon, D. 2011. Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. Morgan Kaufmann, 1 edition.
Download


Paper Citation


in Harvard Style

Rodrigues da Silva L., Garcia L. and Silva L. (2014). Gesture Vocabulary for Natural Interaction with Virtual Museums - Case Study: A Process Created and Tested Within a Bilingual Deaf Children School . In Proceedings of the 16th International Conference on Enterprise Information Systems - Volume 3: ICEIS, ISBN 978-989-758-029-1, pages 5-13. DOI: 10.5220/0004886700050013


in Bibtex Style

@conference{iceis14,
author={Lucineide Rodrigues da Silva and Laura Sánchez Garcia and Luciano Silva},
title={Gesture Vocabulary for Natural Interaction with Virtual Museums - Case Study: A Process Created and Tested Within a Bilingual Deaf Children School},
booktitle={Proceedings of the 16th International Conference on Enterprise Information Systems - Volume 3: ICEIS,},
year={2014},
pages={5-13},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004886700050013},
isbn={978-989-758-029-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 16th International Conference on Enterprise Information Systems - Volume 3: ICEIS,
TI - Gesture Vocabulary for Natural Interaction with Virtual Museums - Case Study: A Process Created and Tested Within a Bilingual Deaf Children School
SN - 978-989-758-029-1
AU - Rodrigues da Silva L.
AU - Garcia L.
AU - Silva L.
PY - 2014
SP - 5
EP - 13
DO - 10.5220/0004886700050013