A KINECT-BASED AUGMENTED REALITY SYSTEM FOR INDIVIDUALS WITH AUTISM SPECTRUM DISORDERS

Xavier Casas, Gerardo Herrera, Inmaculada Coma, Marcos Fernández

2012

Abstract

In this paper an Augmented Reality system for teaching key developmental abilities for individuals with ASD is described. The system has been designed as an augmented mirror where users can see themselves in a mirror world augmented with virtual objects. Regarding the content the tool is designed with the aim of facilitating the acquisition of certain skills in children with ASD. From a technical point of view, it has been necessary to solve two problems to develop the tool. The first one has been how to capture the user’s movements, without wearing invasive devices, to animate their virtual avatar. A Kinect device has been chosen. The other problem has been to mix in the augmented virtual scene real objects located at different depths. An OSG shader has been developed, of which details will given in this paper.

References

  1. Berry R., Makino, M., Hikawa, N., Suzuki, M., Inoue, N., 2006. Tunes on the table. Multimedia Systems, 11 (3): 280-289.
  2. Bogdashina, O. 2003. Sensory Perceptual Issues in Autism and Asperger Syndrome Different Sensory Experiences Different Perceptual Worlds. Jessica Kingsley Publishers: London UK.
  3. Braithwaite, M., & Sigafoos, J. 1998. Effects of social versus musical antecedents on communication responsiveness in five children with developmental disabilities. Journal of Music Therapy, 35(2), 88-104.
  4. Dorfmüller, K., 1999. Robust tracking for augmented reality using retroreflective markers. Computer & Graphics. Volume, 23, 6, 795-800.
  5. Foxlin, E., Harrington, M., Pfeifer, G., 1998. Constellation: A Wide-Range Wireless Tracking System for Augmented Reality and virtual set applications. Proceedings of SIGGRAPH'98.
  6. Vlasic D. et al., 2007. Practical motion capture in everyday surroundings. ACM Transactions on Graphics, Vol. 26, 3.
  7. Herrera, G; Jordan, R; Gimeno, J, 2006. Exploring the advantages of Augmented Reality for Intervention in ASD. Proceedings of the World Autism Congress, Southafrica.
  8. Herrera, G., Alacantud, F., Jordan, R., Blanquer, A., Labajo, G., 2008 Development of symbolic play through the use of virtual reality tools in children with autistic spectrum disorders SAGE Publications and The National Autistic Society, Vol 12(2) 143-157.
  9. Kerawalla, L., Luckin, R., Seljeflot, S., Woolard, A., 2006. Making it real: exploring the potential of augmented reality for teaching primary school science. Virtual Reality, 10, 163-174.
  10. Kimber, D., Vaughan, J., Rieffel, E., 2011. Augmented Perception through Mirror Worlds. Conference AH'11.
  11. Maes, P., Darrell, T., Blumberg, B., Pentland, A., 1997. The ALIVE system: wireless, full-body interaction with autonomous agents. Multimedia Systems 5: 105- 112.
  12. Mulloni, A. 2009. Indoor Positioning and Navigation with Camera Phones. Pervasive Computing, 8, 2, 22-31.
  13. OpenNI TM. http://www.openni.org/ Visited: 2011.
  14. Richard, E., 2007 Augmented Reality for Rehabilitation of Cognitive Disabled Children: A Preliminary Study. Virtual Rehabilitation. pp.102-108.
  15. Strickland, D. 1997. Virtual reality for the treatment of autism. In Virtual Reality in Neuro-PsychoPhysiology. G. Riva, Ed. IOS press. Chapter 5, pp. 81-86.
Download


Paper Citation


in Harvard Style

Casas X., Herrera G., Coma I. and Fernández M. (2012). A KINECT-BASED AUGMENTED REALITY SYSTEM FOR INDIVIDUALS WITH AUTISM SPECTRUM DISORDERS . In Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2012) ISBN 978-989-8565-02-0, pages 440-446. DOI: 10.5220/0003844204400446


in Bibtex Style

@conference{grapp12,
author={Xavier Casas and Gerardo Herrera and Inmaculada Coma and Marcos Fernández},
title={A KINECT-BASED AUGMENTED REALITY SYSTEM FOR INDIVIDUALS WITH AUTISM SPECTRUM DISORDERS},
booktitle={Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2012)},
year={2012},
pages={440-446},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003844204400446},
isbn={978-989-8565-02-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2012)
TI - A KINECT-BASED AUGMENTED REALITY SYSTEM FOR INDIVIDUALS WITH AUTISM SPECTRUM DISORDERS
SN - 978-989-8565-02-0
AU - Casas X.
AU - Herrera G.
AU - Coma I.
AU - Fernández M.
PY - 2012
SP - 440
EP - 446
DO - 10.5220/0003844204400446