Physiology-based Affect Recognition During Driving in Virtual Environment for Autism Intervention

Dayi Bian, Joshua Wade, Amy Swanson, Zachary Warren, Nilanjan Sarkar

2015

Abstract

Independent driving is believed to be an important factor of quality of life for individual with autism spectrum disorder (ASD). In recent years, several computer technologies, particularly Virtual Reality (VR), have been explored to improve driving skills in this population. In this work a VR-based driving environment was developed for skill training for teenagers with ASD. Eight channels of physiological signals were recorded in real time for affect recognition during driving. A large set of physiological features were investigated to determine their correlation with four categories of affective states: engagement, enjoyment, frustration and boredom, of teenagers with ASD. In order to have reliable reference points to link the physiological data with the affective states, the subjective reports from a therapist were recorded and analyzed. Six well-known classifiers were used to develop physiology-based affect recognition models, which yielded reliable predictions. These models could potentially be used in future physiology-based adaptive driving skill training system such that the system could adapt based on individual affective states.

References

  1. Baker, R. S., S. K. D'Mello, et al. (2010). "Better to be frustrated than bored: The incidence, persistence, and impact of learners' cognitive-affective states during interactions with three different computer-based learning environments." International Journal of Human-Computer Studies 68(4): 223-241.
  2. Bauminger, N. (2002). "The facilitation of socialemotional understanding and social interaction in high-functioning children with autism: Intervention outcomes." Journal of autism and developmental disorders 32(4): 283-298.
  3. Bekele, E. T., U. Lahiri, et al. (2013). "A step towards developing adaptive robot-mediated intervention architecture (ARIA) for children with autism." Neural Systems and Rehabilitation Engineering, IEEE Transactions on 21(2): 289-299.
  4. Bian, D., J. W. Wade, et al. (2013). A novel virtual reality driving environment for autism intervention. Universal Access in Human-Computer Interaction. User and Context Diversity, Springer: 474-483.
  5. Bradley, M. M. and P. J. Lang (2000). "Measuring emotion: Behavior, feeling, and physiology." Cognitive neuroscience of emotion 25: 49-59.
  6. CDC (2014). "Prevalence of autism spectrum disorder among children aged 8 years-autism and developmental disabilities monitoring network, 11 sites, United States, 2010." Morbidity and mortality weekly report. Surveillance summaries (Washington, DC: 2002) 63: 1.
  7. Cohen, H., M. Amerine-Dickens, et al. (2006). "Early intensive behavioral treatment: Replication of the UCLA model in a community setting." Journal of Developmental & Behavioral Pediatrics 27(2): S145- S155.
  8. Cox, N. B., R. E. Reeve, et al. (2012). "Brief Report: Driving and young adults with ASD: Parents' experiences." Journal of autism and developmental disorders 42(10): 2257-2262.
  9. Golan, O., E. Ashwin, et al. (2010). "Enhancing emotion recognition in children with autism spectrum conditions: An intervention using animated vehicles with real emotional faces." Journal of autism and developmental disorders 40(3): 269-279.
  10. Goodwin, M. S. (2008). "Enhancing and accelerating the pace of autism research and treatment." Focus on Autism and Other Developmental Disabilities 23(2): 125-128.
  11. Hall, M., E. Frank, et al. (2009). "The WEKA data mining software: an update." ACM SIGKDD explorations newsletter 11(1): 10-18.
  12. Hall, M. A. (1999). Correlation-based feature selection for machine learning, The University of Waikato.
  13. Huang, P., T. Kao, et al. (2012). "Factors associated with driving in teens with autism spectrum disorders." Journal of Developmental & Behavioral Pediatrics 33(1): 70-74.
  14. Jerritta, S., M. Murugappan, et al. (2011). Physiological signals based human emotion recognition: a review. Signal Processing and its Applications (CSPA), 2011 IEEE 7th International Colloquium on, IEEE.
  15. Lahiri, U., E. Bekele, et al. (2013). "Design of a virtual reality based adaptive response technology for children with autism." Neural Systems and Rehabilitation Engineering, IEEE Transactions on 21(1): 55-64.
  16. Liu, C., P. Rani, et al. (2006). Affective state recognition and adaptation in human-robot interaction: A design approach. Intelligent Robots and Systems, 2006 IEEE/RSJ International Conference on, IEEE.
  17. Lord, C., S. Risi, et al. (2000). "The Autism Diagnostic Observation Schedule-Generic: A standard measure of social and communication deficits associated with the spectrum of autism." Journal of autism and developmental disorders 30(3): 205-223.
  18. Rani, P., N. Sarkar, et al. (2003). Affective communication for implicit human-machine interaction. Systems, Man and Cybernetics, 2003. IEEE International Conference on, IEEE.
  19. Reimer, B., R. Fried, et al. (2013). "Brief report: examining driving behavior in young adults with high functioning autism spectrum disorders: a pilot study using a driving simulation paradigm." Journal of autism and developmental disorders 43(9): 2211-2217.
  20. Rogers, S. J. (1998). "Empirically supported comprehensive treatments for young children with autism." Journal of clinical child psychology 27(2): 168-179.
  21. Sarkar, N. (2002). Psychophysiological control architecture for human-robot coordination-concepts and initial experiments. Robotics and Automation, 2002. Proceedings. ICRA'02. IEEE International Conference on, IEEE.
  22. Standen, P. J. and D. J. Brown (2005). "Virtual reality in the rehabilitation of people with intellectual disabilities: review." Cyberpsychology & behavior 8(3): 272-282.
  23. Sundberg, M. L. and J. W. Partington (1998). "Teaching language to children with autism and other developmental disabilities." Pleasant Hill, CA: Behavior Analysts.
  24. Tao, J. and T. Tan (2005). Affective computing: A review. Affective computing and intelligent interaction, Springer: 981-995.
  25. Tartaro, A. and J. Cassell (2007). "Using virtual peer technology as an intervention for children with autism." Towards universal usability: designing computer interfaces for diverse user populations. Chichester: John Wiley 231: 62.
  26. Wade, J., D. Bian, et al. (2014). Design of a Virtual Reality Driving Environment to Assess Performance of Teenagers with ASD. Universal Access in HumanComputer Interaction. Universal Access to Information and Knowledge, Springer: 466-474.
  27. Welch, K. C., U. Lahiri, et al. (2009). An affect-sensitive social interaction paradigm utilizing virtual reality environments for autism intervention. HumanComputer Interaction. Ambient, Ubiquitous and Intelligent Interaction, Springer: 703-712.
  28. Wilms, M., L. Schilbach, et al. (2010). "It's in your eyesusing gaze-contingent stimuli to create truly interactive paradigms for social cognitive and affective neuroscience." Social cognitive and affective neuroscience: nsq024.
Download


Paper Citation


in Harvard Style

Bian D., Wade J., Swanson A., Warren Z. and Sarkar N. (2015). Physiology-based Affect Recognition During Driving in Virtual Environment for Autism Intervention . In Proceedings of the 2nd International Conference on Physiological Computing Systems - Volume 1: PhyCS, ISBN 978-989-758-085-7, pages 137-145. DOI: 10.5220/0005331301370145


in Bibtex Style

@conference{phycs15,
author={Dayi Bian and Joshua Wade and Amy Swanson and Zachary Warren and Nilanjan Sarkar},
title={Physiology-based Affect Recognition During Driving in Virtual Environment for Autism Intervention},
booktitle={Proceedings of the 2nd International Conference on Physiological Computing Systems - Volume 1: PhyCS,},
year={2015},
pages={137-145},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005331301370145},
isbn={978-989-758-085-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Physiological Computing Systems - Volume 1: PhyCS,
TI - Physiology-based Affect Recognition During Driving in Virtual Environment for Autism Intervention
SN - 978-989-758-085-7
AU - Bian D.
AU - Wade J.
AU - Swanson A.
AU - Warren Z.
AU - Sarkar N.
PY - 2015
SP - 137
EP - 145
DO - 10.5220/0005331301370145