Virtual Characters with Affective Facial Behavior

Ana Paula Cláudio, Augusta Gaspar, Eder Lopes, Maria Beatriz Carmo

2014

Abstract

This paper describes an application that generates a simulation of a jury with one to three virtual humans capable of exhibiting facial and body expressions controllable in real-time. This control is performed through an interface that combines facial action elements (AU-Action Units, as described in the Facial Action Coding System), with upper-body postures. The level of detail of this control offers a range of possible combinations to obtain emotional expressions. Besides offering the possibility of controlling the postures of the virtual characters, the application allows the user to choose, among a pre-defined set, the virtual characters that compose the jury, and is able to introduce in the simulation some extra, potentially distractive or annoying events. We envisaged two contexts for using this application: i) assisting psychotherapists in exposure therapy of patients suffering from anxiety of public speaking, particularly in front of a jury in an assessment situation; ii) supporting nonverbal behaviour research carried out by psychologists. The development of the application has been closely monitored by a psychologist that is part of our team. This application is a low-cost approach, which uses only free software and models and resorts to common equipment; it is easy to install and use by people without expertise in informatics. So far, we have performed an evaluation with therapists in the first application context, obtaining encouraging results.

References

  1. Adams Jr., R. B, Nelson, A. J., Soto, J. A., Hess, U., Kleck, R. E., 2012. Emotion in the neutral face. Cognition and Emotion, 26 (3), 431-441.
  2. APA- American Psychiatric Association, 2000. DSM-IVTR. American Psychiatric Publishing, Inc..
  3. Anderson, P., Rothbaum, B., Hodges, L. F., 2003. Virtual reality exposure in the treatment of social anxiety. Cognitive and Behavioral Practice, 10(3), 240-247.
  4. Beidel, D. C., Turner, S. M., 2007. Shy Children, Phobic Adults: Nature and Treatment of Social Anxiety Disorder. Washington, DC: APA, 2nd edition.
  5. Cláudio, A. P., Carmo, M. B., Esteves, F., Pinheiro, T., Lima, J., 2012, Virtual environments to cope with anxiety situations - Two case-studies. In IEEE Information Systems and Technologies (CISTI), 7th Iberian Conference, pp. 1-4.
  6. Cláudio, A. P., Carmo, M. B., Pinheiro, T., Esteves, F., Lopes, E., 2013. Virtual Environment to Treat Social Anxiety. In A. Marcus (Ed.): DUXU/HCII 2013, Part II, LNCS 8013, Springer, Heidelberg, 442-451.
  7. Douilliez, C. Yzerbyt, V., Gilboa-Schechtman, E., Philippot, P., 2012. Social anxiety biases the evaluation of facial displays: Evidence from single face and multi-facial stimuli. Cog & Emo, 26(6): 1107-1115.
  8. Eibl-Eibesfeldt, I., 1989. Human Ethology. NY: Aldine de Gruyter.
  9. Ekman, P, Friesen, WV., Hager, J C., 2002. Facial action coding system. Salt Lake City, UT: Research Nexus.
  10. Esteves, F, 1999. Attentional bias to emotional facial expressions. European Review of Applied Psychology / Revue Européenne de Psychologie Appliquée, Vol 49(2), 91-97.
  11. Gaspar, A., Esteves, F., 2012. Preschoolers faces in spontaneous emotional contexts - how well do they match adult facial expression prototypes? Int J Behav Dev. 36(5), 348-357.
  12. Grillon, H., 2009. Simulating interactions with virtual characters for the treatment of social phobia. Doctoral dissertation, EPFL.
  13. Haworth, M. B., Baljko, M., Faloutsos, P., 2012. PhoVR: a virtual reality system to treat phobias. In Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry, 171-174.
  14. Herbelin, B., Riquier, F., Vexo, F., Thalmann, D., 2002. Virtual reality in cognitive behavioral therapy: a preliminary study on social anxiety disorder. In Proceedings of the 8th VSMM2002.
  15. Herbelin, B., 2005. Virtual reality exposure therapy for social phobia. Doctoral dissertation, EPFL.
  16. James, L. K., et al., 2003. Social anxiety in virtual environments: Results of a pilot study. Cyberpsychology & behavior, 6(3), 237-243.
  17. Klinger, E., et al., 2004. Virtual reality exposure in the treatment of social phobia. Studies in health technology and informatics, 99, 91.
  18. Klinger, E, et al., 2005. Virtual reality therapy versus cognitive behavior therapy for social phobia: A preliminary controlled study. Cyberpsychology & behavior, 8(1), 76-88.
  19. LaViola Jr, J. J., 2000. A discussion of cybersickness in virtual environments. ACM SIGCHI Bulletin, 32(1), 47-56.
  20. North, M. M., et al., 1998. Virtual reality therapy: an effective treatment for the fear of public speaking. The International Journal of Virtual Reality 3, 1-6.
  21. Pertaub, D. P., Slater, M., Barker, C., 2001. An experiment on fear of public speaking in virtual reality. Studies in health technology and informatics, 372-378.
  22. Pertaub, D. P., Slater, M., Barker, C., 2002. An experiment on public speaking anxiety in response to three different types of virtual audience. Presence: Teleoperators & Virtual Environments, 11(1), 68-78.
  23. Russell, J. A., Fernandez-Dols, J. M., 1997. What does a facial expression mean? In The psychology of facial expression, pp. 3-30. New York, NY: Cambridge University Press.
  24. Slater, M., et al., 2006. A virtual reprise of the Stanley Milgram obedience experiments. PloS one, 1(1), e39.
  25. Slater, M., Pertaub, D. P., Steed, A., 1999. Public speaking in virtual reality: Facing an audience of avatars. IEEE CG&A, 19(2), 6-9.
  26. Stein, M.B. and Kean, Y.M., 2000. Disability and Quality of Life in Social Phobia: Epidemiologic Findings. Am J Psychiatry 157: 1606-1613.
  27. Vanni, F., et al., 2013. A survey on virtual environment applications to fear of public speaking. European Review for Medical and Pharmacological Sciences, 17(12), 1561-1568.
Download


Paper Citation


in Harvard Style

Cláudio A., Gaspar A., Lopes E. and Carmo M. (2014). Virtual Characters with Affective Facial Behavior . In Proceedings of the 9th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2014) ISBN 978-989-758-002-4, pages 348-355. DOI: 10.5220/0004677803480355


in Bibtex Style

@conference{grapp14,
author={Ana Paula Cláudio and Augusta Gaspar and Eder Lopes and Maria Beatriz Carmo},
title={Virtual Characters with Affective Facial Behavior},
booktitle={Proceedings of the 9th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2014)},
year={2014},
pages={348-355},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004677803480355},
isbn={978-989-758-002-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2014)
TI - Virtual Characters with Affective Facial Behavior
SN - 978-989-758-002-4
AU - Cláudio A.
AU - Gaspar A.
AU - Lopes E.
AU - Carmo M.
PY - 2014
SP - 348
EP - 355
DO - 10.5220/0004677803480355