DYNAMIC MULTIMEDIA ENVIRONMENT BASED ON REALTIME USER EMOTION ASSESSMENT - Biometric User Data towards Affective Immersive Environments

Vasco Vinhas, Daniel Castro Silva, Eugénio Oliveira, Luís Paulo Reis

2009

Abstract

Both the academic and industry sectors have increased their attention and investment to the fields of Affective Computing and immersive digital environments, the latter imposing itself as a reliable domain, with increasingly cheaper hardware solutions. With all this in mind, the authors envisioned an immersive dynamic digital environment tied with automatic real-time user emotion assessment through biometric readings. The environment consisted in an aeronautical simulation, with internal variables such as flight plan, weather conditions and maneuver smoothness dynamically altered by the assessed emotional state of the user, based on biometric readings, including galvanic skin response, respiration rate and amplitude and phalange temperature. The results were consistent with the emotional states reported by the users, with a success rate of 78%.

References

  1. Altarriba, J., Basnight, D. M., & Canary, T. M., 2003. Emotion representation and perception across cultures. In W. J. Lonner, D. L. Dinnel, S. A. Hayes, & D. N. Sattler (Eds.), Readings in Psychology and Culture (Unit 4, Chapter 5), Center for Cross-Cultural Research, WWU, Bellingham, WA, USA.
  2. Anderson, P., Jacobs, C.H., Lindner, G.K., Edwards, S., Zimand, E., Hodges, L., Rothbaum, B.O., 2006. Cognitive behavior therapy for fear of flying: sustainability of treatment gains after September 11. Behavior Therapy, Volume 37, Issue 1, pp. 91-97.
  3. Benovoy, M., Cooperstock, J., Deitcher, J., 2008. Biosignals Analysis and its Application in a Performance Setting - Towards the Development of an Emotional-Imaging Generator. In Proceedings of the First International Conference on Biomedical Electronics and Devices, pp. 253-258.
  4. Bird, S., 2005. You're Cleared for Take-Off - How to Tackle a Fear of Flying on a Virtual Plane. The Times, March 2005. Available online at http://www.timesonline.co.uk/tol/life_and_style/health /features/article549165.ece. Consulted Dec. 2008.
  5. da Costa, R., Sardinha, A., Nardi, A., 2008. Virtual Reality Exposure in the Treatment of Fear of Flying. Aviation, Space, and Environmental Medicine, 79(9), pp. 899- 903.
  6. Gimenes, R., Silva D.C.,Reis, LP, Oliveira, E., 2008. Flight Simulation Environments Applied to AgentBased Autonomous UAVs. In Proceedings of ICEIS 2008, pp. 243-246.
  7. Kahan, M., Tanzer, J., Darvin, D., and Borer, F., 2000. Virtual Reality-Assisted Cognitive-Behavioral Treatment for Fear of Flying: Acute Treatment and Follow-up. CyberPsychology & Behavior, 3(3), pp. 387-392.
  8. Katsis, C., Katertsidis N., Ganiatsas G. and Fotiadis D., 2008. Towards Emotion Recognition in Car-Racing Drivers: A Biosignal Processing Approach. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, Vol. 38, pp. 502-512.
  9. Kim, J., André, E., 2008. Multi-Channel BioSignal Analysis for Automatic Emotion Recognition. In Proceedings of the First International Conference on Biomedical Electronics and Devices.
  10. Lewis, M., Jacobson, J., 2002. Game Engines in Scientific Research. Communications of the ACM. Vol. 45, Nr. 1, pp. 27-31.
  11. Rothbaum, B. O., Anderson, P., Zimand, E., Hodges, L., Lang, D., & Wilson, J., 2006. Virtual reality exposure therapy and standard (in vivo) exposure therapy in the treatment for the fear of flying. Behavior Therapy, Vol. 37, Issue 1, pp. 80-90.
  12. Russell, J. A., 1980. A Circumplex Model of Affect. In Journal of Personality and Social Psychology, 39, pp. 1161-1178.
  13. Stoller, G., 2006. Fear of Flying can Cripple Workers, USA Today, March 2006. Available online at http://www.usatoday.com/educate/college/business/art icles/20060326.htm. Consulted Dec. 2008.
  14. Teixeira, J., Vinhas, V., Oliveira, E., Reis, LP., 2008. Emotion Assessment Tool for Human-Machine Interfaces - Using EEG Data and Multimedia Stimuli Towards Emotion Classification. In SIGMAP, pp. 185-188.
  15. Vinhas, V., Oliveira, E., Reis, LP., 2008. Realtime Dynamic Multimedia Storyline Based on Online Audience Biometric Information. In KES IIMSS, pp. 545-554.
Download


Paper Citation


in Harvard Style

Vinhas V., Castro Silva D., Oliveira E. and Paulo Reis L. (2009). DYNAMIC MULTIMEDIA ENVIRONMENT BASED ON REALTIME USER EMOTION ASSESSMENT - Biometric User Data towards Affective Immersive Environments . In Proceedings of the 11th International Conference on Enterprise Information Systems - Volume 5: ICEIS, ISBN 978-989-8111-88-3, pages 42-47. DOI: 10.5220/0001984100420047


in Bibtex Style

@conference{iceis09,
author={Vasco Vinhas and Daniel Castro Silva and Eugénio Oliveira and Luís Paulo Reis},
title={DYNAMIC MULTIMEDIA ENVIRONMENT BASED ON REALTIME USER EMOTION ASSESSMENT - Biometric User Data towards Affective Immersive Environments},
booktitle={Proceedings of the 11th International Conference on Enterprise Information Systems - Volume 5: ICEIS,},
year={2009},
pages={42-47},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001984100420047},
isbn={978-989-8111-88-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th International Conference on Enterprise Information Systems - Volume 5: ICEIS,
TI - DYNAMIC MULTIMEDIA ENVIRONMENT BASED ON REALTIME USER EMOTION ASSESSMENT - Biometric User Data towards Affective Immersive Environments
SN - 978-989-8111-88-3
AU - Vinhas V.
AU - Castro Silva D.
AU - Oliveira E.
AU - Paulo Reis L.
PY - 2009
SP - 42
EP - 47
DO - 10.5220/0001984100420047