DYNAMIC MULTIMEDIA CONTENT DELIVERY BASED ON REAL-TIME USER EMOTIONS - Multichannel Online Biosignals Towards Adaptative GUI and Content Delivery

Vasco Vinhas, Luís Paulo Reis, Eugénio Oliveira

2009

Abstract

Recently topics such as affective computing and multichannel multimedia distribution have gained the attention and investment of both industry and academics. The proposed system joins these domains so that ubiquitous system can be potentiated by means of online user emotion assessment based on real-time user’s biosignals. It was used IAPS as a emotional library for controlled visual stimuli and biosignals were collected in real-time - heartbeat rate and skin conductance - in order to online assess the user's emotional state through Russell’s Circumplex Model of Affect. To improve usability and session setup, a distributed architecture was used so that software models might be physically detached. The conducted experimental sessions and the validation interviews supported the system's efficiency not only in real-time discrete emotional state assessment but also considering the emotion inducing process. The future work consists in replicating the success in multi-format multimedia contents without pre-defined emotional metadata.

References

  1. Aftanas, L. I., el al. 1997. Nonlinear forecasting measurements of the human eeg during evoked emotions. Brain Topography. pp. 155-162.
  2. Altarriba, J., Basnight, D. M., & Canary, T. M. 2003. Emotion representation and perception across cultures. In W. J. Lonner, D. L. Dinnel, S. A. Hayes, & D. N. Sattler (Eds.), Readings in Psychology and Culture (Unit 4, Chapter 5), Center for Cross-Cultural Research, Western Washington University, Bellingham, Washington USA.
  3. Chanel, G., et al. 2005. Emotion Assessment: Arousal Evaluation using EEG's and Peripheral Physiological Signals. University of Geneva, Switzerland: Computer Science Department, pp 530-537, vol 4105/2006.
  4. Damásio, A. R. 1994. Descartes error: Emotion, reason and human brain. Europa-América.
  5. Damásio, A. R. 1998. Emotions and the Human Brain. Iowa, USA: Department of Neurology.
  6. Ebersole, J. (2002). Current Practice of Clinical Electroencephalography. Lippincott W&W.
  7. Ishino, K. (2003). A feeling estimation system using a simple electroencephalograph. Journal of Neural Engineering, pp. 63-71.
  8. Kim, J. & André, E (2008). Multi-Channel BioSignal Analysis for Automatic Emotion Recognition. Biosignals 2008.
  9. Lang, P. J. 1980. Behavioral treatment and bio-behavioral assessment: Computer applications. In J. B. Sidowski, J. H. Johnson, & T. A. Williams (Eds.), Technology in mental health care delivery systems (pp. 119-137). Norwood, NJ: Ablex.
  10. Lang, P.J., Bradley, M.M., & Cuthbert, B.N. 2005. International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical Report A-6. University of Florida, Gainesville, FL.
  11. Leuthardt, E. 2004. A braincomputer interface using electrocorticographic signals in humans. IEEE International Conference on Systems, Man, and Cybernetics, pp. 4204-4209..
  12. Russell, J. A. 1980. A circumplex model of affect. Journal of Personality and Social Psychology, 39, 1161-1178.
  13. Takahaski, K. 2004. Remarks on Emotion Recognition from Bio-Potential Signals. 2nd International Conference on Autonomous Robots and Agents pp 1148-1153, vol 3.
  14. Teixeira, J., Vinhas, V. et al. 2008. Multichannel Emotion Assessment Framework: Gender and High-Frequency Electroencephalography as Key-Factors. ICINCO 2008.
Download


Paper Citation


in Harvard Style

Vinhas V., Reis L. and Oliveira E. (2009). DYNAMIC MULTIMEDIA CONTENT DELIVERY BASED ON REAL-TIME USER EMOTIONS - Multichannel Online Biosignals Towards Adaptative GUI and Content Delivery . In Proceedings of the International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2009) ISBN 978-989-8111-65-4, pages 299-304. DOI: 10.5220/0001543302990304


in Bibtex Style

@conference{biosignals09,
author={Vasco Vinhas and Luís Paulo Reis and Eugénio Oliveira},
title={DYNAMIC MULTIMEDIA CONTENT DELIVERY BASED ON REAL-TIME USER EMOTIONS - Multichannel Online Biosignals Towards Adaptative GUI and Content Delivery },
booktitle={Proceedings of the International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2009)},
year={2009},
pages={299-304},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001543302990304},
isbn={978-989-8111-65-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2009)
TI - DYNAMIC MULTIMEDIA CONTENT DELIVERY BASED ON REAL-TIME USER EMOTIONS - Multichannel Online Biosignals Towards Adaptative GUI and Content Delivery
SN - 978-989-8111-65-4
AU - Vinhas V.
AU - Reis L.
AU - Oliveira E.
PY - 2009
SP - 299
EP - 304
DO - 10.5220/0001543302990304