EMOTION-BASED MULTIMEDIA RETRIEVAL AND DELIVERY THROUGH ONLINE USER BIOSIGNALS - Multichannel Online Biosignals Towards Adaptative GUI and Content Delivery

Vasco Vinhas, Luís Paulo Reis, Eugénio Oliveira

2009

Abstract

Affective computing and multichannel multimedia distribution have gathered the time and investment of industry and academics. The proposed system merges such domains so that ubiquitous system can be enhanced through online user emotion assessment based on user’s biosignals. It was used IAPS as a emotional library for controlled visual stimuli and biosignals were collected in real-time - heartbeat rate and skin conductance - in order to online assess the user's emotional state through Russell’s Circumplex Model of Affect. In order to improve usability and session setup, a distributed architecture was used so that software models might be physically detached. The conducted experimental sessions and the validation interviews supported the system's efficiency not only in real-time discrete emotional state assessment but also considering the emotion inducing process. The next logic step consists in replicating the achieved success in multi-format multimedia contents without the need of pre-defined restricted emotional metadata.

References

  1. Altarriba, J., Basnight, D. M., & Canary, T. M. 2003. Emotion representation and perception across cultures. In W. J. Lonner, D. L. Dinnel, S. A. Hayes, & D. N. Sattler (Eds.), Readings in Psychology and Culture (Unit 4, Chapter 5), Center for Cross-Cultural Research, Western Washington University, Bellingham, Washington USA.
  2. Chanel, G., et al. 2005. Emotion Assessment: Arousal Evaluation using EEG's and Peripheral Physiological Signals. University of Geneva, Switzerland: Computer Science Department, pp 530-537, vol 4105/2006.
  3. Damásio, A. R. 1994. Descartes error: Emotion, reason and human brain. Europa-América.
  4. Damásio, A. R. 1998. Emotions and the Human Brain. Iowa, USA: Department of Neurology.
  5. Ishino, K. (2003). A feeling estimation system using a simple electroencephalograph. Journal of Neural Engineering, pp. 63-71.
  6. Kim, J. & André, E (2008). Multi-Channel BioSignal Analysis for Automatic Emotion Recognition. Biosignals 2008.
  7. Lang, P. J. 1980. Behavioral treatment and biobehavioral assessment: Computer applications. In J. B. Sidowski, J. H. Johnson, & T. A. Williams (Eds.), Technology in mental health care delivery systems (pp. 119-137). Norwood, NJ: Ablex.
  8. Lang, P.J., Bradley, M.M., & Cuthbert, B.N. 2005. International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical Report A-6. University of Florida, Gainesville, FL.
  9. Leuthardt, E. 2004. A braincomputer interface using electrocorticographic signals in humans. IEEE International Conference on Systems, Man, and Cybernetics, pp. 4204-4209..
  10. Russell, J. A. 1980. A circumplex model of affect. Journal of Personality and Social Psychology, 39, 1161-1178.
  11. Takahaski, K. 2004. Remarks on Emotion Recognition from Bio-Potential Signals. 2nd International Conference on Autonomous Robots and Agents pp 1148-1153, vol 3.
  12. Teixeira, J., Vinhas, V. et al. 2008. Multichannel Emotion Assessment Framework: Gender and High-Frequency Electroencephalography as KeyFactors. ICINCO 2008,
Download


Paper Citation


in Harvard Style

Vinhas V., Reis L. and Oliveira E. (2009). EMOTION-BASED MULTIMEDIA RETRIEVAL AND DELIVERY THROUGH ONLINE USER BIOSIGNALS - Multichannel Online Biosignals Towards Adaptative GUI and Content Delivery . In Proceedings of the International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-8111-66-1, pages 232-237. DOI: 10.5220/0001658502320237


in Bibtex Style

@conference{icaart09,
author={Vasco Vinhas and Luís Paulo Reis and Eugénio Oliveira},
title={EMOTION-BASED MULTIMEDIA RETRIEVAL AND DELIVERY THROUGH ONLINE USER BIOSIGNALS - Multichannel Online Biosignals Towards Adaptative GUI and Content Delivery},
booktitle={Proceedings of the International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2009},
pages={232-237},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001658502320237},
isbn={978-989-8111-66-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - EMOTION-BASED MULTIMEDIA RETRIEVAL AND DELIVERY THROUGH ONLINE USER BIOSIGNALS - Multichannel Online Biosignals Towards Adaptative GUI and Content Delivery
SN - 978-989-8111-66-1
AU - Vinhas V.
AU - Reis L.
AU - Oliveira E.
PY - 2009
SP - 232
EP - 237
DO - 10.5220/0001658502320237


in Harvard Style

Vinhas V., Reis L. and Oliveira E. (2009). EMOTION-BASED MULTIMEDIA RETRIEVAL AND DELIVERY THROUGH ONLINE USER BIOSIGNALS - Multichannel Online Biosignals Towards Adaptative GUI and Content Delivery.In Proceedings of the International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-8111-66-1, pages 232-237. DOI: 10.5220/0001658502320237


in Bibtex Style

@conference{icaart09,
author={Vasco Vinhas and Luís Paulo Reis and Eugénio Oliveira},
title={EMOTION-BASED MULTIMEDIA RETRIEVAL AND DELIVERY THROUGH ONLINE USER BIOSIGNALS - Multichannel Online Biosignals Towards Adaptative GUI and Content Delivery},
booktitle={Proceedings of the International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2009},
pages={232-237},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001658502320237},
isbn={978-989-8111-66-1},
}


in EndNote Style

TY - CONF

JO - Proceedings of the International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - EMOTION-BASED MULTIMEDIA RETRIEVAL AND DELIVERY THROUGH ONLINE USER BIOSIGNALS - Multichannel Online Biosignals Towards Adaptative GUI and Content Delivery
SN - 978-989-8111-66-1
AU - Vinhas V.
AU - Reis L.
AU - Oliveira E.
PY - 2009
SP - 232
EP - 237
DO - 10.5220/0001658502320237