A Fuzzy Modelling Approach of Emotion for Affective Computing Systems

Charalampos Karyotis, Faiyaz Doctor, Rahat Iqbal, Anne James, Victor Chang

2016

Abstract

In this paper we present a novel affective modelling approach to be utilised by Affective Computing systems. This approach is a combination of the well known Arousal Valence model of emotion and the newly introduced Affective Trajectories Hypothesis. An adaptive data driven fuzzy method is proposed in order to extract personalized emotion models, and successfully visualise the associations of these models’ basic elements, to different emotional labels, using easily interpretable fuzzy rules. Namely we explore how the combinations of arousal, valence, prediction of the future, and the experienced outcome after this prediction, enable us to differentiate between different emotional labels. We use the results obtained from a user study consisting of an online survey, to demonstrate the potential applicability of this affective modelling approach, and test the effectiveness and stability of its adaptive element, which accounts for individual differences between the users. We also propose a basic architecture in order for this approach to be used effectively by AC systems, and finally we present an implementation of a personalised learning system which utilises the suggested framework. This implementation is tested through a pilot experimental session consisting of a tutorial on fuzzy logic which was conducted under an activity-led and problem based learning context.

References

  1. Bradley, M.M. & Lang, P.J. (2010). Affective Norms for English Words (ANEW): Instruction manual and affective ratings. Technical Report C-2, Gainesville, FL.The Center for research in Psychophysiology, University of Florida.
  2. Dawson, M.E., Schell, A. M., and Filion, D. L. (2007) The electrodermal system, In Cacioppo, J. T., Tassinary, L. G., Berntson, G. (eds),Handbook of Psychophysiology. Cambridge University Press, Cambridge.
  3. Doctor, F., Hagras, H., Callaghan, V. (2005) A Fuzzy Embedded Agent-Based Approach for Realizing Ambient Intelligence in Intelligent Inhabited Environments. IEEE Transactions on Systems, Man and Cybernatics- Part A: Systems and Humans, 35(1), 55-56.
  4. Ekman, P., and Friesen, W. V. (1975) Unmasking the Face: A Guide to Recognizing Emotions from Facial Expressions. Prentice-Hall, Englewood Cliffs, New Jersey, NJ.
  5. Graesser, A., Chipman, P., Haynes, B. and Olney, A. (2005) AutoTutor: An Intelligent Tutoring System with Mixed-Initiative Dialogue. IEEE Transactions on Education 48(4), 612-618.
  6. Karyotis, C., Doctor, F., Iqbal, R., and James, A. (2015) An Intelligent Framework for Monitoring Students Affective Trajectories Using Adaptive Fuzzy Systems. IEEE International Conference on Fuzzy Systems, 2-5 August 2015, Istanbul, Turkey.
  7. Kirkland, T., and Cunningham, W. A. (2012) Mapping Emotions Through Time: How Affective Trajectories Inform the Language of Emotion. Emotion, 12(2), 268-282.
  8. Lisetti, C., Nasoz, F., LeRouge, C., Ozyer, O. and Alvarez, K. (2003) Developing multimodal intelligent affective interfaces for tele-home health care. Internarional Journal of Human-Computer Studies, 59(1-2), 245-255.
  9. Mandryk, R.L., Atkins, M.S. (2007) A Fuzzy Physiological Approach for Continuously Modelling Emotion during Interaction with Play Technologies. International Journal of Human-Computer Studies, 65, 329- 347.
  10. McFarland, R. A. (1985) Relationship of skin temperature changes to the emotions accompanying music. Biofeedback and Self-regulation, 10(3), 255-267.
  11. Nasoz, F., Lisetti, C., and Vasilakos A. (2010) Affectively intelligent and adaptive car interfaces. Information Sciences, 180, 3817-3836.
  12. Picard, R. (1997) Affective Computing. The MIT Press, Cambridge MA.
  13. Rainville, P., Bechara, A., Naqvi, N., and Damasio, A. R. (2006) Basic emotions are associated with distinct patterns of cardiorespiratory activity. International Journal of Psychophysiology, 61(1), 5-18.
  14. Russell, J. A. (1980) A Circumplex Model of Affect. Journal of Personality and Social Psychology, 39(6), 1161-1178.
  15. Wang, L. X. (2003) The MW method completed: A flexible system approach to data mining. IEEE Transactions Fuzzy Systems, 11(6), 768-782.
  16. Wu, D. et al. (2010) Using Physiological Signals: Virtual Reality Stroop Task. IEEE Transactions on Affective Computing, 1(2), 109-118.
  17. Wu, D. (2012) Fuzzy sets and systems in building closedloop affective computing systems for human-computer interaction: Advances and new directions, IEEE World Congress on Computational Intelligence, Brisbane, Australia.
Download


Paper Citation


in Harvard Style

Karyotis C., Doctor F., Iqbal R., James A. and Chang V. (2016). A Fuzzy Modelling Approach of Emotion for Affective Computing Systems . In Proceedings of the International Conference on Internet of Things and Big Data - Volume 1: RAIBS, (IOTBD 2016) ISBN 978-989-758-183-0, pages 453-460. DOI: 10.5220/0005945604530460


in Bibtex Style

@conference{raibs16,
author={Charalampos Karyotis and Faiyaz Doctor and Rahat Iqbal and Anne James and Victor Chang},
title={A Fuzzy Modelling Approach of Emotion for Affective Computing Systems},
booktitle={Proceedings of the International Conference on Internet of Things and Big Data - Volume 1: RAIBS, (IOTBD 2016)},
year={2016},
pages={453-460},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005945604530460},
isbn={978-989-758-183-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Internet of Things and Big Data - Volume 1: RAIBS, (IOTBD 2016)
TI - A Fuzzy Modelling Approach of Emotion for Affective Computing Systems
SN - 978-989-758-183-0
AU - Karyotis C.
AU - Doctor F.
AU - Iqbal R.
AU - James A.
AU - Chang V.
PY - 2016
SP - 453
EP - 460
DO - 10.5220/0005945604530460