KNOWLEDGE ENGINEERING FOR AFFECTIVE BI-MODAL HUMAN-COMPUTER INTERACTION

Efthymios Alepis, Maria Virvou, Katerina Kabassi

2007

Abstract

This paper presents knowledge engineering for a system that incorporates user stereotypes as well as a multi criteria decision making theory for affective interaction. The system bases its inferences about students’ emotions on user input evidence from the keyboard and the microphone. Evidence form these two modes is combined by a user modelling component underlying the user interface. The user modelling component reasons about users’ actions and voice input and makes inferences in relation to their possible emotional states. The mechanism that integrates the inferences form the two modes has been based on the results of two empirical studies that were conducted in the context of requirements analysis of the system. The evaluation of the developed system showed significant improvements in the recognition of the emotional states of users.

References

  1. Elfenbein, H.A., Ambady, N., 2003. When Familiarity Breeds Accuracy. Cultural Exposure and Facial Emotion Recognition, Journal of Personality and Social Psychology, Vol. 85, No. 2, pp. 276-290.
  2. Fishburn, P.C., 1967. Additive Utilities with Incomplete Product Set: Applications to Priorities and Assignments, Operations Research.
  3. Goleman, D., 1995. Emotional Intelligence, Bantam Books, New York .
  4. Hudlicka, E., 2003. To feel or not to feel: The role of affect in human-computer interaction. International Journal of Human-Computer Studies, Elsevier Science, London, pp. 1-32.
  5. Hwang, C.L., Yoon, K., 1981. Multiple Attribute Decision Making: Methods and Applications. Lecture Notes in Economics and Mathematical Systems 186, Springer, Berlin/Heidelberg/New York.
  6. Kay, J., 2000. Stereotypes, student models and scrutability. In: G. Gauthier, C. Frasson and K. VanLehn (eds.): Proceedings of the Fifth International Conference on Intelligent Tutoring Systems, Lecture Notes in Computer Science, Springer-Verlag, Berlin, Heidelberg, Vol. 1839, pp. 19-30.
  7. Kobsa, A., Koenemann, J., Pohl, W., 2001. Personalized hypermedia presentation techniques for improving online customer relationships. The Knowledge Engineering Review, vol. 16, pp. 111-115.
  8. Moriyama, T., Ozawa, S., 2001. Measurement of Human Vocal Emotion Using Fuzzy Control. Systems and Computers in Japan, Vol. 32, No. 4.
  9. Moriyama, ?., Saito, ?., Ozawa, S., 2001. Evaluation of the Relation between Emotional Concepts and Emotional Parameters in Speech. Systems and Computers in Japan, Vol. 32, No. 3.
  10. Oviatt, S., 2003. User-modeling and evaluation of multimodal interfaces. Proceedings of the IEEE, Institute of Electrical and Electronics Engineers, pp. 1457-1468.
  11. Pantic, M., Rothkrantz, L.J.M., 2003. Toward an affectsensitive multimodal human-cumputer interaction. Vol. 91, Proceedings of the IEEE, Institute of Electrical and Electronics Engineers, pp. 1370-1390.
  12. Picard, R.W., 2003. Affective Computing: Challenges. Int. Journal of Human-Computer Studies, Vol. 59, Issues 1-2, pp. 55-64.
  13. Picard, R.W., Klein, J., 2002. Computers that recognise and respond to user emotion: theoretical and practical implications. Interacting with Computers 14, pp. 141- 169.
  14. Rich, E., 1983. Users are individuals: individualizing user models. International Journal of Man-Machine Studies 18, pp. 199-214.
  15. Stathopoulou, I.O., Tsihrintzis, G.A., 2005. Detection and Expression Classification System for Face Images (FADECS), IEEE Workshop on Signal Processing Systems, Athens, Greece.
Download


Paper Citation


in Harvard Style

Alepis E., Virvou M. and Kabassi K. (2007). KNOWLEDGE ENGINEERING FOR AFFECTIVE BI-MODAL HUMAN-COMPUTER INTERACTION . In Proceedings of the Second International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2007) ISBN 978-989-8111-13-5, pages 218-225. DOI: 10.5220/0002138302180225


in Bibtex Style

@conference{sigmap07,
author={Efthymios Alepis and Maria Virvou and Katerina Kabassi},
title={KNOWLEDGE ENGINEERING FOR AFFECTIVE BI-MODAL HUMAN-COMPUTER INTERACTION},
booktitle={Proceedings of the Second International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2007)},
year={2007},
pages={218-225},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002138302180225},
isbn={978-989-8111-13-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Second International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2007)
TI - KNOWLEDGE ENGINEERING FOR AFFECTIVE BI-MODAL HUMAN-COMPUTER INTERACTION
SN - 978-989-8111-13-5
AU - Alepis E.
AU - Virvou M.
AU - Kabassi K.
PY - 2007
SP - 218
EP - 225
DO - 10.5220/0002138302180225