Amaryllis Raouzaiou, Kostas Karpouzis, Stefanos Kollias


Man-Machine Interaction (MMI) systems that utilize multimodal information about users' current emotional state are presently at the forefront of interest of the computer vision and artificial intelligence communities. Interfaces with human faces expressing emotions may help users feel at home when interacting with a computer because they are accepted as the most expressive means for communicating and recognizing emotions. Thus, emotion synthesis can enhance the atmosphere of a virtual environment and communicate messages far more vividly than any textual or speech information. In this paper, we present an abstract means of description of facial expressions, by utilizing concepts included in the MPEG-4 standard to synthesize expressions using a reduced representation, suitable for networked and lightweight applications.


  1. Kendon, A, 1988. How gestures can become like words. In Crosscultural perspectives in nonverbal communication. Potyatos, F. (ed.). Hogrefe, Toronto, Canada.
  2. Wexelblat, A., 1995. An approach to natural gesture in virtual environments. In ACM Transactions on Computer-Human Interaction, Vol. 2, iss. 3.
  3. Parke, F., Waters, K., 1996. Computer Facial Animation. A K Peters.
  4. Quek, F., 1996. Unencumbered gesture interaction. In IEEE Multimedia, Vol. 3. no. 3.
  5. Faigin, G., 1990. The Artist's Complete Guide to Facial Expressions. Watson-Guptill, New York.
  6. Lin, J., Wu, Y., Huang, T.S., 2000. Modeling human hand constraints. In Proc. Workshop on Human Motion.
  7. Bassili, J. N., 1979. Emotion recognition: The role of facial movement and the relative importance of upper and lower areas of the face. Journal of Personality and Social Psychology, 37.
  8. Kuch, J. J., Huang, T. S., 1995. Vision-based hand modeling and tracking for virtual teleconferencing and telecollaboration. In Proc. IEEE Int. Conf. Computer Vision.
  9. Karpouzis, K., Tsapatsoulis, N., Kollias, S., 2000. Moving to Continuous Facial Expression Space using the MPEG-4 Facial Definition Parameter (FDP) Set. In Electronic Imaging 2000 Conference of SPIE. San Jose, CA, USA.
  10. Davis, M., College, H., 1975. Recognition of Facial Expressions. Arno Press, New York.
  11. Preda, M., PrĂȘteux, F., 2002. Advanced animation framework for virtual characters within the MPEG-4 standard. In Proc. of the International Conference on Image Processing. Rochester, NY.
  12. Tekalp, M., Ostermann, J., 2000. Face and 2-D mesh animation in MPEG-4.In Image Communication Journal, Vol.15, Nos. 4-5.
  13. Ekman, P., Friesen, W., 1978. The Facial Action Coding System. In Consulting Psychologists Press. San Francisco, CA.
  14. Ekman, P., 1993. Facial expression and Emotion. In Am. Psychologist, Vol. 48.
  15. Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., Taylor, J., 2001. Emotion Recognition in Human-Computer Interaction. In IEEE Signal Processing Magazine.
  16. Plutchik, R., 1980. Emotion: A psychoevolutionary synthesis. Harper and Row New York.
  17. Whissel, C.M., 1989. The dictionary of affect in language. In Emotion: Theory, research and experience: Vol 4, The measurement of emotions. Plutchnik, R., Kellerman, H. (eds). Academic Press, New York.
  18. Wilson, A., Bobick, A., 1998. Recognition and interpretation of parametric gesture. In Proc. IEEE Int. Conf. Computer Vision.
  19. Wu, Y., Huang, T.S., 2001.Hand modeling, analysis, and recognition for vision-based human computer interaction. In IEEE Signal Processing Magazine. Vol. 18, iss. 3.
  20. Raouzaiou, A., Tsapatsoulis, N., Karpouzis, K., Kollias, S., 2002. Parameterized facial expression synthesis based on MPEG-4. In EURASIP Journal on Applied Signal Processing. Vol. 2002, No. 10. Hindawi Publishing Corporation.

Paper Citation

in Harvard Style

Raouzaiou A., Karpouzis K. and Kollias S. (2004). EMOTION SYNTHESIS IN VIRTUAL ENVIRONMENTS . In Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 5: ICEIS, ISBN 972-8865-00-7, pages 44-52. DOI: 10.5220/0002639200440052

in Bibtex Style

author={Amaryllis Raouzaiou and Kostas Karpouzis and Stefanos Kollias},
booktitle={Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 5: ICEIS,},

in EndNote Style

JO - Proceedings of the Sixth International Conference on Enterprise Information Systems - Volume 5: ICEIS,
SN - 972-8865-00-7
AU - Raouzaiou A.
AU - Karpouzis K.
AU - Kollias S.
PY - 2004
SP - 44
EP - 52
DO - 10.5220/0002639200440052