DYNAMIC FACIAL EXPRESSION UNDERSTANDING BASED ON TEMPORAL MODELLING OF TRANSFERABLE BELIEF MODEL

Zakia Hammal

2006

Abstract

In the present contribution a novel approach for dynamic facial expressions classification is presented and discussed. The presented approach is based on the use of the Transferable Belief Model applied to static facial expression classification studied in previous developments. The system is able to recognize pure facial expressions, i.e., Joy, Surprise, Disgust and Neutral as well as their mixtures. Additionally, this approach is able to deal with all facial feature configurations that does not correspond to any of the cited expression, i.e., Unknown expressions. The major improvement of this former work consists in the introduction of the temporal evolution of the facial feature behavior. Initially, the temporal information is introduced to improve the robustness of the frame-by-frame classification by the correction of errors due to the automatic segmentation process. In addition since a facial expression is the result of a dynamic and progressive combination of facial features behavior, which is not always synchronous, a frame-by-frame classification is not sufficient. To overcome this constraint, we propose the introduction of the temporal information inside the TBM fusion framework. The recognition is accomplished by combining all facial feature behaviors between the beginning and the end of an expression sequence independently to their chronological order. Then the final decision is taken on the whole sequence and consequently, the recognition becomes more robust and accurate. Experimental results on the Hammal Caplier database demonstrate the improvement on the frame-by-frame classification and the ability to recognize entire facial expression sequences.

References

  1. Bassili, J. (1978). Facial motion in the perception of faces and of emotional expression. Experimental Psychology - Human Perception and Performance, 4(3):373- 379.
  2. Ekman, P. and Friesen, W. (1978). Facial action coding system. Consulting Psychologist Press, 18(11):881- 905.
  3. Essa, I. and Pentland, A. (1997). Coding, analysis, interpretation, and recognition of facial expressions. IEEE Trans. PAMI, 19(7):757-763.
  4. Hammal, Z., Caplier, A., and Rombaut, M. (2005a). A fusion process based on belief theory for classification of facial basic emotions. ISIF. Philadelphia, USA.
  5. Hammal, Z., Couvreur, L., Caplier, A., and Rombaut, M. (2005b). Facial expressions recognition based on the belief theory: Comparison with diferent classifiers. ICIAP05, pages 743-752.
  6. Hammal, Z., Eveno, N., Caplier, A., and Coulon, P. (2006). Parametric models for facial features segmentation. Signal processing, 86(2):399-413.
  7. Pantic, M. and Rothkrantz, L. (2000). Expert system for automatic analysis of facial expressions. Image and Vision Computing Journal, 18(11):881-905.
  8. Smets, P. (1998). The Transferable Belief Model for Quantified Belief Representation, volume 1. Handbook of Dfeasible Reasoning and Uncertaintly Management System, Kluwer.
  9. Tian, Y., Kanade, T., and Cohn, G. (2001). Recognizing action units for facial expression analysis. IEEE Trans. PAMI, 23(2):97-115.
  10. Yacoob, Y. and Davis, L. (1996). Recognizing human facial expressions from long image sequences using optical flow. IEEE Trans. PAMI, 18:636-642.
  11. Zhang, Y. and Qiang, J. (2005). Active and dynamic information fusion for facial expression understanding from image sequences. IEEE Trans. PAMI, 27(5).
  12. Zhang, Z., Lyons, L., Schuster, M., and Akamatsu, S. (1998). Comparison between geometry-based and gabor wavelets-based facial expression recognition using multi-layer perceptron. AFGR, pages 454-459.
Download


Paper Citation


in Harvard Style

Hammal Z. (2006). DYNAMIC FACIAL EXPRESSION UNDERSTANDING BASED ON TEMPORAL MODELLING OF TRANSFERABLE BELIEF MODEL . In Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, ISBN 972-8865-40-6, pages 93-100. DOI: 10.5220/0001377600930100


in Bibtex Style

@conference{visapp06,
author={Zakia Hammal},
title={DYNAMIC FACIAL EXPRESSION UNDERSTANDING BASED ON TEMPORAL MODELLING OF TRANSFERABLE BELIEF MODEL},
booktitle={Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,},
year={2006},
pages={93-100},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001377600930100},
isbn={972-8865-40-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,
TI - DYNAMIC FACIAL EXPRESSION UNDERSTANDING BASED ON TEMPORAL MODELLING OF TRANSFERABLE BELIEF MODEL
SN - 972-8865-40-6
AU - Hammal Z.
PY - 2006
SP - 93
EP - 100
DO - 10.5220/0001377600930100