FACIAL ACTION UNIT RECOGNITION AND INFERENCE FOR FACIAL EXPRESSION ANALYSIS

Yu Li Xue, Xia Mao, Qing Chang

Abstract

Human facial expression is extremely abundant, and can be described by numerous facial action units. Recognizing facial action units helps catching the inner emotion or intention of human. In this paper, we propose a novel method for facial action unit recognition and inference. We used Gabor wavelet and optical flow for feature extraction, and used support vector machine and dynamic bayesian network for classification and inference respectively. We combined the advantages of both global and local feature extraction, recognized the most discriminant AUs with multiple classifiers to achieve high recognition rate, and then inference the related AUs. Experiments were conducted on the Cohn-Kanade AU-Coded database. The results demonstrated that compared to early researches for facial action units recognition, our method is capable of recognizing more action units and achieved good performance.

References

  1. Kanade, T., Cohn, J., and Tian, Y. L. (2000). Comprehensive database for facial expression analysis. In Proc. of 4th IEEE Int. Conf. on Automatic Face and Gesture Recognition, pages 46-53, Washington, DC, USA. IEEE Computer Society.
  2. Kapoor, A., Qi, Y., and Picard, R. W. (2003). Fully automatic upper facial action recognition. In Proc. of IEEE Int. Workshop on Analysis and Modeling of Faces and Gestures, pages 195-202.
  3. Korb, K. B. and Nicholson, A. E. (2004). Bayesian Artificial Intelligence. A CRC Press Company.
  4. Pantic, M. and Rothkrantz, L. J. M. (2000). Expert system for automatic analysis of facial expressions. Image and Vision Computing, 18(11):881-905.
  5. Tian, Y. L., Kanade, T., and Cohn, J. F. (2001). Recognizing action units for facial expression analysis. IEEE Trans. on PAMI, 23(2):97-115.
  6. Tong, Y., Chen, J. X., and Ji, Q. (2010). A unified probabilistic framework for spontaneous facial action modeling and understanding. IEEE Trans. on PAMI, 32(2):258-273.
  7. Tong, Y., Liao, W. H., and Ji, Q. (2007). Facial action unit recognition by exploiting their dynamic and semantic relationships. IEEE Trans. on PAMI, 29(10):1-17.
  8. Viola, P. and Jones, M. (2001). Rapid object detection using a boosted cascade of simple features. In Proc. of IEEE Conf. on CVPR, pages 511-518, Washington, DC, USA. IEEE Computer Society.
Download


Paper Citation


in Harvard Style

Li Xue Y., Mao X. and Chang Q. (2012). FACIAL ACTION UNIT RECOGNITION AND INFERENCE FOR FACIAL EXPRESSION ANALYSIS . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2012) ISBN 978-989-8565-03-7, pages 694-697. DOI: 10.5220/0003834006940697


in Bibtex Style

@conference{visapp12,
author={Yu Li Xue and Xia Mao and Qing Chang},
title={FACIAL ACTION UNIT RECOGNITION AND INFERENCE FOR FACIAL EXPRESSION ANALYSIS},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2012)},
year={2012},
pages={694-697},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003834006940697},
isbn={978-989-8565-03-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2012)
TI - FACIAL ACTION UNIT RECOGNITION AND INFERENCE FOR FACIAL EXPRESSION ANALYSIS
SN - 978-989-8565-03-7
AU - Li Xue Y.
AU - Mao X.
AU - Chang Q.
PY - 2012
SP - 694
EP - 697
DO - 10.5220/0003834006940697