FACE MODEL FITTING WITH GENERIC, GROUP-SPECIFIC, AND PERSON-SPECIFIC OBJECTIVE FUNCTIONS

Sylvia Pietzsch, Matthias Wimmer, Freek Stulp, Bernd Radig

2008

Abstract

In model-based fitting, the model parameters that best fit the image are determined by searching for the optimum of an objective function. Often, this function is designed manually, based on implicit and domain-dependent knowledge. We acquire more robust objective function by learning them from annotated images, in which many critical decisions are automated, and the remaining manual steps do not require domain knowledge. Still, the trade-off between generality and accuracy remains. General functions can be applied to a large range of objects, whereas specific functions describe a subset of objects more accurately. (Gross et al., 2005) have demonstrated this principle by comparing generic to person-specific Active Appearance Models. As it is impossible to learn a person-specific objective function for the entire human population, we automatically partition the training images and then learn partition-specific functions. The number of groups influences the specificity of the learned functions. We automatically determine the optimal partitioning given the number of groups, by minimizing the expected fitting error. Our empirical evaluation demonstrates that the group-specific objective functions more accurately describe the images of the corresponding group. The results of this paper are especially relevant to face model tracking, as individual faces will not change throughout an image sequence.

References

  1. Chibelushi, C. C. and Bourel, F. (2003). Facial expression recognition: A brief tutorial overview.
  2. Cohen, I., Sebe, N., Chen, L., Garg, A., and Huang, T. (2003). Facial expression recognition from video sequences: Temporal and static modeling. CVIU special issue on face recognition, 91(1-2):160-187.
  3. Cootes, T. F. and Taylor, C. J. (1992). Active shape models - smart snakes. In BMVC, pp 266 - 275.
  4. Cootes, T. F. and Taylor, C. J. (2004). Statistical models of appearance for computer vision. Technical report, U of Manchester, Imaging Science and Biomedical Engineering, Manchester M13 9PT, UK.
  5. Cristinacce, D. and Cootes, T. F. (2006). Facial feature detection and tracking with automatic template selection. In FGR, pp 429-434.
  6. Ginneken, B., Frangi, A., Staal, J., Haar, B., and Viergever, R. (2002). Active shape model segmentation with optimal features. IEEE Transactions on Medical Imaging, 21(8):924-933.
  7. Gross, R., Baker, S., Matthews, I., and Kanade, T. (2004). Face recognition across pose and illumination. In Li, S. Z. and Jain, A. K., editors, Handbook of Face Recognition. Springer-Verlag.
  8. Gross, R., Matthews, I., and Baker, S. (2005). Generic vs. person specific active appearance models. Image and Vision Computing, 23(11):1080-1093.
  9. Hanek, R. (2004). Fitting Parametric Curve Models to Images Using Local Self-adapting Seperation Criteria. PhD thesis, Dept of Informatics, TU Mü nchen.
  10. Jones, M. J. and Viola, P. (2003). Fast multi-view face detection. Technical Report TR2003-96, Mitsubishi Electric Research Lab.
  11. Nefian, A. and Hayes, M. (1999). Face recognition using an embedded HMM. In Proc. of the IEEE Conference on Audio and Video-based Biometric Person Authentication, pp 19-24.
  12. Pantic, M. and Rothkrantz, L. J. M. (2000). Automatic analysis of facial expressions: The state of the art. IEEE TPAMI, 22(12):1424-1445.
  13. Quinlan, R. (1993). C4.5: Programs for Machine Learning. Morgan Kaufmann, San Mateo, California.
  14. Romdhani, S. (2005). Face Image Analysis using a Multiple Feature Fitting Strategy. PhD thesis, U of Basel, Computer Science Department, Basel, CH.
  15. Tian, Y.-L., Kanade, T., and Cohn, J. F. (2001). Recognizing action units for facial expression analysis. IEEE TPAMI, 23(2):97-115.
  16. Viola, P. and Jones, M. (2001). Rapid object detection using a boosted cascade of simple features. In CVPR, vol 1, pp 511-518, Kauai, Hawaii.
  17. Wimmer, M., Stulp, F., Pietzsch, S., and Radig, B. (2007). Learning local objective functions for robust face model fitting. In IEEE PAMI. to appear.
  18. Witten, I. H. and Frank, E. (2005). Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann, San Francisco, 2nd edition.
Download


Paper Citation


in Harvard Style

Pietzsch S., Wimmer M., Stulp F. and Radig B. (2008). FACE MODEL FITTING WITH GENERIC, GROUP-SPECIFIC, AND PERSON-SPECIFIC OBJECTIVE FUNCTIONS . In Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008) ISBN 978-989-8111-21-0, pages 5-12. DOI: 10.5220/0001087500050012


in Bibtex Style

@conference{visapp08,
author={Sylvia Pietzsch and Matthias Wimmer and Freek Stulp and Bernd Radig},
title={FACE MODEL FITTING WITH GENERIC, GROUP-SPECIFIC, AND PERSON-SPECIFIC OBJECTIVE FUNCTIONS},
booktitle={Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)},
year={2008},
pages={5-12},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001087500050012},
isbn={978-989-8111-21-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)
TI - FACE MODEL FITTING WITH GENERIC, GROUP-SPECIFIC, AND PERSON-SPECIFIC OBJECTIVE FUNCTIONS
SN - 978-989-8111-21-0
AU - Pietzsch S.
AU - Wimmer M.
AU - Stulp F.
AU - Radig B.
PY - 2008
SP - 5
EP - 12
DO - 10.5220/0001087500050012