Facial Landmarks Localization Estimation by Cascaded Boosted Regression

Louis Chevallier, Jean-Ronan Vigouroux, Alix Goguey, Alexey Ozerov

Abstract

Accurate detection of facial landmarks is very important for many applications like face recognition or analysis. In this paper we describe an efficient detector of facial landmarks based on a cascade of boosted regressors of arbitrary number of levels. We define as many regressors as landmarks and we train them separately. We describe how the training is conducted for the series of regressors by supplying training samples centered on the predictions of the previous levels. We employ gradient boosted regression and evaluate three different kinds of weak elementary regressors, each one based on Haar features: non parametric regressors, simple linear regressors and gradient boosted trees. We discuss trade-offs between the number of levels and the number of weak regressors for optimal detection speed. Experiments performed on three datasets suggest that our approach is competitive compared to state-of-the art systems regarding precision, speed as well as stability of the prediction on video streams.

References

  1. Belhumeur, P. N., Jacobs, D. W., Kriegman, D. J., and Kumar, N. (2011). Localizing parts of faces using a consensus of exemplars. In The 24th IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
  2. Cao, X., Wei, Y., Wen, F., and Sun, J. (2012). Face alignement by explicit shape regression - to appear. In Proc. of CVPR'12.
  3. Cootes, T. F., Edwards, G. J., and Taylor, C. J. (2001). Active appearance models. IEEE Transactions Pattern Analysis and Machine Intelligence, 23(6):681-685.
  4. Cootes, T. F., Taylor, C. J., Cooper, D. H., and Graham, J. (1995). Active shape models - their training and application. Computer Vision and Image Understanding, 61(1):38-59.
  5. Cristinacce, D. and Cootes, T. (2008). Automatic feature localisation with constrained local models. Pattern Recognition, 41(10):3054-3067.
  6. Dantone, M., Gall, J., Fanelli, G., and Van Gool, L. (2012). Real-time facial feature detection using conditional regression forests. In Computer Vision and Pattern Recognition (CVPR).
  7. Dollár, P., Welinder, P., and Perona, P. (2010). Cascaded pose regression. In Computer Vision and Pattern Recognition (CVPR), pages 1078-1085.
  8. Everingham, M., Sivic, J., and Zisserman, A. (2006). Hello! my name is. . . Buffy - Automatic naming of characters in TV video. In Proceedings of the British Machine Vision Conference, volume 2.
  9. Friedman, J. H. (2001). Greedy function approximation: A gradient boosting machine. Annals of Statistics, 29(5):1189-1232.
  10. Jesorsky, O., Kirchberg, K. J., and Frischholz, R. (2001). Robust Face Detection using the Hausdorff distance. In AVBPA, pages 90-95.
  11. KasiÁski, A., Florek, A., and Schmidt, A. (2008). The PUT face database. Image Processing and Communications, 13(3):59-64.
  12. Kass, M., Witkin, A., and Terzopoulos, D. (1988). Snakes: Active Contour Models. International Journal of Computer Vision, 1(4):321-331.
  13. Lanitis, A., Taylor, C. J., and Cootes, T. F. (1997). Automatic interpretation and coding of face images using flexible models. IEEE Transactions Pattern Analysis and Machine Intelligence, 19(7):743-756.
  14. Milborrow, S., Morkel, J., and Nicolls, F. (2010). The MUCT Landmarked Face Database. Pattern Recognition Association of South Africa.
  15. Ur?ic?ár?, M., Franc, V., and Hlavác?, V. (2012). Detector of facial landmarks learned by the structured output svm. In Proceedings of the 7th International Conference on Computer Vision Theory and Applications. VISAPP 7812.
  16. Valstar, M., Martinez, B., Binefa, X., and Pantic, M. (2010). Facial point detection using boosted regression and graph models. In Proceedings of IEEE Int'l Conf. Computer Vision and Pattern Recognition (CVPR'10), pages 2729-2736, San Francisco, USA.
  17. Viola, P. A. and Jones, M. J. (2001). Rapid object detection using a boosted cascade of simple features. In Computer Vision and Pattern Recognition (CVPR), pages 511-518.
  18. Vukadinovic, D. and Pantic, M. (2005). Fully automatic facial feature point detection using gabor feature based boosted classifiers. In Proceedings of IEEE Int'l Conf. Systems, Man and Cybernetics (SMC'05), pages 1692-1698, Waikoloa, Hawaii.
Download


Paper Citation


in Harvard Style

Chevallier L., Vigouroux J., Goguey A. and Ozerov A. (2013). Facial Landmarks Localization Estimation by Cascaded Boosted Regression . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013) ISBN 978-989-8565-47-1, pages 513-519. DOI: 10.5220/0004192705130519


in Bibtex Style

@conference{visapp13,
author={Louis Chevallier and Jean-Ronan Vigouroux and Alix Goguey and Alexey Ozerov},
title={Facial Landmarks Localization Estimation by Cascaded Boosted Regression},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013)},
year={2013},
pages={513-519},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004192705130519},
isbn={978-989-8565-47-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013)
TI - Facial Landmarks Localization Estimation by Cascaded Boosted Regression
SN - 978-989-8565-47-1
AU - Chevallier L.
AU - Vigouroux J.
AU - Goguey A.
AU - Ozerov A.
PY - 2013
SP - 513
EP - 519
DO - 10.5220/0004192705130519