Active Shape Models with SIFT Descriptors and MARS

Stephen Milborrow, Fred Nicolls

2014

Abstract

We present a technique for locating landmarks in images of human faces. We replace the 1D gradient profiles of the classical Active Shape Model (ASM) (Cootes and Taylor, 1993) with a simplified form of SIFT descriptors (Lowe, 2004), and use Multivariate Adaptive Regression Splines (MARS) (Friedman, 1991) for descriptor matching. This modified ASM is fast and performs well against existing techniques for automatic face landmarking on frontal faces.

References

  1. Bay, H., Tuytelaars, T., and Gool, L. V. (2006). SURF: Speeded Up Robust Features. ECCV.
  2. Belhumeur, P. N., Jacobs, D. W., Kriegman, D. J., and Kumar, N. (2011). Localizing Parts of Faces Using a Consensus of Exemplars. CVPR.
  3. Belongie, S., Malik, J., and Puzicha., J. (2002). Shape Matching and Object Recognition Using Shape Contexts. PAMI.
  4. Breiman, L. (2001). Random Forests. Machine Learning.
  5. Breiman, L., Friedman, J. H., Olshen, R. A., and Stone, C. J. (1984). Classification and Regression Trees. Wadsworth.
  6. Castrillón Santana, M., Déniz Suárez, O., Hernández Tejera, M., and Guerra Artal, C. (2007). ENCARA2: Real-time Detection of Multiple Faces at Different Resolutions in Video Streams. Journal of Visual Communication and Image Representation.
  7. C¸eliktutan, O., Ulukaya, S., and Sankur, B. (2013). A Comparative Study of Face Landmarking Techniques. EURASIP Journal on Image and Video Processing. http://jivp.eurasipjournals.com/content/2013/1/13/ abstract. This study used Stasm Version 3.1.
  8. Cootes, T., Ionita, M., Lindner, C., and Sauer, P. (2012). Robust and Accurate Shape Model Fitting using Random Forest Regression Voting. ECCV.
  9. Cootes, T. F. and Taylor, C. J. (1993). Active Shape Model Search using Local Grey-Level Models: A Quantitative Evaluation. BMVC.
  10. Cootes, T. F. and Taylor, C. J. (2004). Technical Report: Statistical Models of Appearance for Computer Vision. The University of Manchester School of Medicine. http://www.isbe.man.ac.uk/ bim/Models/ app models.pdf.
  11. Cootes, T. F., Taylor, C. J., Cooper, D. H., and Graham, J. (1995). Active Shape Models - their Training and Application. CVIU.
  12. Cristinacce, D. and Cootes, T. (2006). Feature Detection and Tracking with Constrained Local Models. BMVC. mimban.smb.man.ac.uk/publications/ index.php.
  13. Dalal, N. and Triggs, B. (2005). Histograms of oriented gradients for human detection. CVPR.
  14. Freeman, W. T. and Roth, M. (1995). Orientation Histograms for Hand Gesture Recognition. AFGR.
  15. Friedman, J. H. (1991). Multivariate Adaptive Regression Splines (with discussion). Annals of Statistics. http://www.salfordsystems.com/doc/MARS.pdf.
  16. Hastie, T., Tibshirani, R., and Friedman, J. (2009). The Elements of Statistical Learning: Data Mining, Inference, and Prediction (Second Edition). Springer.
  17. Jesorsky, O., Kirchberg, K., and Frischholz, R. (2001). Robust Face Detection using the Hausdorff Distance. AVBPA.
  18. Kanaujia, A. and Metaxas, D. N. (2007). Large Scale Learning of Active Shape Models. ICIP.
  19. Kasinski, A., Florek, A., and Schmidt, A. (2008). The PUT Face Database. IPC.
  20. Le, V., Brandt, J., Lin, Z., Boudev, L., and Huang, T. S. (2012). Interactive Facial Feature Localization. ECCV. http://www.ifp.illinois.edu/ vuongle2/helen.
  21. Leathwick, J., Rowe, D., Richardson, J., Elith, J., and Hastie, T. (2005). Using Multivariate Adaptive Regression Splines to Predict the Distributions of New Zealand's Freshwater Diadromous Fish. Freshwater Biology, 50, 2034-2052. http://www.botany. unimelb.edu.au/envisci/about/staff/elith.html.
  22. Li, Z., Imai, J.-i., and Kaneko, M. (2009). Facial Feature Localization using Statistical Models and SIFT Descriptors. Robot and Human Interactive Communication.
  23. Lienhart, R. and Maydt, J. (2002). An Extended Set of HaarLike Features for Rapid Object Detection. IEEE ICP.
  24. Lowe, D. G. (2004). Distinctive Image Features from ScaleInvariant Keypoints. IJCV.
  25. Messer, K., Matas, J., Kittler, J., Luettin, J., and Maitre, G. (1999). XM2VTS: The Extended M2VTS Database. AVBPA.
  26. Mikolajczyk, K. and Schmid, C. (2005). A Performance Evaluation of Local Descriptors. PAMI.
  27. Milborrow, S., Bishop, T. E., and Nicolls, F. (2013). Multiview Active Shape Models with SIFT Descriptors for the 300-W Face Landmark Challenge. ICCV.
  28. Milborrow, S., Morkel, J., and Nicolls, F. (2010). The MUCT Landmarked Face Database. Pattern Recognition Association of South Africa. http://www.milbo.org/muct.
  29. Milborrow, S. and Nicolls, F. (2008). Locating Facial Features with an Extended Active Shape Model. ECCV.
  30. Querini, M. and Italiano, G. F. (2012). Facial Biometrics for 2D Barcodes. Computer Science and Information Systems.
  31. Rattani, A., Kisku, D. R., Lagorio, A., and Tistarelli, M. (2007). Facial Template Synthesis based on SIFT Features. Automatic Identification Advanced Technologies.
  32. Saragih, J., Lucey, S., and Cohn, J. (2010). Deformable Model Fitting by Regularized Landmark Mean-Shifts. IHCV.
  33. Shi, Y. and Shen, D. (2008). Hierarchical Shape Statistical Model for Segmentation of Lung Fields in Chest Radiographs. MICCAI.
  34. Vogel, C., de Sousa Abreu, R., Ko, D., Le, S., Shapiro, B. A., Burns, S. C., Sandhu, D., Boutz, D. R., Marcotte, E. M., and Penalva, L. O. (2010). Sequence signatures and mRNA concentration can explain twothirds of protein abundance variation in a human cell line. Molecular Systems Biology.
  35. Zhang, J. and Chen, S. Y. (2008). Combination of Local Invariants with an Active Shape Model. BMEI.
  36. Zhang, L., Tjondronegoro, D., and Chandran, V. (2011). Geometry vs. Appearance for Discriminating between Posed and Spontaneous Emotions. NIP.
  37. Zhou, D., Petrovska-Delacrétaz, D., and Dorizzi, B. (2009). Automatic Landmark Location with a Combined Active Shape Model. BTAS.
Download


Paper Citation


in Harvard Style

Milborrow S. and Nicolls F. (2014). Active Shape Models with SIFT Descriptors and MARS . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-004-8, pages 380-387. DOI: 10.5220/0004680003800387


in Bibtex Style

@conference{visapp14,
author={Stephen Milborrow and Fred Nicolls},
title={Active Shape Models with SIFT Descriptors and MARS},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={380-387},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004680003800387},
isbn={978-989-758-004-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2014)
TI - Active Shape Models with SIFT Descriptors and MARS
SN - 978-989-758-004-8
AU - Milborrow S.
AU - Nicolls F.
PY - 2014
SP - 380
EP - 387
DO - 10.5220/0004680003800387