A Multiresolution 3D Morphable Face Model and Fitting Framework

Patrik Huber, Guosheng Hu, Rafael Tena, Pouria Mortazavian, Willem P. Koppen, William J. Christmas, Matthias Rätsch, Josef Kittler

2016

Abstract

3D Morphable Face Models are a powerful tool in computer vision. They consists of a PCA model of face shape and colour information and allow to reconstruct a 3D face from a single 2D image. 3D Morphable Face Models are used for 3D head pose estimation, face analysis, face recognition, and, more recently, facial landmark detection and tracking. However, they are not as widely used as 2D methods - the process of building and using a 3D model is much more involved. In this paper, we present the Surrey Face Model, a multi-resolution 3D Morphable Model that we make available to the public for non-commercial purposes. The model contains different mesh resolution levels and landmark point annotations as well as metadata for texture remapping. Accompanying the model is a lightweight open-source C++ library designed with simplicity and ease of integration as its foremost goals. In addition to basic functionality, it contains pose estimation and face frontalisation algorithms. With the tools presented in this paper, we aim to close two gaps. First, by offering different model resolution levels and fast fitting functionality, we enable the use of a 3D Morphable Model in time-critical applications like tracking. Second, the software library makes it easy for the community to adopt the 3D Morphable Face Model in their research, and it offers a public place for collaboration.

References

  1. Aldrian, O. and Smith, W. A. P. (2013). Inverse rendering of faces with a 3D Morphable Model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(5):1080-1093.
  2. Blanz, V. and Vetter, T. (1999). A Morphable Model for the synthesis of 3D faces. In Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), pages 187-194. ACM Press/Addison-Wesley Publishing Co.
  3. Cootes, T., Edwards, G., and Taylor, C. (2001). Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(6):681 -685.
  4. Feng, Z.-H., Huber, P., Kittler, J., Christmas, W., and Wu, X.-J. (2015). Random cascaded-regression copse for robust facial landmark detection. IEEE Signal Processing Letters, 22(1):76-80.
  5. Hartley, R. I. and Zisserman, A. (2004). Multiple View Geometry in Computer Vision. Cambridge University Press, second edition.
  6. Hu, G., Chan, C.-H., Kittler, J., and Christmas, W. (2012). Resolution-aware 3D Morphable Model. In British Machine Vision Conference (BMVC), pages 1-10.
  7. Huber, P., Feng, Z., Christmas, W., Kittler, J., and Rätsch, M. (2015). Fitting 3D Morphable Models using local features. In IEEE International Conference on Image Processing (ICIP).
  8. Paysan, P., Knothe, R., Amberg, B., Romdhani, S., and Vetter, T. (2009). A 3D face model for pose and illumination invariant face recognition. In Proceedings of the 6th IEEE International Conference on Advanced Video and Signal based Surveillance (AVSS).
  9. Rätsch, M., Huber, P., Quick, P., Frank, T., and Vetter, T. (2012). Wavelet reduced support vector regression for efficient and robust head pose estimation. In IEEE Ninth Conference on Computer and Robot Vision (CRV), pages 260-267.
  10. Rodríguez, J. R. T. (2007). 3D Face Modelling for 2D+3D Face Recognition. PhD thesis, University of Surrey.
  11. Romdhani, S. and Vetter, T. (2005). Estimating 3D shape and texture using pixel intensity, edges, specular highlights, texture constraints and a prior. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), volume 2, pages 986-993. IEEE.
  12. Sarkar, S. (2005). USF HumanID 3D face dataset.
  13. Tena, J. R., Hamouz, M., Hilton, A., and Illingworth, J. (2006). A validated method for dense non-rigid 3D face registration. In Advanced Video and Signal Based Surveillance, 2006 IEEE International Conference on Video and Signal Based Surveillance (AVSS'06), 22- 24 November 2006, Sydney, Australia., page 81. IEEE Computer Society.
  14. Tenenbaum, J. B., de Silva, V., and Langford, J. C. (2000). A global geometric framework for nonlinear dimensionality reduction. Science, 290:2319-2323.
  15. van Rootseler, R. T. A., Spreeuwers, L. J., and Veldhuis, R. N. J. (2012). Using 3D Morphable Models for face recognition in video. In Proceedings of the 33rd WIC Symposium on Information Theory in the Benelux.
  16. Velho, L. and Zorin, D. (2001). 4-8 subdivision. Computer Aided Geometric Design, 18(5):397-427.
  17. Zhu, X., Yan, J., Yi, D., Lei, Z., and Li, S. Z. (2015). Discriminative 3D Morphable Model fitting. In International Conference on Automatic Face and Gesture Recognition, FG 2015, 4-8 May, 2015, Ljubljana, Slovenia. IEEE.
  18. Zivanov, J., Forster, A., Sch önborn, S., and Vetter, T. (2013). Human face shape analysis under spherical harmonics illumination considering self occlusion. In International Conference on Biometrics, ICB 2013, 4- 7 June, 2013, Madrid, Spain, pages 1-8. IEEE.
Download


Paper Citation


in Harvard Style

Huber P., Hu G., Tena R., Mortazavian P., Koppen W., Christmas W., Rätsch M. and Kittler J. (2016). A Multiresolution 3D Morphable Face Model and Fitting Framework . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 79-86. DOI: 10.5220/0005669500790086


in Bibtex Style

@conference{visapp16,
author={Patrik Huber and Guosheng Hu and Rafael Tena and Pouria Mortazavian and Willem P. Koppen and William J. Christmas and Matthias Rätsch and Josef Kittler},
title={A Multiresolution 3D Morphable Face Model and Fitting Framework},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={79-86},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005669500790086},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)
TI - A Multiresolution 3D Morphable Face Model and Fitting Framework
SN - 978-989-758-175-5
AU - Huber P.
AU - Hu G.
AU - Tena R.
AU - Mortazavian P.
AU - Koppen W.
AU - Christmas W.
AU - Rätsch M.
AU - Kittler J.
PY - 2016
SP - 79
EP - 86
DO - 10.5220/0005669500790086