3D HUMAN FACE MODELLING FROM UNCALIBRATED IMAGES USING SPLINE BASED DEFORMATION

Nikos Barbalios, Nikos Nikolaidis, Ioannis Pitas

Abstract

Accurate and plausible 3D face reconstruction remains a difficult problem up to this day, despite the tremendous advances in computer technology and the continuous growth of the applications utilizing 3D face models (e.g. biometrics, movies, gaming). In this paper, a two-step technique for efficient 3D face reconstruction from a set of face images acquired using an uncalibrated camera is presented. Initially, a robust structure from motion (SfM) algorithm is applied over a set of manually selected salient image features to retrieve an estimate of their 3D coordinates. These estimates are further utilized to deform a generic 3D face model, using smoothing splines, and adapt it to the characteristics of a human face.

References

  1. P. R. S. Mendonca and R. Cipolla. A simple technique for self-calibration. In Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), volume 1, pages 500-505, 1999.
  2. R. I. Hartley. Euclidean reconstruction from uncalibrated views. In Proc. of the 2nd Joint European - US Workshop on Applications of Invariance in Computer Vision, pages 237-256. Springer-Verlag, 1994.
  3. M. Pollefeys and L. Van Gool. A stratified approach to metric self-calibration. In Proc. of the IEEE Conf. on Computer Vision and Pattern Recongition (CVPR), pages 407-418, 1997.
  4. S. Basu A. Pentland J. Strom, T. Jebara. Real time tracking and modeling of faces: An ekf-based analysis by synthesis approach. Technical Report 506, MIT Media Laboratory, 1999.
  5. Z. Zhang Y. Shan, Z. Liu. Model-based bundle adjustment with application to face modeling. In Proc. of IEEE Internation Conference on Computer Vision (ICCV), volume 2, pages 644-651, Vancouver, BC, Canada, 2001.
  6. P. Fua. Regularized bundle-adjustment to model heads from image sequences without calibration data. International Journal of Computer Vision, 38(2):153-171, 2000.
  7. S. Krishnamurthy T. Vo A.R. Chowdhury, R. Chellappa. 3d face reconstruction from video using a generic model. In Proc. of IEEE International Conference on Multimedia and Expo (ICME), volume 1, pages 449- 452, 2002.
  8. V. Atalay R. Hassanpour. Delaunay triangulation based 3d human face modeling from uncalibrated images. In Proc. of Computer Vision and Pattern Recognition Workshop (CVPR), pages 75- 75, June 2004.
  9. V. Blanz and T. Vetter. A morphable model for the synthesis of 3d faces. In Proc. of the International Conference on Computer Graphics and Interactive Techniques (SIGGRAPH), pages 187-194, New York, NY, USA, 1999.
  10. P. Fua M. Dimitrijevic, S. Ilic. Accurate face models from uncalibrated and ill-lit video sequences. In Proc of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), volume 2, pages 1034-1041, 2004.
  11. T. Sim M. Zhao, T. Seng Chua. Morphable face reconstruction with multiple images. In Proc. of the International Conference on Automatic Face and Gesture Recognition (AFGR), pages 597-602. IEEE Computer Society, 2006.
  12. R. Koch M. Pollefeys and L. Van Gool. Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters. In Proc. of the International Conference on Computer Vision (ICCV), pages 90-95, 1998.
  13. J. Ahlberg. Candide 3 - an updated parameterized face. Technical Report LiTH-ISY-R-2326, Dept. of Elegxtrial Engineering, Linkoping University, Sweden, 2001.
  14. C. Boyd J.L. Mitchell A. Vlachos, J. Peters. Curved pn triangles. In Proc. of the 2001 Symposium on Interactive 3D graphics, pages 159-166. ACM Press, 2001.
  15. F. L. Bookstein. Principal warps: Thin-plate splines and the decomposition of deformations. IEEE trans. Pattern Analysis and Machine Intelligence (PAMI), 11 (6):567-585, 1989.
Download


Paper Citation


in Harvard Style

Barbalios N., Nikolaidis N. and Pitas I. (2008). 3D HUMAN FACE MODELLING FROM UNCALIBRATED IMAGES USING SPLINE BASED DEFORMATION . In Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008) ISBN 978-989-8111-21-0, pages 455-459. DOI: 10.5220/0001081204550459


in Bibtex Style

@conference{visapp08,
author={Nikos Barbalios and Nikos Nikolaidis and Ioannis Pitas},
title={3D HUMAN FACE MODELLING FROM UNCALIBRATED IMAGES USING SPLINE BASED DEFORMATION},
booktitle={Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)},
year={2008},
pages={455-459},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001081204550459},
isbn={978-989-8111-21-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)
TI - 3D HUMAN FACE MODELLING FROM UNCALIBRATED IMAGES USING SPLINE BASED DEFORMATION
SN - 978-989-8111-21-0
AU - Barbalios N.
AU - Nikolaidis N.
AU - Pitas I.
PY - 2008
SP - 455
EP - 459
DO - 10.5220/0001081204550459