ACTIVE APPEARANCE MODEL FITTING UNDER OCCLUSION USING FAST-ROBUST PCA

Markus Storer, Peter M. Roth, Martin Urschler, Horst Bischof, Josef A. Birchbauer

Abstract

The Active Appearance Model (AAM) is a widely used method for model based vision showing excellent results. But one major drawback is that the method is not robust against occlusions. Thus, if parts of the image are occluded the method converges to local minima and the obtained results are unreliable. To overcome this problem we propose a robust AAM fitting strategy. The main idea is to apply a robust PCA model to reconstruct the missing feature information and to use the thus obtained image as input for the standard AAM fitting process. Since existing methods for robust PCA reconstruction are computationally too expensive for real-time processing we developed a more efficient method: fast robust PCA (FR-PCA). In fact, by using our FR-PCA the computational effort is drastically reduced. Moreover, more accurate reconstructions are obtained. In the experiments, we evaluated both, the fast robust PCA model on the publicly available ALOI database and the whole robust AAM fitting chain on facial images. The results clearly show the benefits of our approach in terms of accuracy and speed when processing disturbed data (i.e., images containing occlusions).

References

  1. Beichel, R., Bischof, H., Leberl, F., and Sonka, M. (2005). Robust active appearance models and their application to medical image analysis. IEEE Trans. Med. Imag., 24(9):1151- 1169.
  2. Black, M. J. and Jepson, A. D. (1996). Eigentracking: Robust matching and tracking of articulated objects using a view-based representation. In Proc. ECCV, pages 329-342.
  3. Blanz, V. and Vetter, T. (1999). A morphable model for the synthesis of 3d-faces. In Proc. SIGGRAPH.
  4. Blanz, V. and Vetter, T. (2003). Face recognition based on fitting a 3D morphable model. IEEE Trans. PAMI, 25(9):1063-1074.
  5. Caltech (1999). Caltech face database. www.vision.caltech.edu/html-files/archive.html.
  6. Cootes, T. F., Edwards, G. J., and Taylor, C. J. (2001). Active appearance models. IEEE Trans. PAMI, 23(6):681-685.
  7. Dornaika, F. and Ahlberg, J. (2002). Face model adaptation using robust matching and active appearance models.
  8. Du, C. and Su, G. (2005). Eyeglasses removal from facial images. Pattern Recognition Letters, 26(14):2215- 2220.
  9. Edwards, G. J., Cootes, T. F., and Taylor, C. J. (1999). Advances in active appearance models. In Proc. ICCV, pages 137-142.
  10. Geusebroek, J. M., Burghouts, G. J., and Smeulders, A. W. M. (2005). The Amsterdam Library of Object Images. International Journal of Computer Vision, 61(1):103-112.
  11. Gross, R., Matthews, I., and Baker, S. (2006). Active appearance models with occlusion. Image and Vision Computing, 24:593-604.
  12. Leonardis, A. and Bischof, H. (2000). Robust recognition using eigenimages. Computer Vision and Image Understanding, 78(1):99-118.
  13. Martinez, A. and Benavente, R. (1998). The AR face database. Technical Report 24, CVC.
  14. Matthews, I. and Baker, S. (2004). Active appearance models revisited. International Journal of Computer Vision, 60(2):135-164.
  15. Mitchell, S. C., Bosch, J. G., Lelieveldt, B. P. F., van der Geest, R. J., Reiber, J. H. C., and Sonka, M. (2001). 3- D active appearance models: Segmentation of cardiac MR and ultrasound images. IEEE Trans. Med. Imag., 21:1167-1178.
  16. Nguyen, M. H., Lalonde, J.-F., Efros, A. A., and de la Torre, F. (2008). Image-based shaving. Computer Graphics Forum Journal (Eurographics 2008), 27(2):627-635.
  17. Rao, R. (1997). Dynamic appearance-based recognition. In Proc. CVPR, pages 540-546.
  18. Romdhani, S. and Vetter, T. (2003). Efficient, robust and accurate fitting of a 3D morphable model. In Proc. ICCV, volume 2.
  19. Theobald, B.-J., Matthews, I., and Baker, S. (2006). Evaluating error functions for robust active appearance models. In Proc. FGR, pages 149-154.
  20. Viola, P. and Jones, M. J. (2004). Robust real-time face detection. International Journal of Computer Vision, 57(2):137-154.
  21. Yu, X., Tian, J., and Liu, J. (2007). Active appearance models fitting with occlusion. In EMMCVPR, volume 4679 of LNCS, pages 137-144.
Download


Paper Citation


in Harvard Style

Storer M., M. Roth P., Urschler M., Bischof H. and A. Birchbauer J. (2009). ACTIVE APPEARANCE MODEL FITTING UNDER OCCLUSION USING FAST-ROBUST PCA . In Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009) ISBN 978-989-8111-69-2, pages 129-136. DOI: 10.5220/0001768701290136


in Bibtex Style

@conference{visapp09,
author={Markus Storer and Peter M. Roth and Martin Urschler and Horst Bischof and Josef A. Birchbauer},
title={ACTIVE APPEARANCE MODEL FITTING UNDER OCCLUSION USING FAST-ROBUST PCA},
booktitle={Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009)},
year={2009},
pages={129-136},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001768701290136},
isbn={978-989-8111-69-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009)
TI - ACTIVE APPEARANCE MODEL FITTING UNDER OCCLUSION USING FAST-ROBUST PCA
SN - 978-989-8111-69-2
AU - Storer M.
AU - M. Roth P.
AU - Urschler M.
AU - Bischof H.
AU - A. Birchbauer J.
PY - 2009
SP - 129
EP - 136
DO - 10.5220/0001768701290136