TRACKING OF FACIAL FEATURE POINTS BY COMBINING SINGULAR TRACKING RESULTS WITH A 3D ACTIVE SHAPE MODEL

Moritz Kaiser, Dejan Arsić, Shamik Sural, Gerhard Rigoll

Abstract

Accurate 3D tracking of facial feature points from one monocular video sequence is appealing for many applications in human-machine interaction. In this work facial feature points are tracked with a Kanade-Lucas-Tomasi (KLT) feature tracker and the tracking results are linked with a 3D Active Shape Model (ASM). Thus, the efficient Gauss-Newton method is not solving for the shift of each facial feature point separately but for the 3D position, rotation and the 3D ASM parameters which are the same for all feature points. Thereby, not only the facial feature points are tracked more robustly but also the 3D position and the 3D ASM parameters can be extracted. The Jacobian matrix for the Gauss-Newton optimization is split via chain rule and the computations per frame are further reduced. The algorithm is evaluated on the basis of three handlabeled video sequences and it outperforms the KLT feature tracker. The results are also comparable to two other tracking algorithms presented recently, whereas the method proposed in this work is computationally less intensive.

References

  1. Bertsekas, D. P. (1999). Nonlinear Programming. Athena Scientific, 2nd edition.
  2. Brox, T., Bruhn, A., Papenberg, N., and Weickert, J. (2004). High accuracy optical flow estimation based on a theory for warping. In ECCV (4), pages 25-36.
  3. Cootes, T. F., Edwards, G. J., and Taylor, C. J. (1998). Active appearance models. In ECCV (2), pages 484-498.
  4. Cootes, T. F., Taylor, C. J., Cooper, D. H., and Graham, J. (1995). Active shape models - their training and application. CVIU, 61(1):38-59.
  5. Cristinacce, D. and Cootes, T. F. (2006a). Facial feature detection and tracking with automatic template selection. In FG, pages 429-434.
  6. Cristinacce, D. and Cootes, T. F. (2006b). Feature detection and tracking with constrained local models. In BMVC, pages 929-938.
  7. Faggian, N., Paplinski, A. P., and Sherrah, J. (2008). 3d morphable model fitting from multiple views. In FG, pages 1-6.
  8. Fang, H., Costen, N., Cristinacce, D., and Darby, J. (2008). 3d facial geometry recovery via group-wise optical flow. In FG, pages 1-6.
  9. Gong, B., Wang, Y., Liu, J., and Tang, X. (2009). Automatic facial expression recognition on a single 3d face by exploring shape deformation. In ACM Multimedia, pages 569-572.
  10. Heimann, T., Wolf, I., Williams, T. G., and Meinzer, H.-P. (2005). 3d active shape models using gradient descent optimization of description length. In IPMI, pages 566-577.
  11. Savran, A., Alyü z, N., Dibeklioglu, H., C¸ eliktutan, O., G ökberk, B., Sankur, B., and Akarun, L. (2008). Bosphorus database for 3d face analysis. In BIOID, pages 47-56.
  12. Sung, J., Kanade, T., and Kim, D. (2008). Pose robust face tracking by combining active appearance models and cylinder head models. International Journal of Computer Vision, 80(2):260-274.
  13. Tomasi, C. and Kanade, T. (1991). Detection and Tracking of Point Features. Technical report, Carnegie Mellon University.
  14. Tong, Y., Wang, Y., Zhu, Z., and Ji, Q. (2007). Robust facial feature tracking under varying face pose and facial expression. Pattern Recognition, 40(11):3195-3208.
Download


Paper Citation


in Harvard Style

Kaiser M., Arsić D., Sural S. and Rigoll G. (2010). TRACKING OF FACIAL FEATURE POINTS BY COMBINING SINGULAR TRACKING RESULTS WITH A 3D ACTIVE SHAPE MODEL . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2010) ISBN 978-989-674-028-3, pages 281-286. DOI: 10.5220/0002819302810286


in Bibtex Style

@conference{visapp10,
author={Moritz Kaiser and Dejan Arsić and Shamik Sural and Gerhard Rigoll},
title={TRACKING OF FACIAL FEATURE POINTS BY COMBINING SINGULAR TRACKING RESULTS WITH A 3D ACTIVE SHAPE MODEL},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2010)},
year={2010},
pages={281-286},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002819302810286},
isbn={978-989-674-028-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2010)
TI - TRACKING OF FACIAL FEATURE POINTS BY COMBINING SINGULAR TRACKING RESULTS WITH A 3D ACTIVE SHAPE MODEL
SN - 978-989-674-028-3
AU - Kaiser M.
AU - Arsić D.
AU - Sural S.
AU - Rigoll G.
PY - 2010
SP - 281
EP - 286
DO - 10.5220/0002819302810286