IMPROVING APPEARANCE-BASED 3D FACE TRACKING USING SPARSE STEREO DATA

Fadi Dornaika, Angel D. Sappa

Abstract

Recently, researchers proposed deterministic and statistical appearance-based 3D head tracking methods which can successfully tackle the image variability and drift problems. However, appearance-based methods dedicated to 3D head tracking may suffer from inaccuracies since these methods are not very sensitive to out-of-plane motion variations. On the other hand, the use of dense 3D facial data provided by a stereo rig or a range sensor can provide very accurate 3D head motions/poses. However, this paradigm requires either an accurate facial feature extraction or a computationally expensive registration technique (e.g., the Iterative Closest Point algorithm). In this paper, we improve our appearance-based 3D face tracker by combining an adaptive appearance model with a robust 3D-to-3D registration technique that uses sparse stereo data. The resulting 3D face tracker combines the advantages of both appearance-based trackers and 3D data-based trackers while keeping the CPU time very close to that required by real-time trackers. We provide experiments and performance evaluation which show the feasibility and usefulness of the proposed approach.

References

  1. Ahlberg, J. (2002). An active model for facial feature tracking. EURASIP Journal on Applied Signal Processing, 2002(6):566-571.
  2. Besl, P. and McKay, N. (1992). A method for registration of 3-D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):239-256.
  3. Cascia, M., Sclaroff, S., and Athitsos, V. (2000). Fast, reliable head tracking under varying illumination: An approach based on registration of texture-mapped 3D models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(4):322-336.
  4. Chetverikov, D., Stepanov, D., and Kresk, P. (2005). Robust Euclidean alignment of 3D point sets: the trimmed iterative closet point algorithm. Image and Vision Computing, 23:299-309.
  5. Cootes, T., Edwards, G., and Taylor, C. (2001). Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(6):681-684.
  6. Dornaika, F. and Davoine, F. (2004). Head and facial animation tracking using appearance-adaptive models and particle filters. In IEEE Workshop on Real-Time Vision for Human-Computer Interaction, Washington DC.
  7. Dornaika, F. and Sappa, A. (2005). Appearance-based tracker: An evaluation study. In IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.
  8. Fischler, M. and Bolles, R. (1981). Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communication ACM, 24(6):381-395.
  9. Fitzgibbon, A. (2003). Robust registration of 2D and 3D point sets. Image and Vision Computing, 21:1145- 1153.
  10. Horn, B. (1987). Closed-form solution of absolute orientation using unit quaternions. J. Opt. Soc. Amer. A., 4(4):629-642.
  11. Jepson, A., Fleet, D., and El-Maraghi, T. (2003). Robust online appearance models for visual tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 25(10):1296-1311.
  12. Lee, D. (2005). Effective Gaussian mixture learning for video background subtraction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(5):827-832.
  13. Malassiotis, S. and Strintzis, M. G. (2005). Robust realtime 3D head pose estimation from range data. Pattern Recognition, 38(8):1153-1165.
  14. Matthews, I. and Baker, S. (2004). Active appearance models revisited. International Journal of Computer Vision, 60(2):135-164.
  15. Moreno, F., Tarrida, A., Andrade-Cetto, J., and Sanfeliu, A. (2002). 3D real-time tracking fusing color histograms and stereovision. In IEEE International Conference on Pattern Recognition.
  16. Rousseeuw, P. and Leroy, A. (1987). Robust Regression and Outlier Detection. John Wiley & Sons, New York.
  17. Zhou, S., Chellappa, R., and Mogghaddam, B. (2004). Visual tracking and recognition using appearanceadaptive models in particle filters. IEEE Transactions on Image Processing, 13(11):1473-1490.
Download


Paper Citation


in Harvard Style

Dornaika F. and D. Sappa A. (2006). IMPROVING APPEARANCE-BASED 3D FACE TRACKING USING SPARSE STEREO DATA . In Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, ISBN 972-8865-40-6, pages 310-317. DOI: 10.5220/0001364003100317


in Bibtex Style

@conference{visapp06,
author={Fadi Dornaika and Angel D. Sappa},
title={IMPROVING APPEARANCE-BASED 3D FACE TRACKING USING SPARSE STEREO DATA},
booktitle={Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,},
year={2006},
pages={310-317},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001364003100317},
isbn={972-8865-40-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,
TI - IMPROVING APPEARANCE-BASED 3D FACE TRACKING USING SPARSE STEREO DATA
SN - 972-8865-40-6
AU - Dornaika F.
AU - D. Sappa A.
PY - 2006
SP - 310
EP - 317
DO - 10.5220/0001364003100317