3D ARTICULATED HAND TRACKING BY NONPARAMETRIC BELIEF PROPAGATION ON FEASIBLE CONFIGURATION SPACE

Tangli Liu, Wei Liang, Yunde Jia

2008

Abstract

An efficient articulated hand tracking method underlying the 3D graphical model from monocular image sequences is proposed in this paper. Due to the inaccurate dependences among the components of human hand leading to distorted estimates in previous work, we design a pertinence graphical model combined with domain–specific heuristics among the components of human hand describing the hand’s 3D structure, kinematics, and dynamics. The proposed model decomposes multivariate, joint distributions into a set of local interactions among small subsets. The modular structure provides an intuitive language for expressing domain–specific knowledge about the variable relationships, and facilitates tracking each hand component independently. And then, we provide a novel belief propagation algorithm to inference in hand graphical model. The algorithm can accommodate an extremely broad class of potential functions besides the potentials appropriate for our model. The experimental results show the robustness and efficiency of tracking each hand component.

References

  1. Wu, Y., Lin, J., Huang, T. S., December 2005. Analyzing and Capturing Articulated Hand Motion in Image Sequences. In Vol. 27, No. 12, IEEE Transactions on Pattern Analysis and Machine Intelligence.
  2. Stenger, B., Wu, Y., Mendonca, P. R. S., 2001. Modelbased 3D tracking of an articulated hand. In pp. 310- 315, Vol. 2. Proc. IEEE Conf. Computer Vision and Pattern Recognition.
  3. Wu, Y., Lin, J. Y., Huang, T. S., 2001. Capturing natural hand articulation. In pp. 426-432, Vol. 2. Proc. IEEE Int. Conf. Computer Vision.
  4. Isard, M., Blake, A, 1998. CONDENSATION - conditional density propagation for visual tracking. In pp. 5-28, Vol. 29. International Journal of Computer Vision.
  5. Sudderth, E. B., Mandel, M. I., Freeman, W. T., Willsky, A. S., May 2004. Visual Hand Tracking Using Nonparametric Belief Propagation. In MIT Laboratory For Information & Decision Systems Technical Report.
  6. Lin, J. Y., Wu, Y., Huang, T. S., December 2002. Capturing Human Hand Motion in Image Sequences. In pp. 99-104. Proc. IEEE Workshop Motion and Video Computing.
  7. Chao, E., An, K., Cooney, W., Linscheid, R., 1989. Biomechanics of the Hand: A Basic Research Study. In Mayo Foundation, Minn.: World Scientific.
  8. Tony, X. H., Ning, H. Z., Huang, T. S., 2006. Efficient Nonparametric Belief Propagation with Application to Articulated Body Tracking. In pp. 214-221, Vol. 1, Proc IEEE Conf. Computer Vision and Pattern Recognition.
  9. Isard, M., 2003. PAMPAS: Real-Valued Graphical Models for Computer Vision. In pp. 18-20, Vol. 1, Proc IEEE Conf. Computer Vision and Pattern Recognition.
  10. Sigal, S., Bhatia, S., Roth, S., Black, M. J., Isard, M., 2004. Tracking Loose-limbed People. In pp. 421-428, Vol. 1, Proc IEEE Conf. Computer Vision and Pattern Recognition.
  11. Frey, B. J., Bhatia, S., MacKay, D. J. C., 1998. A revolution: Belief propagation in graphs with cycles. In pp. 479-485, Vol. 1, Neural Information Processing Systems 10, MIT Press.
  12. Wu, Y., Huang, T. S., May 2001. Hand modeling, analysis, and recognition. In pp. 51-60, IEEE Signal Proc. Mag..
  13. Stenger, B. J., Mendonca, P. R. S., Cipolla, R., 2001. Model-based 3D tracking of an articulated hand. In pp. 310-315, Vol. 2, Proc IEEE Conf. Computer Vision and Pattern Recognition.
Download


Paper Citation


in Harvard Style

Liu T., Liang W. and Jia Y. (2008). 3D ARTICULATED HAND TRACKING BY NONPARAMETRIC BELIEF PROPAGATION ON FEASIBLE CONFIGURATION SPACE . In Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008) ISBN 978-989-8111-21-0, pages 508-513. DOI: 10.5220/0001075405080513


in Bibtex Style

@conference{visapp08,
author={Tangli Liu and Wei Liang and Yunde Jia},
title={3D ARTICULATED HAND TRACKING BY NONPARAMETRIC BELIEF PROPAGATION ON FEASIBLE CONFIGURATION SPACE},
booktitle={Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)},
year={2008},
pages={508-513},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001075405080513},
isbn={978-989-8111-21-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)
TI - 3D ARTICULATED HAND TRACKING BY NONPARAMETRIC BELIEF PROPAGATION ON FEASIBLE CONFIGURATION SPACE
SN - 978-989-8111-21-0
AU - Liu T.
AU - Liang W.
AU - Jia Y.
PY - 2008
SP - 508
EP - 513
DO - 10.5220/0001075405080513