EXPLOITING HUMAN BIPEDAL MOTION CONSTRAINTS FOR 3D POSE RECOVERY FROM A SINGLE UNCALIBRATED CAMERA

Paul Kuo, Thibault Ammar, Michal Lewandowski, Dimitrios Makris, Jean-Christophe Nebel

2009

Abstract

A new method is proposed for recovering 3D human poses in video sequences taken from a single uncalibrated camera. This is achieved by exploiting two important constraints observed from human bipedal motion: coplanarity of body key points during the mid-stance position and the presence of a foot on the ground – i.e. static foot - during most activities. Assuming 2D joint locations have been extracted from a video sequence, the algorithm is able to perform camera auto-calibration on specific frames when the human body adopts particular postures. Then, a simplified pin-hole camera model is used to perform 3D pose reconstruction on the calibrated frames. Finally, the static foot constraint which is found in most human bipedal motions is applied to infer body postures for non-calibrated frames. We compared our method with (1) “orthographic reconstruction” method and (2) reconstruction using manually calibrated data. The results validate the assumptions made for the simplified pin-hole camera model and reconstruction results reveal a significant improvement over the orthographic reconstruction method.

References

  1. P. Kuo, J.-C. Nebel and D. Makris. Camera AutoCalibration from Articulated Motion, AVSS: pp. 135- 140. 2007.
  2. R.Y. Tsai, A versatile camera calibration technique for high accuracy 3D machine vision metrology using offthe-shelf TV cameras and lenses, IEEE Journal of Robotics and Automation, vol. RA-3 pp323-343 Aug, 1987.
  3. C. J. Taylor. Reconstruction of Articulated Objects from Point Correspondences in a Single Image, CVPR: pp. 677-684. 2000.
  4. P. Kuo, D. Makris, N. Megherbi and J.-C. Nebel. Integration of Local Image Cues for Probabilistic 2D Pose Recovery", 4th International Symposium on Visual Computing (ISVC), Springer-Verlag. 2008 A.O. Balan and M.J. Black. An Adaptive Appearance Model Approach for Model-based Articulated Object Tracking. CVPR: pp. 758-765. 2006.
  5. R. Urtasun, D.J. Fleet and P. Fua. 3D People Tracking with Gaussian Process Dynamical Models. CVPR: pp.238-245. 2006.
  6. Frame 359 (rms =23.0) Frame 529 (rms =67.4) Frame 614 Frame 693 Frame 393 Frame 450 Frame 555 Frame 653 Frame 742 (rms =46.3) (rms =172.4) (rms =21.2) (rms = 143.3) (rms = 62.6) (rms = 54.7) (rms = 92.9) S. Bhatia, L. Sigal, M. Isard and M.J. Black. 3D Human Limb Detection using Space Carving and Multi-View Eigen Models. CVPR: pp. 17-24. 2004.
  7. T. Izo and W.E.L. Grimson. Simultaneous pose recovery and camera registration from multiple views of a walking person. Journal of Image and Vision Computing: pp. 342-351. 2007.
  8. A. Elgammal and C.S. Lee. Body Pose Tracking from Uncalibrated Camera using Supervised Manifold Learning. NIPS. 2006.
  9. T. P. Tian, R. Li and S. Sclaroff. Articulated Pose Estimation in a Learned Smooth Space of Feasible Solutions. CVPR: pp: 50-57. 2005.
  10. H. Lim, V. I. Morariu, O.I. Camps, M. Sznaier. Dynamic Appearance Modeling for Human Tracking. CVPR: pp: 751-757. 2006.
  11. C.H. Ek, P.H.S. Torr and N.D. Lawrence. Gaussian Process Latent Variable Models for Human Pose Estimation. LNCS 4892. Springer. pp: 132-143. 2008.
  12. J. Martinez-del-Rincon, J.-C. Nebel, D. Makris, C. OrriteUrunuela. Tracking Human Body Parts Using Particle Filters Constrained by Human Biomechanics. BMVC 2008.
  13. L. Sigal and M. J. Black, HumanEva: Synchronized video and motion capture dataset for evaluation of articulated human motion, Tech. Report CS0608, Brown Univ. 2006.
  14. G. A. F. Seber. Multivariate Observations, Wiley, 1984.
  15. Z. Husz, A. Wallace and P. Green, Evaluation of a Hierarchical Partitioned Particle Filter with Action Primitives. CVPR 2nd workshop on EHuM2. 2007
Download


Paper Citation


in Harvard Style

Kuo P., Ammar T., Lewandowski M., Makris D. and Nebel J. (2009). EXPLOITING HUMAN BIPEDAL MOTION CONSTRAINTS FOR 3D POSE RECOVERY FROM A SINGLE UNCALIBRATED CAMERA . In Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009) ISBN 978-989-8111-69-2, pages 557-564. DOI: 10.5220/0001821305570564


in Bibtex Style

@conference{visapp09,
author={Paul Kuo and Thibault Ammar and Michal Lewandowski and Dimitrios Makris and Jean-Christophe Nebel},
title={EXPLOITING HUMAN BIPEDAL MOTION CONSTRAINTS FOR 3D POSE RECOVERY FROM A SINGLE UNCALIBRATED CAMERA },
booktitle={Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009)},
year={2009},
pages={557-564},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001821305570564},
isbn={978-989-8111-69-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2009)
TI - EXPLOITING HUMAN BIPEDAL MOTION CONSTRAINTS FOR 3D POSE RECOVERY FROM A SINGLE UNCALIBRATED CAMERA
SN - 978-989-8111-69-2
AU - Kuo P.
AU - Ammar T.
AU - Lewandowski M.
AU - Makris D.
AU - Nebel J.
PY - 2009
SP - 557
EP - 564
DO - 10.5220/0001821305570564