Smoothed Surface Transitions for Human Motion Synthesis

Ashish Doshi

2014

Abstract

Multiview techniques to reconstruct an animation from 3D video have advanced in leaps and bounds in recent years. It is now possible to synthesise a 3D animation by fusing motions between different sequences. Prior work in this area has established methods to successfully identify inter-sequence transitions of different or similar actions. In some instances however, the transitions at these nodes in the motion path would cause an abrupt change between the motion sequences. Hence, this paper proposes a framework that allows for smoothing of these inter-sequence transitions, while preserving the detailed dynamics of the captured movement. Laplacian based mesh deformation, in addition to shape and appearance based feature methods, including SIFT and MeshHOG features, are used to obtain temporally consistent meshes. These meshes are then interpolated within a temporal window and concatenated to reproduce a seamless transition between the motion sequences. A quantitative analysis of the inter-sequence transitions, evaluated using three dimensional shape based Hausdorff distance is presented for synthesised 3D animations.

References

  1. Arikan, O. and Forsyth, D. A. (2002). Interactive motion generation from examples. In ACM SIGGRAPH, pages 483-490.
  2. Baran, I., Vlasic, D., Grinspun, E., and Popovic, J. (2009). Semantic deformation transfer. In ACM SIGGRAPH, pages 1-6.
  3. Budd, C., Huang, P., Klaudiny, M., and Hilton, A. (2013). Global non-rigid alignment of surface sequences. Inter. Journal of Computer Vision, 102(1-3):256-270.
  4. Cignoni, P., Rocchini, C., and Scopigno, R. (1998). Metro: measuring error on simplified surfaces. Computer Graphics Forum, 17(2):167-174.
  5. de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.-P., and Thrun, S. (2008). Performance capture from sparse multi-view video. In ACM SIGGRAPH.
  6. Doshi, A., Starck, J., and Hilton, A. (2010). An empirical study of non-rigid surface feature matching of human from 3d video. Journal of Virtual Reality and Broadcasting, 7(2010)(3).
  7. Flagg, M., Nakazawa, A., Zhang, Q., Kang, S. B., Ryu, Y. K., Essa, I., and Rehg, J. M. (2009). Human video textures. In Symposium on Interactive 3D Graphics and Games, pages 199-206.
  8. Hsieh, M.-K., Chen, B.-Y., and Ouhyoung, M. (2005). Motion retargeting and transition in different articulated figures. In 9th Inter. Conf. on Computer Aided Design and Computer Graphics.
  9. Huang, P., Hilton, A., and Starck, J. (2009). Human motion synthesis from 3D video. In IEEE Conf. on Computer Vision and Pattern Recognition.
  10. Kircher, S. and Garland, M. (2008). Free-form motion processing. ACM Transactions on Graphics, 27(2):1-13.
  11. Kovar, L., Gleicher, M., and Pighin, F. (2002). Motion graphs. In ACM SIGGRAPH.
  12. Lowe, D. (2003). Distinctive image features from scaleinvariant keypoints. Inter. Journal of Computer Vision, 20:91-110.
  13. Schödl, A., Szeliski, R., Salesin, D., and Essa, I. A. (2000). Video textures. In ACM SIGGRAPH, pages 489-498.
  14. Sorkine, O. (2006). Differential representations for mesh processing. Computer Graphics Forum, 25(4):789- 807.
  15. Starck, J. and Hilton, A. (2007). Surface capture for performance based animation. Computer Graphics and Applications, 27(3):21-31.
  16. Starck, J., Miller, G., and Hilton, A. (2005). Video-based character animation. In Symposium on Computer Animation.
  17. Vlasic, D., Baran, I., Matusik, W., and Popovic, J. (2008). Articulated mesh animation from multi-view silhouettes. ACM Transactions on Graphics, 27(3):97.
  18. Xu, J., Yamasaki, T., and Aizawa, K. (2009). Motion editing for time-varying mesh. EURASIP Journal on Advances in Signal Processing, 2009.
  19. Zaharescu, A., Boyer, E., Varanasi, K., and Horaud, R. P. (2009). Surface feature detection and description with applications to mesh matching. In IEEE Conf. on Computer Vision and Pattern Recognition, Miami Beach, Florida.
  20. Zhou, K., Huang, J., Snyder, J., Liu, X., Bao, H., Guo, B., and Shum, H.-Y. (2005). Large mesh deformation using the volumetric graph Laplacian. ACM Transactions on Graphics, 24(3):496-503.
Download


Paper Citation


in Harvard Style

Doshi A. (2014). Smoothed Surface Transitions for Human Motion Synthesis . In Proceedings of the 11th International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2014) ISBN 978-989-758-046-8, pages 73-79. DOI: 10.5220/0005122400730079


in Bibtex Style

@conference{sigmap14,
author={Ashish Doshi},
title={Smoothed Surface Transitions for Human Motion Synthesis},
booktitle={Proceedings of the 11th International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2014)},
year={2014},
pages={73-79},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005122400730079},
isbn={978-989-758-046-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th International Conference on Signal Processing and Multimedia Applications - Volume 1: SIGMAP, (ICETE 2014)
TI - Smoothed Surface Transitions for Human Motion Synthesis
SN - 978-989-758-046-8
AU - Doshi A.
PY - 2014
SP - 73
EP - 79
DO - 10.5220/0005122400730079