GENERATING HUMAN INTERACTIVE BEHAVIOURS USING THE WINDOWED VITERBI ALGORITHM

Yue Zheng, Yulia Hicks, Dave Marshall, Darren Cosker

Abstract

In this paper, we propose a new approach for generating interactive behaviours for virtual characters, namely the windowed Viterbi algorithm, capable of doing so in real-time. Consequently, we compare the performance of the standard Viterbi algorithm and the windowed Viterbi algorithm within our system. Our system tracks and analyses the behaviour of a real person in video input and produces a fully articulated three dimensional (3D) character interacting with the person in the video input. Our system is model-based. Prior to tracking, we train a collection of dual Hidden Markov Model (HMM) on 3D motion capture (MoCap) data representing a number of interactions between two people. Then using the dual HMM, we generate a moving virtual character reacting to (the motion of) a real person. In this article, we present the detailed evaluation of using the windowed Viterbi algorithms within our system, and show that our approach is suitable for generating interactive behaviours in real-time.

References

  1. Cosker, D., Marshall, D., Rosin, P. L., and Hicks, Y. (2004). Speech driven facial animation using a hidden markov coarticulation model. IEEE ICPR, 1:314-321.
  2. Deutscher, J., Blake, A., and Reid, I. (2000). Articulated Body Motion Capture by Annealed Particle Filtering. IEEE CVPR Proceedings, 2:126-133.
  3. Jebara, T. and Pentland, A. (2002). Statistical Imitative Learning from Perceptual Data. Proceedings of the 2nd International Conference on Development and Learning.
  4. Johansson, G. (1973). Visual perception of biological motion and a model for its analysis. Perception and Psychophysics, 14(2):201-211.
  5. Johnson, N., Galata, A., and Hogg, D. (1998). The acquisition and use of interaction behaviour model. IEEE CVPR Proceedings, pages 866-871.
  6. Meredith, M. and Maddock, S. (2005). Adapting motion capture data using weighted real-time inverse kinematics. Comput. Entertain., 3(1):5-5.
  7. Pilu, M. (2004). Video stabilization as a variational problem and numerical solution with the viterbi method. IEEE CVPR, 1:625-630.
  8. Rabiner, L. R. (1989). A tutorial on hidden markov models and selected applications in speech recognition. IEEE Proceedings, 77(2):257-286.
  9. Rybski, P. E. and Veloso, M. M. (2005). Robust realtime human activity recognition from tracked face displacements. Proceedings of the 12th Portuguese Conference on Artificial Intelligence, pages 87-98.
  10. Wen, G., Wang, Z., Xia, S., and Zhu, D. (2006). From motion capture data to character animation. VRST 7806: Proceedings of the ACM symposium on Virtual reality software and technology, pages 165-168.
  11. Zheng, Y., Hicks, Y., Cosker, D., Marshall, D., Mostaza, J. C., and Chambers, J. A. (2006). Virtual friend: Tracking and generating natural interactive behaviours in real video. IEEE ICSP.
  12. Zordan, V. B. and Horst, N. C. V. D. (2003). Mapping optical motion capture data to skeletal motion using a physical model. pages 245-250.
Download


Paper Citation


in Harvard Style

Zheng Y., Hicks Y., Marshall D. and Cosker D. (2008). GENERATING HUMAN INTERACTIVE BEHAVIOURS USING THE WINDOWED VITERBI ALGORITHM . In Proceedings of the Third International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2008) ISBN 978-989-8111-20-3, pages 353-358. DOI: 10.5220/0001097503530358


in Bibtex Style

@conference{grapp08,
author={Yue Zheng and Yulia Hicks and Dave Marshall and Darren Cosker},
title={GENERATING HUMAN INTERACTIVE BEHAVIOURS USING THE WINDOWED VITERBI ALGORITHM},
booktitle={Proceedings of the Third International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2008)},
year={2008},
pages={353-358},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001097503530358},
isbn={978-989-8111-20-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Third International Conference on Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2008)
TI - GENERATING HUMAN INTERACTIVE BEHAVIOURS USING THE WINDOWED VITERBI ALGORITHM
SN - 978-989-8111-20-3
AU - Zheng Y.
AU - Hicks Y.
AU - Marshall D.
AU - Cosker D.
PY - 2008
SP - 353
EP - 358
DO - 10.5220/0001097503530358