TEXTURE BASED DESCRIPTION OF MOVEMENTS FOR ACTIVITY ANALYSIS

Kellokumpu Vili, Zhao Guoying, Pietikäinen Matti

Abstract

Human motion can be seen as a type of moving texture pattern. In this paper, we propose a novel approach for activity analysis by describing human activities with texture features. Our approach extracts spatially enhanced local binary pattern (LBP) histograms from temporal templates (Motion History Images and Motion Energy Images) and models their temporal behavior with hidden Markov models. The description is useful for action modeling and is suitable for detecting and recognizing various kinds of activities. The method is computationally simple. We perform tests on two published databases and clearly show the good performance of our approach in classification and detection tasks. Furthermore, experimental results show that the approach performs robustly against irregularities in data, such as limping and walking with a dog, partial occlusions and low video quality.

References

  1. Moeslund T. B.,Hilton A., Krüger V., 2006. A Survey of Advances in Vision-based Human Motion Capture and Analysis. Computer Vision and Image Understanding, vol.104, issues 2-3, pp. 90 - 126,.
  2. Gavrila D. M., 1999. The Visual Analysis of Human Movement: A Survey. Computer Vision and Image Understanding, vol. 73, no. 3, pp. 82 - 98.
  3. Elgammal A., Shet V., Yacoob Y., Davis L. S., 2003. Learning Dynamics for Exemplar-based Gesture Recognition. In Proc. Computer Vision and Pattern Recognition, vol. 1, pp. 571 - 578.
  4. Kellokumpu V., Pietikäinen M., Heikkilä J., 2005. Human Activity Recognition Using Sequences of Postures. In Proc. Machine Vision Application, pp. 570 - 573,.
  5. Efros A. A., Berg A. C., Mori G., Malik J., 2003. Recognizing Action at a Distance. In Proc International conference on Computer Vision, vol. 2, pp. 726 - 733.
  6. Bobick A., Davis J., 2001. The Recognition of Human Movement Using Temporal Templates. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 3, pp. 257 - 267.
  7. Weinland D., Ronfard R., Boyer E., 2006. Free Viewpoint Action Recognition Using Motion History Volumes. Computer Vision and Image Understanding, vol. 104, issues 2-3, Pages 249-257.
  8. Blank M., Gorelick L., Shechtman E., Irani M., Basri R., 2005. Actions as Space-Time Shapes. In Proc. International Conference on Computer Vision, vol. 2, pp. 1395 - 1402.
  9. Yilmaz A., Shah M., 2005. Action Sketch: a Novel Action Representation. In Proc. Computer Vision and Pattern Recognition, vol. 1, pp. 984 - 989.
  10. Ojala T., Pietikäinen M., Mäenpää T., 2002. Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, pp. 971 - 987.
  11. Rabiner L.R., 1989. A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition. Proceedings of the IEEE, vol. 77, no. 2, pp. 257 - 285.
  12. Niebles J. C., Fei-Fei L., 2007. A Hierarchical Model of Shape and Appearance for Human Action Classification, In Proc. Computer Vision and Pattern Recognition, 8p.
  13. Wang L., Suter D., 2007. Recognizing Human Activities from Silhouettes: Motion Subspace and Factorial Discriminative Graphical Model, In Proc. Computer Vision and Pattern Recognition, 8p.
  14. Boiman O., Irani M., 2006. Similarity by Composition, Neural Information Processing Systems (NIPS).
  15. Scovanner P., Ali S., Shah M., 2007. A 3-Dimensional SIFT Descriptor and its Application to Action Recognition. In Proc ACM Multimedia, pp. 357 - 360.
  16. Ali S., Basharat A., Shah M., 2007. Chaotic Invariants for Human Action Recognition. In proc International Conference on Computer Vision, 8p.
Download


Paper Citation


in Harvard Style

Vili K., Guoying Z. and Matti P. (2008). TEXTURE BASED DESCRIPTION OF MOVEMENTS FOR ACTIVITY ANALYSIS . In Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008) ISBN 978-989-8111-21-0, pages 206-213. DOI: 10.5220/0001075502060213


in Bibtex Style

@conference{visapp08,
author={Kellokumpu Vili and Zhao Guoying and Pietikäinen Matti},
title={TEXTURE BASED DESCRIPTION OF MOVEMENTS FOR ACTIVITY ANALYSIS},
booktitle={Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)},
year={2008},
pages={206-213},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001075502060213},
isbn={978-989-8111-21-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)
TI - TEXTURE BASED DESCRIPTION OF MOVEMENTS FOR ACTIVITY ANALYSIS
SN - 978-989-8111-21-0
AU - Vili K.
AU - Guoying Z.
AU - Matti P.
PY - 2008
SP - 206
EP - 213
DO - 10.5220/0001075502060213