ANALYZING INVARIANCE OF FREQUENCY DOMAIN BASED FEATURES FROM VIDEOS WITH REPEATING MOTION

Kahraman Ayyildiz, Stefan Conrad

Abstract

This paper discusses an approach, which allows classifying videos by frequency spectra. Many videos contain activities with repeating movements. Sports videos, home improvement videos, or videos showing mechanical motion are some example areas. Motion of these areas usually repeats with a certain main frequency and several side frequencies. Transforming repeating motion to its frequency domain via FFT reveals these frequency features. In this paper we explain how to compute frequency features for video clips and how to use them for classifying. The experimental stage of this work focuses on the invariance of these features with respect to rotation, reflection, scaling, translation and time shift.

References

  1. Abdelkader, C. B., Cutler, R., and Davis, L. (2002). Motionbased recognition of people in eigengait space. In Proceedings of the Fifth IEEE Int. Conf. on Automatic Face and Gesture Recognition, pages 267-277.
  2. Ayyildiz, K. and Conrad, S. (2011). Video classification by main frequencies of repeating movements. In 12th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2011).
  3. Bashir, F., Khokhar, A., and Schonfeld, D. (2006). Viewinvariant motion trajectory-based activity classification and recognition. Multimedia Systems, 12(1):45- 54.
  4. Bobick, A. F., Davis, J. W., Society, I. C., and Society, I. C. (2001). The recognition of human movement using temporal templates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23:257-267.
  5. Chen, X., Schonfeld, D., and Khokhar, A. (2008). Robust null space representation and sampling for viewinvariant motion trajectory analysis. Computer Vision and Pattern Recognition, IEEE Computer Society Conference on, 0:1-6.
  6. Fanti, C., Zelnik-manor, L., and Perona, P. (2005). Hybrid models for human motion recognition. In IEEE International Conf. on Computer Vision, pages 1166-1173.
  7. He, Q. and Debrunner, C. (2000). Individual recognition from periodic activity using hidden markov models. In Workshop on Human Motion, pages 47-52.
  8. Lienhart, R. (1996). Indexing and retrieval of digital video sequences based on automatic text recognition. In Fourth ACM int. conf. on multimedia, pages 419-420.
  9. Meng, Q., Li, B., and Holstein, H. (2006). Recognition of human periodic movements from unstructured information using a motion-based frequency domain approach. IVC, pages 795-809.
  10. Niebles, J. C. and Fei-fei, L. (2007). A hierarchical model of shape and appearance for human action classification. In IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 1-8.
  11. Patel, N. and Sethi, I. (1996). Audio characterization for video indexing. In SPIE on Storage and Retrieval for Still Image and Video Databases, pages 373-384.
  12. Pei, S. and Chen, F. (2003). Semantic scenes detection and classification in sports videos. In Conf. on Computer Vision, Graphics and Image Proc., pages 210-217.
  13. Rao, C., Gritai, A., Shah, M., and Syeda-Mahmood, T. (2003). View-invariant alignment and matching of video sequences. IEEE International Conference on Computer Vision, pages 939-945.
  14. Weinland, D., Ronfard, R., and Boyer, E. (2006). Free viewpoint action recognition using motion history volumes. In Computer vision and image understanding, pages 249-257.
  15. Wong, W., Siu, W., and Lam, K. (1995). Generation of moment invariants and their uses for character recognition. Pattern Recognition Letters, 16:115-123.
  16. Zhang, R., Vogler, C., and Metaxas, D. (2004). Human gait recognition. In Proc. of the 2004 Conf. on Computer Vision and Pattern Recognition, pages 18-27.
Download


Paper Citation


in Harvard Style

Ayyildiz K. and Conrad S. (2012). ANALYZING INVARIANCE OF FREQUENCY DOMAIN BASED FEATURES FROM VIDEOS WITH REPEATING MOTION . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2012) ISBN 978-989-8565-03-7, pages 659-666. DOI: 10.5220/0003798806590666


in Bibtex Style

@conference{visapp12,
author={Kahraman Ayyildiz and Stefan Conrad},
title={ANALYZING INVARIANCE OF FREQUENCY DOMAIN BASED FEATURES FROM VIDEOS WITH REPEATING MOTION},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2012)},
year={2012},
pages={659-666},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003798806590666},
isbn={978-989-8565-03-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2012)
TI - ANALYZING INVARIANCE OF FREQUENCY DOMAIN BASED FEATURES FROM VIDEOS WITH REPEATING MOTION
SN - 978-989-8565-03-7
AU - Ayyildiz K.
AU - Conrad S.
PY - 2012
SP - 659
EP - 666
DO - 10.5220/0003798806590666