VIDEO EVENT CLASSIFICATION AND DETECTION USING 2D TRAJECTORIES

Alexandre Hervieu, Patrick Bouthemy, Jean-Pierre Le Cadre

Abstract

This paper describes an original statistical trajectory-based approach which can address several issues related to dynamic video content understanding: unsupervised clustering of events, recognition of events corresponding to learnt classes of dynamic video contents, and detection of unexpected events. Appropriate local differ- ential features combining curvature and motion magnitude are robustly computed on the trajectories. They are invariant to image translation, in-the-plane rotation and scale transformation. The temporal causality of these features is then captured by hidden Markov models whose states are properly quantized values, and similarity between trajectories is expressed by exploiting the HMM framework. We report experiments on two sets of data, a first one composed of typical classes of synthetic (noised) trajectories (such as parabola or clothoid), and a second one formed with trajectories computed in sports videos. We have also favorably compared our method to other ones, including feature histogram comparison, use of the longest common subsequence (LCSS) distance and SVM-based classification.

References

  1. F. I. Bashir, A. A. Khokhar, and D. Schonfeld. Realtime motion trajectory-based indexing and retrieval of video sequences. IEEE Trans. on Multimedia, 9(1):58-65, 2007.
  2. O. Boiman and M. Irani. Detecting irregularities in images and in video. IEEE Int. Conf. on Computer Vision, ICCV'05, Beijing, Vol.1, pages 462-469, Oct. 2005.
  3. C. Burges. A tutorial on support vector machines for pattern recognition. Data Mining and Knowledge Discovery, 2:121-167, 1998.
  4. D. Buzan, S. Sclaroff, and G. Kollios. Extraction and clustering of motion trajectories in video. In Proc. of the 17th Int. Conf. Pattern Recognition, ICPR'04, pages 521-524, Cambridge, UK, Aug. 2004.
  5. M. T. Chan, A. Hoogs, J. Schmiederer, and M. Peterson. Detecting rare events in video using semantic primitives with HMM. In Proc. of the 17th Int. Conf. on Pattern Recognition, ICPR'04,pages 150- 154, Cambridge, UK, Aug. 2004.
  6. M. T. Chan, A. Hoogs, R. Bhotika, and A. Perera. Joint recognition of complex events and track matching. In Proc of the IEEE Conf. on Comp. Vis. and Patt. Rec., CVPR'06, pages 694-699, New York, June 2006.
  7. J. Ford and J. Moore. Adaptive estimation of HMM transition probabilities. IEEE Trans. on Signal Processing, 46(5):1374-1385, 1998.
  8. P. Perez, C. Hue, J. Vermaak, and M. Gangnet. Color-based probabilistic tracking. Proc. Europ. Conf. Computer Vision, ECCV'02, Copenhaguen, June 2002.
  9. S. Gong and T. Xiang. Recognition of group activities using dynamic probabilistic networks. In Proc. of the IEEE Int. Conf. on Computer Vision, ICCV'03, pages 742- 749, Nice, Oct. 2003.
  10. S. Hongeng, R. Nevatia, and F. Bremond. Video-based event recognition: Activity representation and probabilistic recognition methods. Computer Vision and Image Understanding, 96(2):129-162, 2003.
  11. W. Hu, D. Xie, Z. Fu, W. Zheng, and S. Maybank. Semantic-based surveillance video retrieval. IEEE Trans. on Image Proc., 16(4):1168-1181, April 2007.
  12. A. Kokaram, N. Rea, R. Dahyot, M. Tekalp, P. Bouthemy, P. Gros, and I. Sezan. Browsing sports video (Trends in sports-related indexing and retrieval work). IEEE Signal Processing Magazine, 23(2):47-58, March 2006.
  13. C. Li and G. Biswas. Temporal pattern generation using hidden Markov model based unsupervised classification. Advances in Intelligent Data Analysis, Lecture Notes in Computer Science, 1642:245-256, 1999.
  14. X. Li, W. Hu, and W. Hu. A coarse-to-fine strategy for vehicle motion trajectory clustering. In Proceedings of the 17th International Conference on Pattern Recognition, pages 591-594, Hong Kong, Aug. 2006.
  15. F. Porikli. Trajectory distance metric using hidden Markov model based representation. In PETS Workshop, Prague, May 2004.
  16. L. Rabiner. A tutorial on hidden Markov models and selected applications in speech recognition. Proc. IEEE, 77(2):257-285, 1989.
  17. C. Stauffer and W. E. L. Grimson. Learning patterns of activity using real-time tracking. IEEE Trans. Pattern Analysis and Machine Intelligence, 22(8):747- 757, Aug. 2000.
  18. M. Vlachos, G. Kollios, and D. Gunopulos. Discovering similar multidimensional trajectories. In Proc. of the 18th International Conference on Data Engineering, San Jose, Feb 2002.
  19. X. Wang, K. Tieu, and E. Grimson. Learning semantic scene models by trajectory analysis. In Proc. Europ. Conf. Computer Vision, ECCV'06, Graz, May 2006.
Download


Paper Citation


in Harvard Style

Hervieu A., Bouthemy P. and Le Cadre J. (2008). VIDEO EVENT CLASSIFICATION AND DETECTION USING 2D TRAJECTORIES . In Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008) ISBN 978-989-8111-21-0, pages 158-166. DOI: 10.5220/0001073001580166


in Bibtex Style

@conference{visapp08,
author={Alexandre Hervieu and Patrick Bouthemy and Jean-Pierre Le Cadre},
title={VIDEO EVENT CLASSIFICATION AND DETECTION USING 2D TRAJECTORIES},
booktitle={Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)},
year={2008},
pages={158-166},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001073001580166},
isbn={978-989-8111-21-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)
TI - VIDEO EVENT CLASSIFICATION AND DETECTION USING 2D TRAJECTORIES
SN - 978-989-8111-21-0
AU - Hervieu A.
AU - Bouthemy P.
AU - Le Cadre J.
PY - 2008
SP - 158
EP - 166
DO - 10.5220/0001073001580166