A Novel Key Frame Extraction Approach for Video Summarization

Hana Gharbi, Sahbi Bahroun, Ezzeddine Zagrouba

2016

Abstract

Video summarization is a principal task in video analysis and indexing algorithms. In this paper we will present a new algorithm for video key frame extraction. This process is one of the basic procedures for video retrieval and summary. Our new approach is based on interest points description and repeatability measurement. Before key frame extraction, the video should be segmented into shots. Then, for each shot, we detect interest points in all images. After that, we calculate repeatability matrix for each shot. Finally, we apply PCA and HAC to extract key frames.

References

  1. Ueda, H., Miyatake, T., and Yoshizawa, S., 1991. An interactive natural-motion-picture dedicated multimedia authoring system. Proc. ACM CHI Conference, 343 -350.
  2. Pentland, A., Picard, R.,Davenport G., and Haase , K., 1994. Video and image semantics, advanced tools for telecommunications. IEEE Multimedia. 73-75.
  3. Zhuang, Y., Rui, Y., Huang, T. S, Mehrotra, S., 1998. Key Frame Extraction Using Unsupervised Clustering. ICIP'98, Chicago, USA, 866-870.
  4. Girgensohn, A., Boreczky, J., 2000. Time-Constrained Keyframe Selection Technique. Multimedia Tools and Application, 347-358.
  5. Gong Y., and Liu, X., 2000. Generating optimal video summaries. Proc. IEEE Int. Conference on Multimedia and Expo, 3:1559-1562.
  6. Mundur, P., Rao, Y. and Yesha Y., 2006 .Keyframe-based video summarization using Delaunay clustering. International Journal on Digital Libraries, vol. 6, no. 2, pp. 219-232.
  7. Luo, J., Papin, C., Costello, K., 2009. Towards extracting semantically meaningful key frames from personal video clips: from humans to computers. IEEE Transactions on Circuits and Systems for Video Technology 19 (2) 289-301.
  8. Guironnet, M., Pellerin, D., Guyader, N., 2007. Ladret, P.,Video summarization based on camera motion and a subjective evaluation method. EURASIP Journal on Image and Video Processing, 12.
  9. Chen, F., Delannay, D., Vleeschouwer, C., 2011. “An autonomous framework to produce and distribute personalized team-sport video summaries: a basketball case study. IEEE Transactions on Multimedia 13 (6) 1381-1394.
  10. Truong, B.T., Venkatesh, S., 2007. Video abstraction: a systematic review and classification, ACM Transactions Multimedia Computing. Communications and Applications. 3 (1).
  11. Cai et al., 2005. A Study of Video Scenes Clustering Based on Shot Key Frames. Series Core Journal of Wuhan University (English) Wuhan University Journal of Natural Sciences Pages 966-970.
  12. Lowe D. G., 2004. Distinctive image features from scale Invariant keypoints. Int. J. Computer Vision, vol. 60, no. 2, pp. 91-110.
  13. Bahroun, S., Gharbi, H., and Zagrouba, E., 2014. Local query on satellite images based on interest points. International Geoscience and Remote Sensing Symposium, Quebec.
  14. Gharbi, H., Bahroun, S., and Zagrouba, E., 2014. Robust interest points matching based on local description and spatial constraints. International Conference on Image, Vision and Computing, Paris.
  15. Park, K. T., Lee, J. Y., Rim, K. W., Moon, Y. S., 2005. Key frame extraction based on shot coverage and distortion. LNCS, 3768:291-300.
  16. Wolf, W., 1996. Key frame selection by motion analysis. Int Conf on Acoustic. Speech and Signal Processing.
  17. Barhoumi, W., and Zagrouba, E., 2013. “On-the-fly extraction of key frames for efficient video summarization. AASRI Procedia 4, 78 - 84.
  18. Ciocca, G., and Schettini, R. 2006. An innovative algorithm for key frame extraction in video summarization. J. of Real-Time Image Processing 1(1): 69-88.
  19. Schmid, C., Mohr, R., Bauckhage, C., 2000. Evaluation of Interest Point Detectors. International Journal of Computer Vision.
  20. Berkhin, P., 2002. Clustering DataMining Techniques. Accrue Software, San Jose.
Download


Paper Citation


in Harvard Style

Gharbi H., Bahroun S. and Zagrouba E. (2016). A Novel Key Frame Extraction Approach for Video Summarization . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 146-153. DOI: 10.5220/0005725701460153


in Bibtex Style

@conference{visapp16,
author={Hana Gharbi and Sahbi Bahroun and Ezzeddine Zagrouba},
title={A Novel Key Frame Extraction Approach for Video Summarization},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={146-153},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005725701460153},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)
TI - A Novel Key Frame Extraction Approach for Video Summarization
SN - 978-989-758-175-5
AU - Gharbi H.
AU - Bahroun S.
AU - Zagrouba E.
PY - 2016
SP - 146
EP - 153
DO - 10.5220/0005725701460153