VIEW-INDEPENDENT VIDEO SYNCHRONIZATION FROM TEMPORAL SELF-SIMILARITIES

Emilie Dexter, Patrick Pérez, Ivan Laptev, Imran N. Junejo

2009

Abstract

This paper deals with the temporal synchronization of videos representing the same dynamic event from different viewpoints. We propose a novel approach to automatically synchronize such videos based on temporal self-similarities of sequences. We explore video descriptors which capture the structure of video similarity over time and remain stable under viewpoint changes. We achieve temporal synchronization of videos by aligning such descriptors by Dynamic Time Warping. Our approach is simple and does not require point correspondences between views while being able to handle strong view changes. The method is validated on two public datasets with controlled view settings as well as on other videos with challenging motions and large view variations.

References

  1. Benabdelkader, C., Cutler, R. G., and Davis, L. S. (2004). Gait recognition using image self-similarity. EURASIP J. Appl. Signal Process., 2004(1):572-585.
  2. Carceroni, R., Padua, F., Santos, G., and Kutulakos, K. (2004). Linear sequence-to-sequence alignment. In Proc. Conf. Comp. Vision Pattern Rec., pages I: 746- 753.
  3. Caspi, Y. and Irani, M. (2002). Spatio-temporal alignment of sequences. IEEE Trans. on Pattern Anal. and Machine Intell., 24(11):1409-1424.
  4. Cha, S. and Srihari, S. (2002).
  5. Cutler, R. and Davis, L. (2000). Robust real-time periodic motion detection, analysis, and applications. PAMI, 22(8):781-796.
  6. Dalal, N. and Triggs, B. (2005). Histograms of oriented gradients for human detection. In Proc. Conf. Comp. Vision Pattern Rec, volume 2, pages 886-893.
  7. Junejo, I., Dexter, E., Laptev, I., and Pérez, P. (2008). Cross-view action recognition from temporal selfsimilarities. In Proc. Eur. Conf. Comp. Vision, pages 293-306.
  8. Lele, S. (1993). Euclidean distance matrix analysis (edma): Estimation of mean form and mean form difference. Mathematical Geology, 25(5):573-602.
  9. Lucas, B. and Kanade, T. (1981). An iterative image registration technique with an application to stereo vision. In Image Understanding Workshop, pages 121-130.
  10. Rabiner, L., Rosenberg, A., and Levinson, S. (1978). Considerations in dynamic time warping algorithms for discrete word recognition. IEEE Trans. on Acoustics, Speech and Signal Processing, 26(6):575- 582.
  11. Rao, C.and Gritai, A., Shah, M., and Syeda Mahmood, T. F. (2003). View-invariant alignment and matching of video sequences. In Proc. Int. Conf. on Image Processing, pages 939-945.
  12. Shechtman, E. and Irani, M. (2007). Matching local selfsimilarities across images and videos. In Proc. Conf. Comp. Vision Pattern Rec.
  13. Stein, G. (1999). Tracking from multiple view points: Selfcalibration of space and time. In Proc. Conf. Comp. Vision Pattern Rec., volume 1, pages 521-527.
  14. Tuytelaars, T. and Van Gool, L. (2004). Synchronizing video sequences. In Proc. Conf. Comp. Vision Pattern Rec., volume 1, pages 762-768.
  15. Ukrainitz, Y. and Irani, M. (2006). Aligning sequences and actions by minimizing space-time correlations. In Proc. Europ. Conf. on Computer Vision.
  16. Ushizaki, M., Okatani, T., and Deguchi, K. (2006). Video synchronization based on co-occurrence of appearance changes in video sequences. In Int. Conf. on Pattern Recognition, pages III: 71-74.
  17. Weinland, D., Boyer, E., and Ronfard, R. (2007). Action recognition from arbitrary views using 3d exemplars. In Proc. Int.Conf. on Computer Vision, pages 1-7.
  18. Wolf, L. and Zomet, A. (2006). Wide baseline matching between unsynchronized video sequences. Int. J. of Computer Vision, 68(1):43-52.
Download


Paper Citation


in Harvard Style

Dexter E., Pérez P., Laptev I. and N. Junejo I. (2009). VIEW-INDEPENDENT VIDEO SYNCHRONIZATION FROM TEMPORAL SELF-SIMILARITIES . In Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2009) ISBN 978-989-8111-69-2, pages 383-391. DOI: 10.5220/0001561003830391


in Bibtex Style

@conference{visapp09,
author={Emilie Dexter and Patrick Pérez and Ivan Laptev and Imran N. Junejo},
title={VIEW-INDEPENDENT VIDEO SYNCHRONIZATION FROM TEMPORAL SELF-SIMILARITIES},
booktitle={Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2009)},
year={2009},
pages={383-391},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001561003830391},
isbn={978-989-8111-69-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Fourth International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2009)
TI - VIEW-INDEPENDENT VIDEO SYNCHRONIZATION FROM TEMPORAL SELF-SIMILARITIES
SN - 978-989-8111-69-2
AU - Dexter E.
AU - Pérez P.
AU - Laptev I.
AU - N. Junejo I.
PY - 2009
SP - 383
EP - 391
DO - 10.5220/0001561003830391