Rolling Shutter Camera Synchronization with Sub-millisecond Accuracy

Matěj Šmíd, Jiri Matas

2017

Abstract

A simple method for synchronization of video streams with a precision better than one millisecond is proposed. The method is applicable to any number of rolling shutter cameras and when a few photographic flashes or other abrupt lighting changes are present in the video. The approach exploits the rolling shutter sensor property that every sensor row starts its exposure with a small delay after the onset of the previous row. The cameras may have different frame rates and resolutions, and need not have overlapping fields of view. The method was validated on five minutes of four streams from an ice hockey match. The found transformation maps events visible in all cameras to a reference time with a standard deviation of the temporal error in the range of 0.3 to 0.5 milliseconds. The quality of the synchronization is demonstrated on temporally and spatially overlapping images of a fast moving puck observed in two cameras.

References

  1. Atcheson, B., Ihrke, I., Heidrich, W., Tevs, A., Bradley, D., Magnor, M., and Seidel, H.-P. (2008). Time-resolved 3d capture of non-stationary gas flows. ACM Trans. Graph.
  2. Bradley, D., Atcheson, B., Ihrke, I., and Heidrich, W. (2009). Synchronization and rolling shutter compensation for consumer video camera arrays. In CVPR.
  3. Caspi, Y., Irani, M., and Yaron Caspi, M. I. (2002). Spatiotemporal alignment of sequences. PAMI.
  4. Caspi, Y., Simakov, D., and Irani, M. (2006). Feature-based sequence-to-sequence matching. IJCV.
  5. Cheng Lei and Yee-Hong Yang (2006). Tri-focal tensorbased multiple video synchronization with subframe optimization. IEEE Trans. Image Process.
  6. Dai, C., Zheng, Y., and Li, X. (2006). Subframe video synchronization via 3D phase correlation. In ICIP.
  7. Farlinger, C. M., Kruisselbrink, L. D., and Fowles, J. R. (2007). Relationships to Skating Performance in Competitive Hockey Players. J. Strength Cond. Res.
  8. Hudon, M., Kerbiriou, P., Schubert, A., and Bouatouch, K. (2015). High speed sequential illumination with electronic rolling shutter cameras. In CVPR Workshops.
  9. Perez, F. and Granger, B. E. (2007). IPython: A System for Interactive Scientific Computing. Comput. Sci. Eng.
  10. Shrestha, P., Weda, H., Barbieri, M., and Sekulovski, D. (2006). Synchronization of multiple video recordings based on still camera flashes. In Int. Conf. Multimed.
  11. Sony (2014). Diagonal 6.23 mm (Type 1/2.9) CMOS Image Sensor with Square Pixel for Color Cameras. IMX322LQJ-C.
  12. Stein, G. (1999). Tracking from multiple view points: Selfcalibration of space and time. In CVPR.
  13. Tresadern, P. and Reid, I. (2003). Synchronizing Image Sequences of Non-Rigid Objects. In BMVC.
  14. Tresadern, P. A. and Reid, I. D. (2009). Video synchronization from human motion using rank constraints. CVIU.
  15. van der Walt, S., Colbert, S. C., and Varoquaux, G. (2011). The NumPy Array: A Structure for Efficient Numerical Computation. Comput. Sci. Eng.
  16. Wilburn, B., Joshi, N., Vaish, V., Levoy, M., and Horowitz, M. (2004). High-speed videography using a dense camera array. In CVPR.
  17. Worobets, J. T., Fairbairn, J. C., and Stefanyshyn, D. J. (2006). The influence of shaft stiffness on potential energy and puck speed during wrist and slap shots in ice hockey. Sport. Eng.
Download


Paper Citation


in Harvard Style

Šmíd M. and Matas J. (2017). Rolling Shutter Camera Synchronization with Sub-millisecond Accuracy . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-225-7, pages 238-245. DOI: 10.5220/0006175402380245


in Bibtex Style

@conference{visapp17,
author={Matěj Šmíd and Jiri Matas},
title={Rolling Shutter Camera Synchronization with Sub-millisecond Accuracy},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017)},
year={2017},
pages={238-245},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006175402380245},
isbn={978-989-758-225-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2017)
TI - Rolling Shutter Camera Synchronization with Sub-millisecond Accuracy
SN - 978-989-758-225-7
AU - Šmíd M.
AU - Matas J.
PY - 2017
SP - 238
EP - 245
DO - 10.5220/0006175402380245