Simultaneous Frame-rate Up-conversion of Image and Optical Flow Sequences

Shun Inagaki, Hayato Itoh, Atsushi Imiya

2015

Abstract

We develop a variational method for the frame-rate up-conversion of optical flow fields, in which we combine motion coherency in an image sequence and the smoothness of the temporal flow field. Since optical flow vectors define the motion of each point in an image, we can construct interframe images from low frame-rate image sequences using flow field vectors. The algorithm produces both interframe images and optical flow fields from a set of successive images in a sequence.

References

  1. Arrate, F., Ratnanather, J. T., and Younes, L. (2010). Diffeomorphic active contours. In SIAM J. Imaging Science, volume 3, pages 176-198.
  2. Demmel, J. W. (1997). Applied Numerical Linear Algebra. SIAM, Philadelphia.
  3. Hjelle, O. and Daehlen, M. (2006). Triangulations and Applications. Springer, Heidelberg.
  4. Lee, W. H., Choi, Y., Choi, K., and Ra, J. B. (2010). Frame rate up conversion via image fusion based on variational approach,. In Prceedings of 17th IEEE ICIP, pages 335-888. IEEE.
  5. Mobahi, H., Collobert, R., and Weston, J. (2012). Deep learning from temporal coherence in video. In Proceddings of VISAPP2012, pages 367-372. SCITEPRESS.
  6. Modersitzki, J. (2004). Numerical Methods for Image Registration. OUP, Oxford.
  7. Sadek, R., Ballester, C., Garrido, L., Meinhardt, E., and Caselles, V. (2009). Deep learning from temporal coherence in video,. In Proceddings of ICML09, pages 733-744. ACM.
  8. Strang, G. and Nguyen, T. (1996). Wavelets and Filter Banks. Wellesley-Cambridge Pres, Cambridge, MA.
  9. Vardy, A. and Moller, R. (2005). Biologically plausible visual homing methods based on optical flow techniques. In Connection Science, volume 17, pages 47- 89.
  10. Varga, R. S. (2000). Matrix Iterative Analysis. Springer, Heidelberg, 2nd edition.
  11. Volz, S., Bruhn, A., Valgaerts, L., and Zimmer, H. (2011). Modeling temporal coherence for optical flow,. In 13th ICCV, pages 1116-1123. IEEE.
  12. Werlberger, M., Pock, T., Unger, M., and Bischof, H. (2011). Optical flow guided tv-l1 video interpolation and restoration. In LNCS, volume 6819, pages 273- 286.
  13. Zimmer, H., Bruhn, A., and Weickert, J. (2011). Optic flow in harmony. In IJCV, volume 93, pages 368-388.
Download


Paper Citation


in Harvard Style

Inagaki S., Itoh H. and Imiya A. (2015). Simultaneous Frame-rate Up-conversion of Image and Optical Flow Sequences . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-089-5, pages 68-75. DOI: 10.5220/0005296800680075


in Bibtex Style

@conference{visapp15,
author={Shun Inagaki and Hayato Itoh and Atsushi Imiya},
title={Simultaneous Frame-rate Up-conversion of Image and Optical Flow Sequences},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={68-75},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005296800680075},
isbn={978-989-758-089-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2015)
TI - Simultaneous Frame-rate Up-conversion of Image and Optical Flow Sequences
SN - 978-989-758-089-5
AU - Inagaki S.
AU - Itoh H.
AU - Imiya A.
PY - 2015
SP - 68
EP - 75
DO - 10.5220/0005296800680075