Optical Flow Estimation with Consistent Spatio-temporal Coherence Models

Javier Sánchez, Agustín Salgado, Nelson Monzón

Abstract

In this work we propose a new variational model for the consistent estimation of motion fields. The aim of this work is to develop appropriate spatio-temporal coherence models. In this sense, we propose two main contributions: a nonlinear flow constancy assumption, similar in spirit to the nonlinear brightness constancy assumption, which conveniently relates flow fields at different time instants; and a nonlinear temporal regularization scheme, which complements the spatial regularization and can cope with piecewise continuous motion fields. These contributions pose a congruent variational model since all the energy terms, except the spatial regularization, are based on nonlinear warpings of the flow field. This model is more general than its spatial counterpart, provides more accurate solutions and preserves the continuity of optical flows in time. In the experimental results, we show that the method attains better results and, in particular, it considerably improves the accuracy in the presence of large displacements.

References

  1. Í lvarez, L., Weickert, J., and Sánchez, J. (2000). Reliable estimation of dense optical flow fields with large displacements. International Journal of Computer Vision, 39(1):41-56.
  2. Black, M. J. (1994). Recursive non-linear estimation of discontinuous flow fields. In Proceedings of the third European conference on Computer vision (vol. 1), ECCV 7894, pages 138-145, Secaucus, NJ, USA. SpringerVerlag New York, Inc.
  3. Nagel, H. H. and Enkelmann, W. (1986). An investigation of smoothness constraints for the estimation of displacement vector fields from image sequences. IEEE Transanctions on Pattern Analysis and Machine Intelligence, 8:565-593.
  4. Papenberg, N., Bruhn, A., Brox, T., Didas, S., and Weickert, J. (2006). Highly Accurate Optic Flow Computation with Theoretically Justified Warping. International Journal of Computer Vision, 67(2):141-158.
  5. Salgado, A. and Sánchez, J. (2006). A temporal regularizer for large optical flow estimation. In IEEE International Conference on Image Processing ICIP, pages 1233-1236.
  6. Sánchez, J., Monzón, N., and Salgado, A. (2012). Robust optical flow estimation. IPOL: Image Processing Online, Preprint:1-18.
  7. Sun, D., Sudderth, E., and Black, M. J. (2010). Layered Image Motion with Explicit Occlusions, Temporal Consistency, and Depth Ordering. In Lafferty, J., Williams, C. K. I., Shawe-Taylor, J., Zemel, R., and Culotta, A., editors, Advances in Neural Information Processing Systems 23, volume 23, pages 2226-2234.
  8. Weickert, J. and Schnörr, C. (2001). Variational Optic Flow Computation with a Spatio-Temporal Smoothness Constraint. Journal of Mathematical Imaging and Vision, 14(3):245-255.
Download


Paper Citation


in Harvard Style

Sánchez J., Salgado A. and Monzón N. (2013). Optical Flow Estimation with Consistent Spatio-temporal Coherence Models . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2013) ISBN 978-989-8565-48-8, pages 366-369. DOI: 10.5220/0004199903660369


in Bibtex Style

@conference{visapp13,
author={Javier Sánchez and Agustín Salgado and Nelson Monzón},
title={Optical Flow Estimation with Consistent Spatio-temporal Coherence Models},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2013)},
year={2013},
pages={366-369},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004199903660369},
isbn={978-989-8565-48-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2013)
TI - Optical Flow Estimation with Consistent Spatio-temporal Coherence Models
SN - 978-989-8565-48-8
AU - Sánchez J.
AU - Salgado A.
AU - Monzón N.
PY - 2013
SP - 366
EP - 369
DO - 10.5220/0004199903660369