IMPROVEMENT OF MOTION ESTIMATION BY ASSESSING THE ERRORS ON THE EVOLUTION EQUATION

Isabelle Herlin, Dominique Béréziat, Nicolas Mercier

Abstract

Image assimilation methods are nowadays widely used to retrieve motion from image sequences with heuristics on the underlying dynamics. A mathematical model on the temporal evolution of the motion field has to be chosen, according to these heuristics, that approximately describes the evolution of the velocity at a pixel over the sequence. In order to quantify this approximation, we add an error term in the evolution equation of the motion field and design a weak formulation of 4D-Var image assimilation. The designed cost function simultaneously depends on the initial motion field and on the error value at each time step. The BFGS solver performs minimization to retrieve both motion field and errors. The method is evaluated and quantified on twin experiments, as no ground truth would be available for real data. The results demonstrate that the motion field is better estimated thanks to the error control.

References

  1. Béréziat, D. and Herlin, I. (2011). Solving ill-posed image processing problems using data assimilation. Numerical Algorithms, 56(2):219-252.
  2. Béréziat, D., Herlin, I., and Younes, L. (2000). A generalized optical flow constraint and its physical interpretation. In CVPR, pages 487-492.
  3. Byrd, R. H., Lu, P., and Nocedal, J. (1995). A limited memory algorithm for bound constrained optimization. Journal on Scientific and Statistical Computing, 16(5):1190-1208.
  4. Hascoët, L. and Pascual, V. (2004). Tapenade 2.1 user's guide. Technical Report 0300, INRIA.
  5. Horn, B. and Schunk, B. (1981). Determining optical flow. Artificial Intelligence, 17:185-203.
  6. Hundsdorfer, W. and Spee, E. (1995). An efficient horizontal advection scheme for the modeling of global transport of constituents. Monthly Weather Review, 123(12):3,554-3,564.
  7. Isambert, T., Berroir, J., and Herlin, I. (2008). A multiscale vector spline method for estimating the fluids motion on satellite images. In ECCV, pages 665-676. Springer.
  8. Le Dimet, F.-X. and Talagrand, O. (1986). Variational algorithms for analysis and assimilation of meteorological observations: Theoretical aspects. Tellus, 38A:97- 110.
  9. LeVeque, R. (1992). Numerical Methods for Conservative Laws, chapter Godunov's method. Lectures in Mathematics. ETH Z ürich, Birkhaü ser Verlag, 2nd edition.
  10. Papadakis, N., Corpetti, T., and Mémin, E. (2007). Dynamically consistent optical flow estimation. In ICCV, pages 1-7.
  11. Papadakis, N., Mémin, E., and Cao, F. (2005). A variational approach for object contour tracking. In ICCV workshop on variational, geometric and level set methods in computer vision, pages 259-270.
  12. Tikhonov, A. N. (1963). Regularization of incorrectly posed problems. Soviet mathematics - Doklady, 4:1624- 1627.
  13. Titaud, O., Vidard, A., Souopgui, I., and Le Dimet, F.-X. (2010). Assimilation of image sequences in numerical models. Tellus A, 62:30-47.
  14. Trémolet, Y. (2006). Accounting for an imperfect model in 4D-Var. Quaterly Journal of the Royal Meteorological Society, 132(621):2483-2504.
  15. Valur Hó lm, E. (2008). Lectures notes on assimilation algorithms. European Centre for Medium-Range Weather Forecasts Reading.
  16. Wolke, R. and Knoth, O. (2000). Implicit-explicit RungeKutta methods applied to atmospheric chemistrytransport modelling. Environmental Modelling and Software, 15:711-719.
Download


Paper Citation


in Harvard Style

Herlin I., Béréziat D. and Mercier N. (2012). IMPROVEMENT OF MOTION ESTIMATION BY ASSESSING THE ERRORS ON THE EVOLUTION EQUATION . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012) ISBN 978-989-8565-04-4, pages 235-240. DOI: 10.5220/0003815802350240


in Bibtex Style

@conference{visapp12,
author={Isabelle Herlin and Dominique Béréziat and Nicolas Mercier},
title={IMPROVEMENT OF MOTION ESTIMATION BY ASSESSING THE ERRORS ON THE EVOLUTION EQUATION},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012)},
year={2012},
pages={235-240},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003815802350240},
isbn={978-989-8565-04-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2012)
TI - IMPROVEMENT OF MOTION ESTIMATION BY ASSESSING THE ERRORS ON THE EVOLUTION EQUATION
SN - 978-989-8565-04-4
AU - Herlin I.
AU - Béréziat D.
AU - Mercier N.
PY - 2012
SP - 235
EP - 240
DO - 10.5220/0003815802350240