An Image-based Ensemble Kalman Filter for Motion Estimation

Yann Lepoittevin, Isabelle Herlin, Dominique Béréziat

2015

Abstract

This paper designs an Image-based Ensemble Kalman Filter (IEnKF), whose components are defined only from image properties, to estimate motion on image sequences. The key elements of this filter are, first, the construction of the initial ensemble, and second, the propagation in time of this ensemble on the studied temporal interval. Both are analyzed in the paper and their impact on results is discussed with synthetic and real data experiments. The initial ensemble is obtained by adding a Gaussian vector field to an estimate of motion on the first two frames. The standard deviation of this normal law is computed from motion results given by a set of optical flow methods of the literature. It describes the uncertainty on the motion value at initial date. The propagation in time of the ensemble members relies on the following evolution laws: transport by velocity of the image brightness function and Euler equations for the motion function. Shrinking of the ensemble is avoided thanks to a localization method and the use of observation ensembles, both techniques being defined from image characteristics. This Image-based Ensemble Kalman Filter is quantified on synthetic experiments and applied on traffic and meteorological images.

References

  1. Agullo, E., Demmel, J., Dongarra, J., Hadri, B., Kurzak, J., Langou, J., Ltaief, H., Luszczek, P., and Tomov, S. (2009). Numerical linear algebra on emerging architectures: The PLASMA and MAGMA projects. Journal of Physics: Conference Series, 180(1):012037.
  2. Anderson, J. L. (2007). An adaptive covariance inflation error correction algorithm for ensemble filters. Tellus A, 59:210-224.
  3. Anderson, J. L. and Anderson, S. L. (1999). A Monte Carlo implementation of the nonlinear filtering problem to produce ensemble assimilations and forecasts. Monthly Weather Review, 127:2741-2758.
  4. Baker, S., Scharstein, D., Lewis, J., Roth, S., Black, M., and Szeliski, R. (2011). A Database and Evaluation Methodology for Optical Flow. International Journal on Computer Vision, 92(1):131.
  5. Béréziat, D. and Herlin, I. (2011). Solving ill-posed image processing problems using data assimilation. Numerical Algorithms, 56(2):219-252.
  6. Beyou, S., Cuzol, A., Gorthi, S. S., and Mémin, E. (2012). Weighted ensemble transform Kalman filter for image assimilation. Tellus A, 65.
  7. Black, M. J. and Anandan, P. (1996). The robust estimation of multiple motions: Parametric and piecewisesmooth flow fields. Computer Vision and Image Understanding, 63(1):75 - 104.
  8. Brankart, J.-M., Testut, C.-E., Brasseur, P., and Verron, J. (2003). Implementation of a multivariate data assimilation scheme for isopycnic coordinate ocean models: Application to a 1993-1996 hindcast of the North Atlantic Ocean circulation. Journal of Geophysical Research: Oceans, 108.
  9. Brox, T., Bruhn, A., Papenberg, N., and Weickert, J. (2004). High accuracy optical flow estimation based on a theory for warping. In Springer-Verlag, editor, Proceedings of European Conference on Computer Vision, volume 4, pages 25-36, Prague, Czech Republic.
  10. Evensen, G. (2003). The ensemble Kalman filter: Theoretical formulation and practical implementation. Ocean Dynamics, 53:343-367.
  11. Hamill, T. M., Whitaker, J. S., and Snyder, C. (2001). Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter. Monthly Weather Review, 129:2776-2790.
  12. Haugen, V. E. J. and Evensen, G. (2002). Assimilation of SLA and SST data into an OGCM for the Indian Ocean. Ocean Dynamics, 52(3):133-151.
  13. Horn, B. and Schunk, B. (1981). Determining optical flow. Artificial Intelligence, 17:185-203.
  14. Houtekamer, P. L. and Mitchell, H. L. (1998). Data assimilation using an ensemble Kalman filter technique. Monthly Weather Review, 128:796-811.
  15. http://i21www.ira.uka.de/image sequences/ (1995). Nibelungen-platz.
  16. Kalman, R. E. (1960). A new approach to linear filtering and prediction problems. Transactions of the ASMEJournal of Basic Engineering, 82(Series D):35-45.
  17. Li, Y. and Osher, S. (2009). A new median formula with applications to PDE based denoising. Communication in Mathematical Sciences, 7(3):741-753.
  18. Mac Aodha, O., Brostow, G., and Pollefeys, M. (2010). Segmenting video into classes of algorithmsuitability. In Proceedings of Conference on Computer Vision and Pattern Recognition, pages 1054- 1061.
  19. Oke, P. R., Sakov, P., and Corney, S. P. (2007). Impacts of localisation in the EnKF and EnOI: experiments with a small model. Ocean Dynamics, 57(1):32-45.
  20. Papadakis, N., Corpetti, T., and Mémin, E. (2007). Dynamically consistent optical flow estimation. In Proceedings of International Conference on Computer Vision, Rio de Janeiro, Brazil.
  21. Sakov, P. and Oke, P. R. (2008). A deterministic formulation of the ensemble Kalman filter: An alternative to ensemble square root filters. Tellus.
  22. Sun, D., Roth, S., and Black, M. (2010). Secrets of optical flow estimation and their principles. In Proceedings of European Conference on Computer Vision, pages 2432-2439.
  23. Titaud, O., Vidard, A., Souopgui, I., and Le Dimet, F.-X. (2010). Assimilation of image sequences in numerical models. Tellus A, 62:30-47.
Download


Paper Citation


in Harvard Style

Lepoittevin Y., Herlin I. and Béréziat D. (2015). An Image-based Ensemble Kalman Filter for Motion Estimation . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-091-8, pages 437-445. DOI: 10.5220/0005259804370445


in Bibtex Style

@conference{visapp15,
author={Yann Lepoittevin and Isabelle Herlin and Dominique Béréziat},
title={An Image-based Ensemble Kalman Filter for Motion Estimation},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={437-445},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005259804370445},
isbn={978-989-758-091-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015)
TI - An Image-based Ensemble Kalman Filter for Motion Estimation
SN - 978-989-758-091-8
AU - Lepoittevin Y.
AU - Herlin I.
AU - Béréziat D.
PY - 2015
SP - 437
EP - 445
DO - 10.5220/0005259804370445