Ensemble Kalman Filter based on the Image Structures

Dominique Béréziat, Isabelle Herlin, Yann Lepoittevin


One major limitation of the motion estimation methods that are available in the literature concerns the availability of the uncertainty on the result. This is however assessed by a number of filtering methods, such as the ensemble Kalman filter (EnKF). The paper consequently discusses the use of a description of the displayed structures in an ensemble Kalman filter, which is applied for estimating motion on image acquisitions. An example of such structure is a cloud on meteorological satellite acquisitions. Compared to the Kalman filter, EnKF does not require propagating in time the error covariance matrix associated to the estimation, resulting in reduced computational requirements. However, EnKF is also known for exhibiting a shrinking effect when taking into account the observations on the studied system at the analysis step. Methods are available in the literature for correcting this shrinking effect, but they do not involve the spatial content of images and more specifically the structures that are displayed on the images. Two solutions are described and compared in the paper, which are first a dedicated localization function and second an adaptive domain decomposition. Both methods proved being well suited for fluid flows images, but only the domain decomposition is suitable for an operational setting. In the paper, the two methods are applied on synthetic data and on satellite images of the atmosphere, and the results are displayed and evaluated.


  1. Anderson, J. L. (2007). An adaptive covariance inflation error correction algorithm for ensemble filters. Tellus Series A : Dynamic meteorology and oceanography, 59:210-224.
  2. Anderson, J. L. (2001). An Ensemble Adjustment Kalman Filter for Data Assimilation. Monthly Weather Review, 129(12):2884-2903.
  3. Baker, S., Scharstein, D., Lewis, J. P., Roth, S., Black, M. J., and Szeliski, R. (2011). A database and evaluation methodology for optical flow. International Journal on Computer Vision, 92(1):1-31.
  4. Elad, M. and Feuer, A. (1998). Recursive optical flow estimation - adaptive filtering approach.Journal of Visual Communication and Image Representation, 9(2):199- 138.
  5. Evensen, G. (2003). The ensemble Kalman filter: Theoretical formulation and practical implementation. Ocean Dynamics, 53:343-367.
  6. Franke, U. and Rabe, C. (2005). Kalman filter based depth from motion with fast convergence. In Intelligent Vehicles Symposium.
  7. Franke, U., Rabe, C., Badino, H., and Gehrig, S. (2005). 6d-vision: Fusion of stereo and motion for robust environment perception. In DAGM Symposium.
  8. Hamill, T. M., Whitaker, J. S., and Snyder, C. (2001). Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter. Monthly Weather Review, 129:2776-2790.
  9. Horn, B. and Schunk, B. (1981). Determining optical flow. Artificial Intelligence, 17:185-203.
  10. Horowitz, S. L. and Pavlidis, T. (1976). Picture segmentation by a tree traversal algorithm. Journal ACM, 23(2):368-388.
  11. Houtekamer, P. L. and Mitchell, H. L. (1998). A sequential ensemble Kalman filter for atmospheric data assimilation. Monthly Weather Review, 129:123-137.
  12. Hunt, B. R., Kostelich, E. J., and Szunyogh, I. (2007). Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter. Physica D: Nonlinear Phenomena, 230(1):112-126.
  13. Janjic, T., Nerger, L., Albertella, A., Schröter, J., and Skachko, S. (2011). On domain localization in ensemble-based Kalman filter algorithms. Monthly Weather Review, 139(7):2046-2060.
  14. Kalman, R. E. (1960). A new approach to linear filtering and prediction problems. Transactions of the ASMEJournal of Basic Engineering, 82(Series D):35-45.
  15. Lepoittevin, Y., Herlin, I., and Béréziat, D. (2015). An image-based ensemble kalman filter for motion estimation. In International Conference on Computer Vision Theory and Applications.
  16. Lowe, D. (1999). Object recognition from local scaleinvariant features. In International Conference on Computer Vision.
  17. Miyoshi, T., Yamane, S., and Enomoto, T. (2007). Localizing the error covariance by physical distances within a local ensemble transform Kalman filter (LETKF). Scientific Online Letters on the Atmosphere, 3:8992.
  18. Nerger, L., Danilov, S., Hiller, W., and Schröter, J. (2006). Using sea-level data to constrain a finite-element primitive-equation ocean model with a local SEIK filter. Ocean Dynamics, 56(5-6):634-649.
  19. Oke, P. R., Sakov, P., and Corney, S. P. (2007). Impacts of localisation in the EnKF and EnOI: experiments with a small model. Ocean Dynamics, 57(1):32-45.
  20. Rabe, C., Mller, T., Wedel, A., and Franke, U. (2010). Dense, robust, and accurate motion field estimation from stereo image sequences in real-time. In European Conference on Computer Vision.
  21. Sun, D., Roth, S., and Black, M. (2010). Secrets of optical flow estimation and their principles. In European Conference on Computer Vision, pages 2432-2439.
  22. Tomasi, C. and Kanade, T. (1991). Detection and tracking of point features. Technical Report CMU-CS-91-132, Carngie Mellon University.

Paper Citation

in Harvard Style

Béréziat D., Herlin I. and Lepoittevin Y. (2017). Ensemble Kalman Filter based on the Image Structures . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-227-1, pages 140-150. DOI: 10.5220/0006096201400150

in Bibtex Style

author={Dominique Béréziat and Isabelle Herlin and Yann Lepoittevin},
title={Ensemble Kalman Filter based on the Image Structures},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)},

in EndNote Style

JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)
TI - Ensemble Kalman Filter based on the Image Structures
SN - 978-989-758-227-1
AU - Béréziat D.
AU - Herlin I.
AU - Lepoittevin Y.
PY - 2017
SP - 140
EP - 150
DO - 10.5220/0006096201400150