OPTICAL FLOW ESTIMATION WITH CONFIDENCE MEASURES FOR SUPER-RESOLUTION BASED ON RECURSIVE ROBUST TOTAL LEAST SQUARES

Tobias Schuchert, Fabian Oser

Abstract

In this paper we propose a novel optical flow estimation method accompanied by confidence measures. Our main goal is fast and highly accurate motion estimation in regions where information is available and a confidence measure which identifies these regions. Therefore we extend the structure tensor method to robust recursive total least squares (RRTLS) and run it on a GPU for real-time processing. Based on a coarse-to-fine framework we propagate not only the motion estimates to finer scales but also the covariance matrices, which may be used as confidence measures. Experiments on synthetic data show the benefits of our approach. We applied the RRTLS framework to a real-time super-resolution method for deforming objects which incorporates the confidence measures and demonstrates that propagating the covariances through the pyramid improves super-resolution results.

References

  1. Bab-Hadiashar, A. and Suter, D. (1998). Robust optic flow computation. International Journal of Computer Vision, 29(1):59-77.
  2. Baker, S., Scharstein, D., Lewis, J., Roth, S., Black, M., and Szeliski, R. (2011). A database and evaluation methodology for optical flow. International Journal of Computer Vision, pages 1-31. 10.1007/s11263-010- 0390-2.
  3. Barron, J. L., Fleet, D. J., and Beauchemin, S. S. (1994). Performance of optical flow techniques. Int. Journal of Computer Vision, 12:43-77.
  4. Black, M. and Anandan, P. (1996). The robust estimation of multiple motions: parametric and piecewise-smooth flow fields. In Computer Vision and Image Understanding, volume 63(1), pages 75-104.
  5. Boley, D., Steinmetz, E., and Sutherland, K. (1996). Recursive total least squares: An alternative to using the discrete kalman filter in robot navigation. In Reasoning with Uncertainty in Robotics, volume 1093 of Lecture Notes in Computer Science, pages 221-234. Springer Berlin / Heidelberg. 10.1007/BFb0013963.
  6. Bruhn, A. and Weickert, J. (2006). A confidence measure for variational optic flow methods. In Properties for Incomplete data, pages 283-298. Springer.
  7. Chojnacki, W., Brooks, M. J., and Hengel, A. V. D. (2001). Rationalising the renormalisation method of kanatani. Journal of Mathematical Imaging and Vision, 14:21- 38.
  8. Farsiu, S., Robinson, D., Elad, M., and Milanfar, P. (2003). Fast and robust multi-frame super-resolution. IEEE Transactions on Image Processing, 13:1327-1344.
  9. Foerstner, W. and Guelch, E. (1987). A fast operator for detection and precise location of distinct points, corners and centers of circular features. In Proceedings of the ISPRS Intercommission Workshop on Fast Processing of Photogrammetric Data, pages 281-305.
  10. Haussecker, H. and Spies, H. (1999). Motion. In Handbook of Computer Vision and Applications, volume 2, chapter 13, pages 309-396. Academic Press, 1 edition.
  11. Horn, B. and Schunck, B. (1981). Determining optical flow. Artificial Intelligence, 17:185-204.
  12. Kanatani, K. (1996). Statistical Optimization for Geometric Computation: Theory and Practice. Elsevier.
  13. Kondermann, C. (2009). Postprocessing and Restoration of Optical Flows. PhD thesis, Heidelberg University.
  14. Lucas, B. D. and Kanade, T. (1981). An iterative image registration technique with an application to stereo vision. In Proceedings of the 7th international joint conference on Artificial intelligence - Volume 2, pages 674-679, San Francisco, CA, USA.
  15. Nestares, O., Fleet, D. J., and Heeger, D. J. (2000). Likelihood functions and confidence bounds for Total Least Squares estimation. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition (CVPR'2000).
  16. Scharr, H. (2005). Optimal filters for extended optical flow. In Complex Motion, 1. Int. Workshop, G├╝nzburg, Oct. 2004, volume 3417 of Lecture Notes in Computer Science, Berlin. Springer Verlag.
  17. Schuchert, T. (2010). Plant leaf motion estimation using a 5D affine optical flow model. PhD thesis, RWTH Aachen University.
  18. Schuchert, T., Aach, T., and Scharr, H. (2010). Range flow in varying illumination: Algorithms and comparisons. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32:1646-1658.
  19. Senst, T., Eiselein, V., Evangelio, R. H., and Sikora, T. (2011). Robust modified l2 local optical flow estimation and feature tracking. In IEEE Workshop on Motion and Video Computing, pages 685-690, Kona, USA.
  20. Simoncelli, E. P. (1999). Bayesian multi-scale differential optical flow. In Handbook of Computer Vision and Applications, volume 2, chapter 14, pages 397-422. Academic Press, San Diego.
  21. Wang, Z. and Qi, F. (2004). On ambiguities in superresolution modeling. Signal Processing Letters, IEEE, 11(8):678-681.
  22. Weickert, J., Bruhn, A., Brox, T., and Papenberg, N. (2006). A survey on variational optic flow methods for small displacements. In Mathematical Models for Registration and Applications to Medical Imaging, volume 10 of Mathematics in Industry, pages 103-136. Springer Berlin Heidelberg.
  23. Werlberger, M., Trobin, W., Pock, T., Wedel, A., Cremers, D., and Bischof, H. (2009). Anisotropic huber-l1 optical flow. In Proceedings of the British Machine Vision Conference (BMVC), London, UK.
Download


Paper Citation


in Harvard Style

Schuchert T. and Oser F. (2012). OPTICAL FLOW ESTIMATION WITH CONFIDENCE MEASURES FOR SUPER-RESOLUTION BASED ON RECURSIVE ROBUST TOTAL LEAST SQUARES . In Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM, ISBN 978-989-8425-99-7, pages 463-469. DOI: 10.5220/0003785904630469


in Bibtex Style

@conference{icpram12,
author={Tobias Schuchert and Fabian Oser},
title={OPTICAL FLOW ESTIMATION WITH CONFIDENCE MEASURES FOR SUPER-RESOLUTION BASED ON RECURSIVE ROBUST TOTAL LEAST SQUARES},
booktitle={Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM,},
year={2012},
pages={463-469},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003785904630469},
isbn={978-989-8425-99-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 2: ICPRAM,
TI - OPTICAL FLOW ESTIMATION WITH CONFIDENCE MEASURES FOR SUPER-RESOLUTION BASED ON RECURSIVE ROBUST TOTAL LEAST SQUARES
SN - 978-989-8425-99-7
AU - Schuchert T.
AU - Oser F.
PY - 2012
SP - 463
EP - 469
DO - 10.5220/0003785904630469