Simultaneous Estimation of Optical Flow and Its Boundaries based on the Dynamical System Model

Yuya Michishita, Noboru Sebe, Shuichi Enokida, Eitaku Nobuyama

2017

Abstract

Optical flow is a velocity vector which represents the motion of objects in video images. Optical flow estimation is difficult in the neighborhood of flow boundary. To resolve this problem, Sasagawa (2014) proposes a modified dynamical system model in which one assumes that, in the neighborhood of flow boundaries, the brightness flows in the perpendicular direction, and considers the resulting corrections to the brightness constancy constraint. However, in that model, the correction is occurred even in place where the flow is continuous. We propose a new model, which switches the conventional model and the proposed model in Sasagawa (2014). As a result, we expect improvement of the estimate accuracy in place where the flow is continuous. We conduct numerical experiments to investigate the improvements that the proposed model yields in the estimation accuracy of optical flows.

References

  1. Brox, T., Bruhn, A., Pepenberg, N., and Weickert, J. (2004). High accuracy optical flow estimation based on a theory for warping. European Conference on Computer Vision (ECCV), pages 25-36.
  2. Butler, D. J., Wulff, J., Stanley, G. B., and Black, M. J. (2012). A naturalistic open source movie for optical flow evaluation. Conf. on Computer Vision (ECCV), pages 611-625.
  3. Fukami, T., Enokida, S., Sebe, N., and Nobuyama, E. (2011). Quasi-dense optical flow estimation based on dynamical system models. SICE Annual Conference, pages 802-811.
  4. Horn, B. K. P. and Schunck, B. G. (1981). Determining optical flow. Artificial Intelligence , pages 185-203.
  5. Lucas, K. and Kanade, T. (1981). An interactive image registration techniques with an application to stereo vision. In Proceedings of 7th IJCAL, pages 674-679.
  6. Sasagawa, T. (2014). Optical flow estimation accuracy improvement in the flow near the boundary. Kyushu Institute of Technology Graduate School of master's thesis.
  7. Sasagawa, T., Sebe, N., Enokida, S., Nobuyama, E., and Fukami, T. (2013). Improvement of the accuracy of the optical flow estimation by simultaneous estimation of flow boundary. The 32nd SICE Kyushu Branch Annual Conference, pages 151-154.
  8. Sebe, N., Nobuyama, E., and Enokida, S. (2009). Optical flow estimation method in the moving image by the dynamic systems theory approach. The 38th Symposium on Control Theory, pages 357-362.
  9. Thomas Brox, J. W. (2002). Nonlinear matrix diffusion for optic flow estimation. Pattern Recognition (Proc. DAGM), pages 446-453.
Download


Paper Citation


in Harvard Style

Michishita Y., Sebe N., Enokida S. and Nobuyama E. (2017). Simultaneous Estimation of Optical Flow and Its Boundaries based on the Dynamical System Model . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-227-1, pages 377-385. DOI: 10.5220/0006101303770385


in Bibtex Style

@conference{visapp17,
author={Yuya Michishita and Noboru Sebe and Shuichi Enokida and Eitaku Nobuyama},
title={Simultaneous Estimation of Optical Flow and Its Boundaries based on the Dynamical System Model},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)},
year={2017},
pages={377-385},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006101303770385},
isbn={978-989-758-227-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)
TI - Simultaneous Estimation of Optical Flow and Its Boundaries based on the Dynamical System Model
SN - 978-989-758-227-1
AU - Michishita Y.
AU - Sebe N.
AU - Enokida S.
AU - Nobuyama E.
PY - 2017
SP - 377
EP - 385
DO - 10.5220/0006101303770385