EXEMPLAR-BASED INPAINTING WITH ROTATION INVARIANT PATCH MATCHING

Jiří Boldyš, Bernard Besserer

2006

Abstract

In this paper, we propose a novel approach to patch matching in exemplar-based inpainting. Our field of concern is movie restoration, particularly scratch concealment. Here we want to focus on a single frame (still image) inpainting. Exemplar-based approach uses patches from the known areas and copies their content to the damaged area. In case of irregular texture, there might be no patches available, so that the result would be visually acceptable. One way to increase the number of available patches is to rotate them. In most of the exemplar-based approaches, a target patch is not complete and a source patch has to be rotated and compared at every single angle. We overcome this inefficiency using a clue image, which comes from previous processing stages. We use moments of patches from this clue image, normalized to rotation, to reject apparently dissimilar patches, and to calculate the approximate angle of rotation, which has to be performed only once. In this paper, we provide justification for this simplification. We have no ambitions to provide a complete inpainting algorithm here.

References

  1. Bertalmio, M., Sapiro, G., Caselles, V., and Ballester, C. (2000). Image inpainting. In Akeley, K., editor, Siggraph 2000, Computer Graphics Proceedings, pages 417-424. ACM Press / ACM SIGGRAPH / Addison Wesley Longman.
  2. Bertalmio, M., Vese, L., Sapiro, G., and Osher, S. (2003). Simultaneous structure and texture image inpainting. In CVPR'03, IEEE Computer Society Conference on Computer Vision and Pattern Recognition.
  3. Chan, T. F., Kang, S. H., and Shen, J. (2002). Euler's Elastica and curvature-based inpainting. SIAM Journal of Applied Mathematics, 63(2):564-592.
  4. Chan, T. F. and Shen, J. (2001). Non-texture inpainting by curvature-driven diffusions. Journal of Visual Communication abd Image Representation, 12(4):436- 449.
  5. Criminisi, A., Pérez, P., and Toyama, K. (2004). Region filling and object removal by exemplar-based image inpainting. IEEE Transactions on Image Processing, 13(9):1-13.
  6. Drori, I., Cohen-Or, D., and Yeshurun, H. (2003). Fragment-based image completion. ACM Transactions on Graphics, 22(3):303-312.
  7. Flusser, J. (2000). On the independence of rotation moment invariants. Pattern Recognition, 33(9):1405-1410.
  8. Joyeux, L., Boukir, S., and Besserer, B. (2002). Tracking and map reconstruction of line scratches in degraded motion pictures. Machine Vision and Applications, 13(3):119-128.
  9. Suk, T. and Flusser, J. (2005). Image normalization by complex moments. In et al., B.-T. J., editor, Proc. Int'l. Conf. ACIVS'05, volume LNCS 3708, pages 100-107. Springer.
  10. Zhang, Y., Xiao, J., and Shah, M. (2004). Region completion in a single image. In Eurographics.
  11. Zitová, B. and Flusser, J. (2003). Image registration methods: a survey. Image and Vision Computing, 21:977- 1000.
Download


Paper Citation


in Harvard Style

Boldyš J. and Besserer B. (2006). EXEMPLAR-BASED INPAINTING WITH ROTATION INVARIANT PATCH MATCHING . In Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, ISBN 972-8865-40-6, pages 115-120. DOI: 10.5220/0001376801150120


in Bibtex Style

@conference{visapp06,
author={Jiří Boldyš and Bernard Besserer},
title={EXEMPLAR-BASED INPAINTING WITH ROTATION INVARIANT PATCH MATCHING},
booktitle={Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP,},
year={2006},
pages={115-120},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001376801150120},
isbn={972-8865-40-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP,
TI - EXEMPLAR-BASED INPAINTING WITH ROTATION INVARIANT PATCH MATCHING
SN - 972-8865-40-6
AU - Boldyš J.
AU - Besserer B.
PY - 2006
SP - 115
EP - 120
DO - 10.5220/0001376801150120