# IMAGE INPAINTING CONSIDERING BRIGHTNESS CHANGE AND SPATIAL LOCALITY OF TEXTURES

### Norihiko Kawai, Tomokazu Sato, Naokazu Yokoya

#### Abstract

Image inpainting is a tequnique for removing undesired visual objects in images and filling the missing regions with plausible textures. Conventionally, the missing parts of an image are completed by optimizing the objective function, which is defined based on pattern similarity between the missing region and the rest of the image (data region). However, unnatural textures are easily generated due to two factors: (1) available samples in the data region are quite limited, and (2) pattern similarity is one of the required conditions but is not sufficient for reproducing natural textures. In this paper, in order to improve the image quality of completed texture, the objective function is extended by allowing brightness changes of sample textures (for (1)) and introducing spatial locality as an additional constraint (for (2)). The effectiveness of these extensions is successfully demonstrated by applying the proposed method to one hundred images and comparing the results with those obtained by the conventional methods.

#### References

- A. Criminisi, P. Pérez, and K. Toyama (2004). Region Filling and Object Removal by Exemplar-Based Image Inpainting. In Trans. on Image Processing, volume 13, No. 9, pages 1200-1212.
- A. Levin, A. Zomet, and Y. Weiss (2003). Learning How to Inpaint from Global Image Statistics. In Proc. ICCV, volume 1, pages 305-312.
- A.A. Efros and T.K. Leung (1999). Texture Synthesis by Non-parametric Sampling. In Proc. ICCV, pages 1033-1038.
- A.N. Hirani and T. Totsuka (1996). Combining Frequency and Spatial Domain Information for Fast Interactive Image Noise Removal. In Proc. SIGGRAPH1996, pages 269-276.
- B. Li, Y. Qi, and X. Shen (2005). An Image Inpainting Method. In Proc. IEEE Int. Conf. on Computer Aided Design and Computer Graphics, pages 531-536.
- C. Allène and N. Paragios (2006). Image Renaissance Using Discrete Optimization. In Proc. ICPR, pages 631- 634.
- C. Ballester, M. Bertalmio, V. Sapiro, and J. Verdera (2001a). Filling-In by Joint Interpolation of Vector Fields and Gray Levels. In Trans. on Image Processing, volume 10, No. 8, pages 1200-1211.
- C. Ballester, V. Caselles, J. Verdera, M. Bertalmio, and G. Sapiro (2001b). A Variational Model for Filling-In Gray Level and Color Images. In Proc. ICCV, pages 10-16.
- D. Tschumperlé (2006). Curvature-Preserving Regularization of Multi-valued Images Using PDE's. In Proc. ECCV, volume 2, pages 295-307.
- E. Villéger, G. Aubert, and L. Blanc-Féraud (2004). Image Disocclusion Using a Probabilistic Gradient Orientation. In Proc. ICPR, volume 2, pages 52-55.
- I. Drori, D. Cohen-Or, and H. Yeshurun (2003). FragmentBased Image Completion. In Proc. SIGGRAPH2003, pages 303-312.
- J. Jia and C. Tang (2003). Image Repairing: Robust Image Synthesis by Adaptive ND Tensor Voting. In Proc. CVPR, pages 643-650.
- J. Sun, L. Yuan, J. Jia, and H. Shum (2005). Image Completion with Structure Propagation. In Proc. SIGGRAPH2005, pages 861-868.
- M. Bertalmio, A. L. Bertozzi, and G. Sapiro (2001). NavierStokes, Fluid Dynamics, and Image and Video Inpainting. In Proc. CVPR, pages 355-362.
- M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballester (2000). Image Inpainting. In Proc. SIGGRAPH2000, pages 417-424.
- N. Komodakis and G. Tziritas (2006). Image Completion Using Global Optimization. In Proc. CVPR, pages 442-452.
- R. Bornard, E. Lecan, L. Laborelli, and J. Chenot (2002). Missing Data Correction in Still Images and Image Sequences. In Proc. ACM Int. Conf. on Multimedia, pages 355-361.
- S. Esedoglu and J. Shen (2003). Digital Inpainting Based on the Mumford-shah-euler Image Model. In European J. of Applied Mathematics, volume 13, pages 353-370.
- S. Masnou and J.M. Morel (1998). Level Lines Based Disocclusion. In Proc. ICIP, volume 3, pages 259-263.
- S.D. Rane, J. Remus, and G. Sapiro (1996). WaveletDomain Reconstruction of Lost Blocks in Wireless Image Transmission and Packet-Switched. In Proc. ICIP, volume 1, pages 309-312.
- T. Amano (2004). Image Interpolation by High Dimensional Projection Based on Subspace Method. In Proc. ICPR, volume 4, pages 665-668.
- T. Chan and J. Shen (2001). Non-texture Inpainting by Curvature-Driven Diffusions (CDD). In J. of Visual Communication and Image Representation, volume 12, No. 4, pages 436-449.
- T. Chan, S. Kang, J. Shen, and S. Osher (2002). Euler's Elastica and Curvature Based Inpaintings. In SIAM J. of Applied Mathematics, volume 63, No. 2, pages 564-592.
- Y. Wexler, E. Shechtman, and M. Irani (2007). Space-Time Completion of Video. In Trans. on Pattern Analysis and Machine Intelligence, volume 29, No. 3, pages 463-476.

#### Paper Citation

#### in Harvard Style

Kawai N., Sato T. and Yokoya N. (2008). **IMAGE INPAINTING CONSIDERING BRIGHTNESS CHANGE AND SPATIAL LOCALITY OF TEXTURES** . In *Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)* ISBN 978-989-8111-21-0, pages 66-73. DOI: 10.5220/0001075200660073

#### in Bibtex Style

@conference{visapp08,

author={Norihiko Kawai and Tomokazu Sato and Naokazu Yokoya},

title={IMAGE INPAINTING CONSIDERING BRIGHTNESS CHANGE AND SPATIAL LOCALITY OF TEXTURES},

booktitle={Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)},

year={2008},

pages={66-73},

publisher={SciTePress},

organization={INSTICC},

doi={10.5220/0001075200660073},

isbn={978-989-8111-21-0},

}

#### in EndNote Style

TY - CONF

JO - Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)

TI - IMAGE INPAINTING CONSIDERING BRIGHTNESS CHANGE AND SPATIAL LOCALITY OF TEXTURES

SN - 978-989-8111-21-0

AU - Kawai N.

AU - Sato T.

AU - Yokoya N.

PY - 2008

SP - 66

EP - 73

DO - 10.5220/0001075200660073