ADAPTIVE PATCH-BASED INPAINTING FOR IMAGE BLOCK RECOVERY

Yunqiang Liu, Jin Wang, Huanhuan Zhang

Abstract

This paper presents an adaptive patch-based inpainting algorithm for image block recovery in block-based coding image transmission. The proposed approach is based on prior information - patch similarity within the image. By taking advantage of the information, we recover the lost pixels by copying pixel values from the source based on a similarity criterion to keep local continuity. The pixel recovery is performed in a sequential fashion in which the recovered pixels can be used in the recovery process afterwards. In order to alleviate the error propagation with sequential recovery, we proposed an adaptive combination strategy which merges different directional recovered pixels according to the confidence of the estimated recovery performance. Experimental results show that the proposed method provides significant gains in both subjective and objective measurements.

References

  1. Agrafiotis, D., Bull, D., and Canagarajah, C. (2006). Error resilient video coding techniques. IEEE Trans. Circuits Syst. Video Technol., 16(8):960-973.
  2. Arias, P., Caselles, V., and Sapiro, G. (2009). Variational framework for non-local image inpainting. In Proc.EMMCVPR, pages 345-358, Bonn, Germany.
  3. Bertalmio, M., Sapiro, G., Caselles, V., and Ballester, C. (2000). Image inpainting. In Proc. Computer Graphics (SIGGRAPH 2000), pages 417-424.
  4. Bertalmio, M., Vese, L., Sapiro, G., and Osher, S. (2003).
  5. IEEE Trans. on Image Processing, 12(8):882-889.
  6. Chan, T. and Shen, J. (2001). Mathematical models for local nontexture inpainting. SIAM J. Appl. Math., 62(3):1019-1043.
  7. Criminisi, A. and Perez, P. (2003). Object removal by exemplar-based inpainting. In Proc. Int. Conf. Comp. Vision Pattern Rec., pages 721-728, Madison, WI.
  8. Efros, A. and Leung, T. (1999). Texture synthesis by nonparametric sampling. In Proc. Int. Conf. Computer Vision, pages 1033-1038, Kerkyra, Greece.
  9. Gao, Y., Wang, J., Liu, Y., Yang, X., and Wang, J. (2007). Spatial error concealment technique using verge points. In Proc. IEEE ICASSP, pages 309-312, Honolulu, HI.
  10. Hong, M. C., Scwab, H., Kondi, L., and Katsaggelos, A. K. (1999). Error concealment algorithms for compressed video. Signal Processing: Image Communication, 14:473-492.
  11. Kim, W., Koo, J., and Jeong, J. (2006). Fine directional interpolation for spatial error concealment. IEEE Trans. Consumer Electronics, 52(3):1050-1055.
  12. Kung, W.-Y., Kim, C.-S., and Kuo, C.-C. J. (2006). Spatial and temporal error concealment techniques for video transmission over noisy channels. IEEE Trans. Circuits Syst. Video Technol., 16:789-802.
  13. Li, X. and Orchard, M. T. (2002). Novel sequential errorrecovery techniques utilizing orientation adaptive interpolation. IEEE Trans. Circuits Syst. Video Technol., 12(10):857-864.
  14. Rane, S. D., Remus, J., and Sapiro, G. (2002). Waveletdomain reconstruction of lost blocks in wireless image transmission and packet-switched networks. In Proc.IEEE ICIP, pages 309-312, Rochester, NY.
  15. Sullivan, G. J. and Wiegand, T. (2005). Video compression - from concepts to the H.264/AVC standard. Proceedings of the IEEE, 93(1):18-31.
  16. Wang, Y., Hannuksela, M. M., Varsa, V., Hourunranta, A., and Gabbouj, M. (2002). The error concealment feature in the H.26L test model. In Proc. IEEE ICIP, pages 729-732, Rochester, NY.
  17. Wang, Y., Wenger, S., , and Katsaggelos, A. K. (2000). Error resilient video coding techniques. IEEE Signal Processing Mag., 17(4):61-82.
  18. Wang, Y. and Zhu, Q.-F. (1998). Error control and concealment for video communication: A review. Proceedings of the IEEE, 86(5):974-997.
  19. Wang, Z., Yu, Y., and Zhang, D. (1998). Best neighborhood matching: An information loss restoration technique for block-based image coding systems. IEEE Trans. on Image Processing, 7(7):1056-1061.
Download


Paper Citation


in Harvard Style

Liu Y., Wang J. and Zhang H. (2010). ADAPTIVE PATCH-BASED INPAINTING FOR IMAGE BLOCK RECOVERY . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2010) ISBN 978-989-674-028-3, pages 52-59. DOI: 10.5220/0002832000520059


in Bibtex Style

@conference{visapp10,
author={Yunqiang Liu and Jin Wang and Huanhuan Zhang},
title={ADAPTIVE PATCH-BASED INPAINTING FOR IMAGE BLOCK RECOVERY},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2010)},
year={2010},
pages={52-59},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002832000520059},
isbn={978-989-674-028-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2010)
TI - ADAPTIVE PATCH-BASED INPAINTING FOR IMAGE BLOCK RECOVERY
SN - 978-989-674-028-3
AU - Liu Y.
AU - Wang J.
AU - Zhang H.
PY - 2010
SP - 52
EP - 59
DO - 10.5220/0002832000520059