Context-aware Patch-based Method for Façade Inpainting

Benedikt Kottler, Dimitri Bulatov, Zhang Xingzi

2020

Abstract

Realistic representations of 3D urban scenes is an important aspect of scene understanding and has many applications. Given untextured polyhedral Level-of-Detail 2 (LoD2) models of building and imaging containing façade textures, occlusions caused by foreground objects are an essential disturbing factor of façade textures. We developed a modification of a well-known patch-based inpainting method and used the knowledge about façade details in order to improve the façade inpainting of occlusions. Our modification focuses on suppression of undesired, superfluous repetitions of textures. To achieve this, a coarse inpainting result by a structural-based method is used to influence the choice of the best patch so that homogeneous regions are preferred. The coarse inpainting is calculated using the context knowledge and average color instead of traditionally applied arbitrary structural inpainting. Our modification furthermore introduces a parameter that allows to weight the influence of the coarse inpainting. A parameter study shows that this parameter can be chosen intuitively and does not require any parameter choice method. The cleaned façade textures could be successfully integrated into the accordingly adjusted building models thus upgrading them to LoD3.

Paper Citation

in Harvard Style

Kottler B., Bulatov D. and Xingzi Z. (2020). Context-aware Patch-based Method for Façade Inpainting. In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 1: GRAPP; ISBN 978-989-758-402-2, SciTePress, pages 210-218. DOI: 10.5220/0008874802100218

in Bibtex Style

@conference{grapp20,
author={Benedikt Kottler and Dimitri Bulatov and Zhang Xingzi},
title={Context-aware Patch-based Method for Façade Inpainting},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 1: GRAPP},
year={2020},
pages={210-218},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008874802100218},
isbn={978-989-758-402-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 1: GRAPP
TI - Context-aware Patch-based Method for Façade Inpainting
SN - 978-989-758-402-2
AU - Kottler B.
AU - Bulatov D.
AU - Xingzi Z.
PY - 2020
SP - 210
EP - 218
DO - 10.5220/0008874802100218
PB - SciTePress