Towards Unsupervised Image Harmonisation

Alan Dolhasz, Carlo Harvey, Ian Williams

2020

Abstract

The field of image synthesis intrinsically relies on the process of image compositing. This process can be automatic or manual, and depends upon artistic intent. Compositing can introduce errors, due to human-detectable differences in the general pixel level transforms of component elements of an image composite. We report on a pilot study evaluating a proof-of-concept automatic image composite harmonisation system consisting of a state-of-the-art deep harmonisation model and a perceptually-based composite luminance artifact detector. We evaluate the performance of both systems on a large data-set of 68128 automatically generated image composites and find that without any task-specific adaptations, the end-to-end system achieves comparable results to the baseline harmoniser fed with ground truth composite masks. We discuss these findings in the context of extending this to an end-to-end, multi-task system.

Paper Citation

in Harvard Style

Dolhasz A., Harvey C. and Williams I. (2020). Towards Unsupervised Image Harmonisation. In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP; ISBN 978-989-758-402-2, SciTePress, pages 574-581. DOI: 10.5220/0009354705740581

in Bibtex Style

@conference{visapp20,
author={Alan Dolhasz and Carlo Harvey and Ian Williams},
title={Towards Unsupervised Image Harmonisation},
booktitle={Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP},
year={2020},
pages={574-581},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009354705740581},
isbn={978-989-758-402-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2020) - Volume 5: VISAPP
TI - Towards Unsupervised Image Harmonisation
SN - 978-989-758-402-2
AU - Dolhasz A.
AU - Harvey C.
AU - Williams I.
PY - 2020
SP - 574
EP - 581
DO - 10.5220/0009354705740581
PB - SciTePress