Training Methods for Regularizing Gradients on Multi-Task Image Restoration Problems

Samuel Willingham, Samuel Willingham, Mårten Sjöström, Christine Guillemot

2024

Abstract

Inverse problems refer to the task of reconstructing a clean signal from a degraded observation. In imaging, this pertains to restoration problems like denoising, super-resolution or in-painting. Because inverse problems are often ill-posed, regularization based on prior information is needed. Plug-and-play (pnp) approaches take a general approach to regularization and plug a deep denoiser into an iterative solver for inverse problems. However, considering the inverse problems at hand in training could improve reconstruction performance at test-time. Deep equilibrium models allow for the training of multi-task priors on the reconstruction error via an estimate of the iterative method’s fixed-point (FP). This paper investigates the intersection of pnp and DEQ models for the training of a regularizing gradient (RG) and derives an upper bound for the reconstruction loss of a gradient-descent (GD) procedure. Based on this upper bound, two procedures for the training of RGs are proposed and compared: One optimizes the upper bound directly, the other trains a deep equilibrium GD (DEQGD) procedure and uses the bound for regularization. The resulting regularized RG (RERG) produces consistently good reconstructions across different inverse problems, while the other RGs tend to have some inverse problems on which they provide inferior reconstructions.

Paper Citation

in Harvard Style

Willingham S., Sjöström M. and Guillemot C. (2024). Training Methods for Regularizing Gradients on Multi-Task Image Restoration Problems. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP; ISBN 978-989-758-679-8, SciTePress, pages 145-153. DOI: 10.5220/0012368100003660

in Bibtex Style

@conference{visapp24,
author={Samuel Willingham and Mårten Sjöström and Christine Guillemot},
title={Training Methods for Regularizing Gradients on Multi-Task Image Restoration Problems},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP},
year={2024},
pages={145-153},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012368100003660},
isbn={978-989-758-679-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP
TI - Training Methods for Regularizing Gradients on Multi-Task Image Restoration Problems
SN - 978-989-758-679-8
AU - Willingham S.
AU - Sjöström M.
AU - Guillemot C.
PY - 2024
SP - 145
EP - 153
DO - 10.5220/0012368100003660
PB - SciTePress