loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Authors: Ivan Pereira-Sánchez 1 ; 2 ; Eloi Sans 1 ; Julia Navarro 1 ; 2 and Joan Duran 1 ; 2

Affiliations: 1 Departament de Ciències Matemàtiques i Informàtica, Universitat de les Illes Balears (UIB), Spain ; 2 Institute of Applied Computing and Community Code (IAC3), Spain

Keyword(s): Unfolding, Multi-Head Attention, Image Super-Resolution, Variational Methods, Nonlocal Regularization, Self-Similarity.

Abstract: Classical variational methods for solving image processing problems are more interpretable and flexible than pure deep learning approaches, but their performance is limited by the use of rigid priors. Deep unfolding networks combine the strengths of both by unfolding the steps of the optimization algorithm used to estimate the minimizer of an energy functional into a deep learning framework. In this paper, we propose an unfolding approach to extend a variational model exploiting self-similarity of natural images in the data fidelity term for single-image super-resolution. The proximal, downsampling and upsampling operators are written in terms of a neural network specifically designed for each purpose. Moreover, we include a new multi-head attention module to replace the nonlocal term in the original formulation. A comprehensive evaluation covering a wide range of sampling factors and noise realizations proves the benefits of the proposed unfolding techniques. The model shows to bett er preserve image geometry while being robust to noise. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.133.157.231

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Pereira-Sánchez, I.; Sans, E.; Navarro, J. and Duran, J. (2024). Beyond Variational Models and Self-Similarity in Super-Resolution: Unfolding Models and Multi-Head Attention. In Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP; ISBN 978-989-758-679-8; ISSN 2184-4321, SciTePress, pages 190-198. DOI: 10.5220/0012395400003660

@conference{visapp24,
author={Ivan Pereira{-}Sánchez. and Eloi Sans. and Julia Navarro. and Joan Duran.},
title={Beyond Variational Models and Self-Similarity in Super-Resolution: Unfolding Models and Multi-Head Attention},
booktitle={Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP},
year={2024},
pages={190-198},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012395400003660},
isbn={978-989-758-679-8},
issn={2184-4321},
}

TY - CONF

JO - Proceedings of the 19th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP
TI - Beyond Variational Models and Self-Similarity in Super-Resolution: Unfolding Models and Multi-Head Attention
SN - 978-989-758-679-8
IS - 2184-4321
AU - Pereira-Sánchez, I.
AU - Sans, E.
AU - Navarro, J.
AU - Duran, J.
PY - 2024
SP - 190
EP - 198
DO - 10.5220/0012395400003660
PB - SciTePress