Exploration and Validation of Specialized Loss Functions for Generative Visual-Thermal Image Domain Transfer

Simon Fischer, Benedikt Kottler, Eva Strauß, Dimitri Bulatov

2025

Abstract

This paper presents an enhanced approach to visual-to-thermal image translation using an improved InfraGAN model, incorporating additional loss functions to increase realism and fidelity in generated thermal images. Building on the existing InfraGAN architecture, we introduce perceptual, style, and discrete Fourier transform (DFT) losses, aiming to capture intricate image details and enhance texture and frequency consistency. Our model is trained and evaluated on the FLIR Adas dataset, providing paired visual and thermal images across diverse contexts, from urban traffic scenes. To optimize the interplay of loss functions, we employ hyperparameter tuning with the Optuna library, achieving an optimal balance among the components of the loss function. First, experimental results show that these modifications lead to significant improvements in the quality of generated thermal images, underscoring the potential of advanced loss functions for domain transfer tasks. This work contributes a refined framework for generating high-quality thermal imagery, with implications for fields such as surveillance, autonomous driving, and facial recognition in challenging environmental conditions.

Paper Citation

in Harvard Style

Fischer S., Kottler B., Strauß E. and Bulatov D. (2025). Exploration and Validation of Specialized Loss Functions for Generative Visual-Thermal Image Domain Transfer. In Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: VISAPP; ISBN 978-989-758-728-3, SciTePress, pages 527-534. DOI: 10.5220/0013274400003912

in Bibtex Style

@conference{visapp25,
author={Simon Fischer and Benedikt Kottler and Eva Strauß and Dimitri Bulatov},
title={Exploration and Validation of Specialized Loss Functions for Generative Visual-Thermal Image Domain Transfer},
booktitle={Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: VISAPP},
year={2025},
pages={527-534},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013274400003912},
isbn={978-989-758-728-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 2: VISAPP
TI - Exploration and Validation of Specialized Loss Functions for Generative Visual-Thermal Image Domain Transfer
SN - 978-989-758-728-3
AU - Fischer S.
AU - Kottler B.
AU - Strauß E.
AU - Bulatov D.
PY - 2025
SP - 527
EP - 534
DO - 10.5220/0013274400003912
PB - SciTePress