Dynamic Latent Scale for GAN Inversion

Jeongik Cho, Adam Krzyzak

2022

Abstract

When the latent random variable of GAN is an i.i.d. random variable, the encoder trained with mean squared error loss to invert the generator does not converge because the generator loses the information of the latent random variable. In this paper, we introduce a dynamic latent scale GAN, a method for training a generator that does not lose the information of the latent random variable, and an encoder that inverts the generator. Dynamic latent scale GAN dynamically scales each element of the latent random variable during GAN training to adjust the entropy of the latent random variable. As training progresses, the entropy of the latent random variable decreases until the generator does not lose the information of the latent random variable, which enables the encoder trained with squared error loss to converge. The scale of the latent random variable is approximated by tracing the element-wise variance of the predicted latent random variable from previous training steps. Since the scale of latent random variable changes dynamically, the encoder should be trained with the generator during GAN training. The encoder can be integrated with the discriminator, and the loss for the encoder is added to the generator loss for fast training.

Paper Citation

in Harvard Style

Cho J. and Krzyzak A. (2022). Dynamic Latent Scale for GAN Inversion. In Proceedings of the 11th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-549-4, pages 221-228. DOI: 10.5220/0010816800003122

in Bibtex Style

@conference{icpram22,
author={Jeongik Cho and Adam Krzyzak},
title={Dynamic Latent Scale for GAN Inversion},
booktitle={Proceedings of the 11th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2022},
pages={221-228},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010816800003122},
isbn={978-989-758-549-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Dynamic Latent Scale for GAN Inversion
SN - 978-989-758-549-4
AU - Cho J.
AU - Krzyzak A.
PY - 2022
SP - 221
EP - 228
DO - 10.5220/0010816800003122