Impact of Hyperparameters on the Generative Adversarial Networks Behavior

Bihi Sabiri, Bouchra El Asri, Maryem Rhanoui

2022

Abstract

Generative adversarial networks (GANs) have become a full-fledged branch of the most important neural network models for unsupervised machine learning. A multitude of loss functions have been developed to train the GAN discriminators and they all have a common structure: a sum of real and false losses which depend only on the real losses and generated data respectively. A challenge associated with an equally weighted sum of two losses is that the formation can benefit one loss but harm the other, which we show causes instability and mode collapse. In this article, we introduce a new family of discriminant loss functions which adopts a weighted sum of real and false parts. With the use the gradients of the real and false parts of the loss, we can adaptively choose weights to train the discriminator in the sense that benefits the stability of the GAN model. Our method can potentially be applied to any discriminator model with a loss which is a sum of the real and fake parts. Our method consists in adjusting the hyper-parameters appropriately in order to improve the training of the two antagonistic models Experiences validated the effectiveness of our loss functions on image generation tasks, improving the base results by a significant margin on dataset Celebdata.

Paper Citation

in Harvard Style

Sabiri B., El Asri B. and Rhanoui M. (2022). Impact of Hyperparameters on the Generative Adversarial Networks Behavior. In Proceedings of the 24th International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 978-989-758-569-2, pages 428-438. DOI: 10.5220/0011115100003179

in Bibtex Style

@conference{iceis22,
author={Bihi Sabiri and Bouchra El Asri and Maryem Rhanoui},
title={Impact of Hyperparameters on the Generative Adversarial Networks Behavior},
booktitle={Proceedings of the 24th International Conference on Enterprise Information Systems - Volume 2: ICEIS,},
year={2022},
pages={428-438},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011115100003179},
isbn={978-989-758-569-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 24th International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - Impact of Hyperparameters on the Generative Adversarial Networks Behavior
SN - 978-989-758-569-2
AU - Sabiri B.
AU - El Asri B.
AU - Rhanoui M.
PY - 2022
SP - 428
EP - 438
DO - 10.5220/0011115100003179