PhotoHandler: Manipulation of Portrait Images with StyleGANs Using Text

Geral Castillo-Arredondo, Dante Moreno-Carhuacusma, Willy Ugarte

2023

Abstract

There are many methods and approaches used for manipulation of images. However, according to the state of the art, the ones related to StyleGANs has shown better overall results when it comes to this task. In this work, we proposed to use StyleGANs in order to allow the manipulation of portrait images using text. We used a method called StyleCLIP which combine StyleGANs with CLIP, a neural network that connects text and images. This method has two numeric parameters, which are the manipulation strength and the disentanglement threshold. The contribution consists of adjusting these parameters based on the entered text in order to improve the result of the edited image. With this technology, we built an app that will help people with poor digital skills to edit their photos easily by using words. The opinion of the users of the application has been validated through a survey. The results obtained allowed us to demonstrate that our method make a satisfactory image edition for most users.

Paper Citation

in Harvard Style

Castillo-Arredondo G., Moreno-Carhuacusma D. and Ugarte W. (2023). PhotoHandler: Manipulation of Portrait Images with StyleGANs Using Text. In Proceedings of the 20th International Conference on Smart Business Technologies - Volume 1: ICSBT; ISBN 978-989-758-667-5, SciTePress, pages 73-82. DOI: 10.5220/0012123200003552

in Bibtex Style

@conference{icsbt23,
author={Geral Castillo-Arredondo and Dante Moreno-Carhuacusma and Willy Ugarte},
title={PhotoHandler: Manipulation of Portrait Images with StyleGANs Using Text},
booktitle={Proceedings of the 20th International Conference on Smart Business Technologies - Volume 1: ICSBT},
year={2023},
pages={73-82},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012123200003552},
isbn={978-989-758-667-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 20th International Conference on Smart Business Technologies - Volume 1: ICSBT
TI - PhotoHandler: Manipulation of Portrait Images with StyleGANs Using Text
SN - 978-989-758-667-5
AU - Castillo-Arredondo G.
AU - Moreno-Carhuacusma D.
AU - Ugarte W.
PY - 2023
SP - 73
EP - 82
DO - 10.5220/0012123200003552
PB - SciTePress