GenGUI: A Dataset for Automatic Generation of Web User Interfaces Using ChatGPT

Mădălina Dicu, Enol García González, Camelia Chira, José R. Villar

2025

Abstract

The identification of elements in user interfaces is a problem that can generate great interest in current times due to the significant interaction between users and machines. Digital technologies are increasingly used to carry out almost any daily task. Computer vision can be helpful in different applications, such as accessibility, testing, or automatic code generation, to accurately identify the elements that make up a graphical interface. This paper focuses on one problem that affects almost any Deep Learning and computer vision problem, which is the generation and annotation of datasets. Few contributions in the literature provide datasets to train vision models to solve this problem. Moreover, analyzing the literature, most datasets focus on generating images of mobile applications, all in English. In this paper, we propose GenGUI, a new dataset of desktop applications that presents various contents, including multiple languages. Furthermore, this contribution will train different versions of YOLO models using GenGUI to test their quality with reasonably good results.

Paper Citation

in Harvard Style

Dicu M., González E., Chira C. and Villar J. (2025). GenGUI: A Dataset for Automatic Generation of Web User Interfaces Using ChatGPT. In Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART; ISBN 978-989-758-737-5, SciTePress, pages 707-714. DOI: 10.5220/0013177200003890

in Bibtex Style

@conference{icaart25,
author={Mădălina Dicu and Enol González and Camelia Chira and José Villar},
title={GenGUI: A Dataset for Automatic Generation of Web User Interfaces Using ChatGPT},
booktitle={Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART},
year={2025},
pages={707-714},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013177200003890},
isbn={978-989-758-737-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART
TI - GenGUI: A Dataset for Automatic Generation of Web User Interfaces Using ChatGPT
SN - 978-989-758-737-5
AU - Dicu M.
AU - González E.
AU - Chira C.
AU - Villar J.
PY - 2025
SP - 707
EP - 714
DO - 10.5220/0013177200003890
PB - SciTePress