An Evaluation of ChatGPT’s Reliability in Generating Biographical Text Outputs

Kehinde Oloyede, Cristina Luca, Vitaliy Milke

2025

Abstract

The rapid evolution of large language models has transformed the landscape of Artificial Intelligence-based applications, with ChatGPT standing out for generating text that feels human-like. This study aims to assess ChatGPT’s reliability and consistency when creating biographical texts. The paper focuses on evaluating how precise, consistent, readable and contextually appropriate the model’s biographical outputs are, taking into account various interactions and inputs. The input consisting of a biographical text dataset, specific rules and a prompt was used in an extensive experimentation with ChatGPT. The model’s performance was assessed using both quantitative and qualitative measures, scrutinising how well it maintains consistency across different biographical scenarios. This paper shows how greater coherence and accuracy in text generation can be achieved by creating detailed and structured directives. The significance of this study extends beyond its technical aspects, as accurate and reliable biographical data is essential for record-keeping and historical preservation.

Paper Citation

in Harvard Style

Oloyede K., Luca C. and Milke V. (2025). An Evaluation of ChatGPT’s Reliability in Generating Biographical Text Outputs. In Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART; ISBN 978-989-758-737-5, SciTePress, pages 993-1000. DOI: 10.5220/0013248400003890

in Bibtex Style

@conference{icaart25,
author={Kehinde Oloyede and Cristina Luca and Vitaliy Milke},
title={An Evaluation of ChatGPT’s Reliability in Generating Biographical Text Outputs},
booktitle={Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART},
year={2025},
pages={993-1000},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013248400003890},
isbn={978-989-758-737-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART
TI - An Evaluation of ChatGPT’s Reliability in Generating Biographical Text Outputs
SN - 978-989-758-737-5
AU - Oloyede K.
AU - Luca C.
AU - Milke V.
PY - 2025
SP - 993
EP - 1000
DO - 10.5220/0013248400003890
PB - SciTePress