Large Language Models in Civic Education on the Supervision and Risk Assessment of Public Works

Joaquim Honório, Paulo Brito, J. Moura, Nazareno Andrade

2024

Abstract

The Public Administration spends an estimated 13 trillion USD annually worldwide, of which approximately 20% is allocated to public works. Despite strict rules, unfinished works for legal reasons, including corruption, are not atypical, negatively impacting the region’s economy, culture, and society. Civic awareness about this problem may help reduce such losses. This study investigates the use of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) to support civic education on risks in public works. While LLMs interpret and create human language, RAGs combine text production with access to other external data, allowing contextualized responses. Here, we evaluate how these technologies can facilitate the population’s understanding of technical information about public works. To this end, we initially create and evaluate 4 Machine Learning models for risk prediction of public work failure, using data from real public works. We provide a failure estimate for each contracted work based on the most efficient model. These data and others related to government development and risk processes are accessed and presented to the user through a web support system. Tests with 35 participants indicate a significant improvement in citizens ability to understand complex aspects related to risks and contracts of public works.

Paper Citation

in Harvard Style

Honório J., Brito P., Moura J. and Andrade N. (2024). Large Language Models in Civic Education on the Supervision and Risk Assessment of Public Works. In Proceedings of the 16th International Conference on Computer Supported Education - Volume 2: CSEDU; ISBN 978-989-758-697-2, SciTePress, pages 27-38. DOI: 10.5220/0012589300003693

in Bibtex Style

@conference{csedu24,
author={Joaquim Honório and Paulo Brito and J. Moura and Nazareno Andrade},
title={Large Language Models in Civic Education on the Supervision and Risk Assessment of Public Works},
booktitle={Proceedings of the 16th International Conference on Computer Supported Education - Volume 2: CSEDU},
year={2024},
pages={27-38},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012589300003693},
isbn={978-989-758-697-2},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Conference on Computer Supported Education - Volume 2: CSEDU
TI - Large Language Models in Civic Education on the Supervision and Risk Assessment of Public Works
SN - 978-989-758-697-2
AU - Honório J.
AU - Brito P.
AU - Moura J.
AU - Andrade N.
PY - 2024
SP - 27
EP - 38
DO - 10.5220/0012589300003693
PB - SciTePress