It is Time to Develop an Auditing Framework to Promote Value Aware Chatbots

Yanchen Wang, Lisa Singh

2024

Abstract

The launch of ChatGPT in November 2022 marked the beginning of a new era in AI, the availability of generative AI tools for everyone to use. ChatGPT and other similar chatbots boast a wide range of capabilities from answering student homework questions to creating music and art. Given the large amounts of human data chatbots are built on, it is inevitable that they will inherit human errors and biases. These biases have the potential to inflict significant harm or increase inequity on different subpopulations. Because chatbots do not have an inherent understanding of societal values, they may create new content that is contrary to established norms. Examples of concerning generated content includes child pornography, inaccurate facts, and discriminatory posts. In this position paper, we argue that the speed of advancement of this technology requires us, as computer and data scientists, to mobilize and develop a values-based auditing framework containing a community established standard set of measurements to monitor the health of different chatbots and LLMs. To support our argument, we use a simple audit template to share the results of basic audits we conduct that are focused on measuring potential bias in search engine style tasks, code generation, and story generation. We identify responses from GPT 3.5 and GPT 4 that are both consistent and not consistent with values derived from existing law. While the findings come as no surprise, they do underscore the urgency of developing a robust auditing framework for openly sharing results in a consistent way so that mitigation strategies can be developed by the academic community, government agencies, and companies when our values are not being adhered to. We conclude this paper with recommendations for value-based strategies for improving the technologies.

Paper Citation

in Harvard Style

Wang Y. and Singh L. (2024). It is Time to Develop an Auditing Framework to Promote Value Aware Chatbots. In Proceedings of the 13th International Conference on Data Science, Technology and Applications - Volume 1: DATA; ISBN 978-989-758-707-8, SciTePress, pages 460-470. DOI: 10.5220/0012806800003756

in Bibtex Style

@conference{data24,
author={Yanchen Wang and Lisa Singh},
title={It is Time to Develop an Auditing Framework to Promote Value Aware Chatbots},
booktitle={Proceedings of the 13th International Conference on Data Science, Technology and Applications - Volume 1: DATA},
year={2024},
pages={460-470},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012806800003756},
isbn={978-989-758-707-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Conference on Data Science, Technology and Applications - Volume 1: DATA
TI - It is Time to Develop an Auditing Framework to Promote Value Aware Chatbots
SN - 978-989-758-707-8
AU - Wang Y.
AU - Singh L.
PY - 2024
SP - 460
EP - 470
DO - 10.5220/0012806800003756
PB - SciTePress