Enhancing User Experience in Games with Large Language Models

Ciprian Paduraru, Marina Cernat, Alin Stefanescu, Alin Stefanescu

2024

Abstract

This paper explores the application of state-of-the-art natural language processing (NLP) technologies to improve the user experience in games. Our motivation stems from the realization that a virtual assistant’s input during games or simulation applications can significantly assist the user in real-time problem solving, suggestion generation, and dynamic adjustments. We propose a novel framework that seamlessly integrates large-scale language models (LLMs) into game environments and enables intelligent assistants to take the form of physical 3D characters or virtual background entities within the player narrative. Our evaluation considers computational requirements, latency and quality of results using techniques such as synthetic dataset generation, fine-tuning, Retrieval Augmented Generation (RAG) and security mechanisms. Quantitative and qualitative evaluations, including real user feedback, confirm the effectiveness of our approach. The framework is implemented as an open-source plugin for the Unreal Engine and has already been successfully used in a game demo. The presented methods can be extended to simulation applications and serious games in general.

Paper Citation

in Harvard Style

Paduraru C., Cernat M. and Stefanescu A. (2024). Enhancing User Experience in Games with Large Language Models. In Proceedings of the 19th International Conference on Software Technologies - Volume 1: ICSOFT; ISBN 978-989-758-706-1, SciTePress, pages 293-304. DOI: 10.5220/0012854600003753

in Bibtex Style

@conference{icsoft24,
author={Ciprian Paduraru and Marina Cernat and Alin Stefanescu},
title={Enhancing User Experience in Games with Large Language Models},
booktitle={Proceedings of the 19th International Conference on Software Technologies - Volume 1: ICSOFT},
year={2024},
pages={293-304},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012854600003753},
isbn={978-989-758-706-1},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 19th International Conference on Software Technologies - Volume 1: ICSOFT
TI - Enhancing User Experience in Games with Large Language Models
SN - 978-989-758-706-1
AU - Paduraru C.
AU - Cernat M.
AU - Stefanescu A.
PY - 2024
SP - 293
EP - 304
DO - 10.5220/0012854600003753
PB - SciTePress