Towards Personal Assistants for Energy Processes Based on Locally Deployed LLMs

Maximilian Orlowski, Emilia Knauff, Florian Marquardt

2025

Abstract

This paper presents a coaching assistant for network operator processes based on a Retrieval-Augmented Generation (RAG) system leveraging open-source Large Language Models (LLMs) as well as Embedding Models. The system addresses challenges in employee onboarding and training, particularly in the context of increased customer contact due to more complex and extensive processes. Our approach incorporates domain-specific knowledge bases to generate precise, context-aware recommendations while mitigating LLM hallucination. We introduce our systems architecture to run all components on-premise in an our own datacenter, ensuring data security and process knowledge control. We also describe requirements for underlying knowledge documents and their impact on assistant answer quality. Our system aims to improve onboarding accuracy and speed while reducing senior employee workload. The results of our study show that realizing a coaching assistant for German network operators is reasonable, when addressing performance, correctness, integration and locality. However current results regarding accuracy do not yet meet the requirements for productive use.

Paper Citation

in Harvard Style

Orlowski M., Knauff E. and Marquardt F. (2025). Towards Personal Assistants for Energy Processes Based on Locally Deployed LLMs. In Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART; ISBN 978-989-758-737-5, SciTePress, pages 695-706. DOI: 10.5220/0013175600003890

in Bibtex Style

@conference{icaart25,
author={Maximilian Orlowski and Emilia Knauff and Florian Marquardt},
title={Towards Personal Assistants for Energy Processes Based on Locally Deployed LLMs},
booktitle={Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART},
year={2025},
pages={695-706},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013175600003890},
isbn={978-989-758-737-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART
TI - Towards Personal Assistants for Energy Processes Based on Locally Deployed LLMs
SN - 978-989-758-737-5
AU - Orlowski M.
AU - Knauff E.
AU - Marquardt F.
PY - 2025
SP - 695
EP - 706
DO - 10.5220/0013175600003890
PB - SciTePress