A Framework for a Data Quality Module in Decision Support Systems: An Application with Smart Grid Time Series

Giulia Rinaldi, Fernando Crema Garcia, Oscar Agudelo, Thijs Becker, Thijs Becker, Koen Vanthournout, Koen Vanthournout, Willem Mestdagh, Bart De Moor

2023

Abstract

Data quality (DQ) measures data status based on different dimensions. This broad topic was brought to the fore in the ’80s when it was first discussed and studied. A high-quality dataset correlates with good performance in artificial intelligence (AI) algorithms and decision-making processes. Therefore, checking the quality of the data inside a decision support system (DSS) is an essential pre-processing step and is beneficial for improving further analysis. In this paper, a theoretical framework for a DQ module for a DSS is proposed. The framework evaluates the quality status in three stages: as based on the European guidelines, as based on DQ metrics, and as based on checking a subset of data cleaning (DC) problems. Additionally, the framework supports the user in identifying and fixing the DC problems, which speeds up the process. As output, the user receives a DQ report and the DC pipeline to execute to improve the dataset’s quality. An implementation of the framework is illustrated in a proof-of-concept (POC) for an industrial use case. In the POC, an example of the execution of the various framework phases was shown using a public time series dataset containing quarter-hourly consumption profiles of residential electricity customers in Belgium for the year 2016.

Paper Citation

in Harvard Style

Rinaldi G., Crema Garcia F., Agudelo O., Becker T., Vanthournout K., Mestdagh W. and De Moor B. (2023). A Framework for a Data Quality Module in Decision Support Systems: An Application with Smart Grid Time Series. In Proceedings of the 25th International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-758-648-4, SciTePress, pages 443-452. DOI: 10.5220/0011749700003467

in Bibtex Style

@conference{iceis23,
author={Giulia Rinaldi and Fernando Crema Garcia and Oscar Agudelo and Thijs Becker and Koen Vanthournout and Willem Mestdagh and Bart De Moor},
title={A Framework for a Data Quality Module in Decision Support Systems: An Application with Smart Grid Time Series},
booktitle={Proceedings of the 25th International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2023},
pages={443-452},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011749700003467},
isbn={978-989-758-648-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 25th International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - A Framework for a Data Quality Module in Decision Support Systems: An Application with Smart Grid Time Series
SN - 978-989-758-648-4
AU - Rinaldi G.
AU - Crema Garcia F.
AU - Agudelo O.
AU - Becker T.
AU - Vanthournout K.
AU - Mestdagh W.
AU - De Moor B.
PY - 2023
SP - 443
EP - 452
DO - 10.5220/0011749700003467
PB - SciTePress