A Data Quality Assessment Approach in the SmartWork Project’s Time-series Data Imputation Paradigm

Georgios Papoulias, Otilia Kocsis, Konstantinos Moustakas

2021

Abstract

The plethora of collected data streams of the SmartWork project’s sensing system is often accompanied by missing values, yielding the need for estimating these missing values through imputation, which may prove unnecessary or computationally expensive in relation to the outcome. This work introduces a data quality assessment approach that allows for decision making regarding the need/efficiency of data completion in order to save system computational resources and ensure quality of imputed data. Preliminary validation of the proposed approach is performed by assessing the correlation between the proposed data quality assessment scores and the normalized mean square error of the imputation on various simulated missing patterns. The results reinforce our initial hypothesis that the suggested score is a suitable data quality indicator, correlating well with the potential errors introduced by imputation in the case of a given batch of input data.

Paper Citation

in Harvard Style

Papoulias G., Kocsis O. and Moustakas K. (2021). A Data Quality Assessment Approach in the SmartWork Project’s Time-series Data Imputation Paradigm. In Proceedings of the 13th International Joint Conference on Computational Intelligence - Volume 1: SmartWork; ISBN 978-989-758-534-0, SciTePress, pages 453-459. DOI: 10.5220/0010719000003063

in Bibtex Style

@conference{smartwork21,
author={Georgios Papoulias and Otilia Kocsis and Konstantinos Moustakas},
title={A Data Quality Assessment Approach in the SmartWork Project’s Time-series Data Imputation Paradigm},
booktitle={Proceedings of the 13th International Joint Conference on Computational Intelligence - Volume 1: SmartWork},
year={2021},
pages={453-459},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010719000003063},
isbn={978-989-758-534-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Joint Conference on Computational Intelligence - Volume 1: SmartWork
TI - A Data Quality Assessment Approach in the SmartWork Project’s Time-series Data Imputation Paradigm
SN - 978-989-758-534-0
AU - Papoulias G.
AU - Kocsis O.
AU - Moustakas K.
PY - 2021
SP - 453
EP - 459
DO - 10.5220/0010719000003063
PB - SciTePress