Continuous Data Quality Management for Machine Learning based Data-as-a-Service Architectures

Shelernaz Azimi, Claus Pahl

2021

Abstract

Data-as-a-Service (DaaS) solutions make raw source data accessible in the form of processable information. Machine learning (ML) allows to produce meaningful information and knowledge based on raw data. Thus, quality is a major concern that applies to raw data as well as to information provided by ML-generated models. At the core of the solution is a conceptual framework that links input data quality and the machine learned data service quality, specifically inferring raw data problems as root causes from observed data service deficiency symptoms. This allows to deduce the hidden origins of quality problems observable by users of DaaS offerings. We analyse the quality framework through an extensive case study from an edge cloud and Internet-of-Things-based traffic application. We determine quality assessment mechanisms for symptom and cause analysis in different quality dimensions.

Paper Citation

in Harvard Style

Azimi S. and Pahl C. (2021). Continuous Data Quality Management for Machine Learning based Data-as-a-Service Architectures. In Proceedings of the 11th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-510-4, pages 328-335. DOI: 10.5220/0010509503280335

in Bibtex Style

@conference{closer21,
author={Shelernaz Azimi and Claus Pahl},
title={Continuous Data Quality Management for Machine Learning based Data-as-a-Service Architectures},
booktitle={Proceedings of the 11th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2021},
pages={328-335},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010509503280335},
isbn={978-989-758-510-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - Continuous Data Quality Management for Machine Learning based Data-as-a-Service Architectures
SN - 978-989-758-510-4
AU - Azimi S.
AU - Pahl C.
PY - 2021
SP - 328
EP - 335
DO - 10.5220/0010509503280335