QTrail-DB: A Query Processing Engine for Imperfect Databases with Evolving Qualities

Maha Asiri, Mohamed Eltabakh

2023

Abstract

Imperfect databases are very common in many applications due to various reasons ranging from data-entry errors, transmission errors, and wrong instruments’ readings, to faulty experimental setups leading to incorrect results. The management and query processing of imperfect databases is a very challenging problem requires incorporating the data’s qualities within the database engine. Even more challenging, the qualities are not static and may evolve over time. Unfortunately, most of the state-of-art techniques deal with the data quality problem as an offline task. In this paper, we propose the “QTrail-DB” system that introduces a new quality model based on the new concept of “Quality Trails”, which captures the evolution of the data’s qualities over time. QTrail-DB extends the relational data model to incorporate the quality trails within the database system. We propose a new query algebra, called “QTrail Algebra”, that enables transparent propagation and derivations of the data’s qualities within a query pipeline. QTrail-DB is developed within PostgreSQL and experimentally evaluated using real-world datasets to demonstrate its efficiency and practicality.

Paper Citation

in Harvard Style

Asiri M. and Eltabakh M. (2023). QTrail-DB: A Query Processing Engine for Imperfect Databases with Evolving Qualities. In Proceedings of the 12th International Conference on Data Science, Technology and Applications - Volume 1: DATA; ISBN 978-989-758-664-4, SciTePress, pages 295-302. DOI: 10.5220/0012081200003541

in Bibtex Style

@conference{data23,
author={Maha Asiri and Mohamed Eltabakh},
title={QTrail-DB: A Query Processing Engine for Imperfect Databases with Evolving Qualities},
booktitle={Proceedings of the 12th International Conference on Data Science, Technology and Applications - Volume 1: DATA},
year={2023},
pages={295-302},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012081200003541},
isbn={978-989-758-664-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 12th International Conference on Data Science, Technology and Applications - Volume 1: DATA
TI - QTrail-DB: A Query Processing Engine for Imperfect Databases with Evolving Qualities
SN - 978-989-758-664-4
AU - Asiri M.
AU - Eltabakh M.
PY - 2023
SP - 295
EP - 302
DO - 10.5220/0012081200003541
PB - SciTePress