Overcoming the Complexity of Quality Assurance for Big Data Systems: An Examination of Testing Methods

Christian Daase, Daniel Staegemann, Klaus Turowski

2024

Abstract

As the complexity and diversity of big data systems reaches a new level, testing the solutions developed is becoming increasingly difficult. In this study, a systematic literature review is conducted on the role of testing and related quality assurance techniques in current big data systems in terms of applied strategies and design guidelines. After briefly introducing the necessary knowledge about big data in general, the methodology is explained in a detailed and reproducible manner, including the reasoned division of the main question into two concise research questions. The results show that methods such as individual experiments, standardized benchmarking, case studies and preparatory surveys are among the preferred approaches, but also have some drawbacks that need to be considered. In conclusion, testing alone may not guarantee a perfectly operating system, but can serve to minimize malfunctions to a limited number of special cases by revealing its principal weaknesses.

Paper Citation

in Harvard Style

Daase C., Staegemann D. and Turowski K. (2024). Overcoming the Complexity of Quality Assurance for Big Data Systems: An Examination of Testing Methods. In Proceedings of the 9th International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS; ISBN 978-989-758-699-6, SciTePress, pages 358-369. DOI: 10.5220/0012742100003705

in Bibtex Style

@conference{iotbds24,
author={Christian Daase and Daniel Staegemann and Klaus Turowski},
title={Overcoming the Complexity of Quality Assurance for Big Data Systems: An Examination of Testing Methods},
booktitle={Proceedings of the 9th International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS},
year={2024},
pages={358-369},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012742100003705},
isbn={978-989-758-699-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 9th International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS
TI - Overcoming the Complexity of Quality Assurance for Big Data Systems: An Examination of Testing Methods
SN - 978-989-758-699-6
AU - Daase C.
AU - Staegemann D.
AU - Turowski K.
PY - 2024
SP - 358
EP - 369
DO - 10.5220/0012742100003705
PB - SciTePress