Challenges in Data Acquisition and Management in Big Data Environments

Daniel Staegemann, Matthias Volk, Akanksha Saxena, Matthias Pohl, Abdulrahman Nahhas, Robert Häusler, Mohammad Abdallah, Sascha Bosse, Naoum Jamous, Klaus Turowski

2021

Abstract

In the recent years, the term big data has attracted a lot of attention. It refers to the processing of data that is characterized mainly by 4Vs, namely volume, velocity, variety and veracity. The need for collecting and analysing big data has increased manifolds these days as organizations want to derive meaningful information out of any data that is available and create value for the business. A challenge that comes with big data is inferior data quality due to which a lot of time is spent on data cleaning. One prerequisite for solving data quality issues is to understand the reasons for their occurrence. In this paper, we discuss various issues that cause reduced quality of the data during the acquisition and management. Furthermore, we extend the research to categorize the quality of data with respect to the identified issues.

Paper Citation

in Harvard Style

Staegemann D., Volk M., Saxena A., Pohl M., Nahhas A., Häusler R., Abdallah M., Bosse S., Jamous N. and Turowski K. (2021). Challenges in Data Acquisition and Management in Big Data Environments. In Proceedings of the 6th International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS, ISBN 978-989-758-504-3, pages 193-204. DOI: 10.5220/0010429001930204

in Bibtex Style

@conference{iotbds21,
author={Daniel Staegemann and Matthias Volk and Akanksha Saxena and Matthias Pohl and Abdulrahman Nahhas and Robert Häusler and Mohammad Abdallah and Sascha Bosse and Naoum Jamous and Klaus Turowski},
title={Challenges in Data Acquisition and Management in Big Data Environments},
booktitle={Proceedings of the 6th International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS,},
year={2021},
pages={193-204},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010429001930204},
isbn={978-989-758-504-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 6th International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS,
TI - Challenges in Data Acquisition and Management in Big Data Environments
SN - 978-989-758-504-3
AU - Staegemann D.
AU - Volk M.
AU - Saxena A.
AU - Pohl M.
AU - Nahhas A.
AU - Häusler R.
AU - Abdallah M.
AU - Bosse S.
AU - Jamous N.
AU - Turowski K.
PY - 2021
SP - 193
EP - 204
DO - 10.5220/0010429001930204