What to Do when Privacy Issues Screw It Up: Ingestion Refactoring in a Big-Data Pipeline

Gian Jesi, Nicola Spazzoli, Andrea Odorizzi, Gianluca Mazzini

2024

Abstract

Privacy is an increasingly important concern especially in the European Union (EU). With the growing use of technology individuals’ personal information is being collected and processed by companies and organizations on a massive scale. In order to be compliant with Privacy regulations and General Data Protection Regulation (GDPR) in particular, we could no longer use a software tool, LOGGIT, for several reasons. This tool was a cornerstone in one of our Big-data pipeline ingestion. We did our best to comply with this requirement as soon as possible. In this work, we discuss how we refactor our pipeline architecture several times in order to find a balance between our requirements in terms of reliability and the regulations of the GDPR.

Paper Citation

in Harvard Style

Jesi G., Spazzoli N., Odorizzi A. and Mazzini G. (2024). What to Do when Privacy Issues Screw It Up: Ingestion Refactoring in a Big-Data Pipeline. In Proceedings of the 26th International Conference on Enterprise Information Systems - Volume 1: ICEIS; ISBN 978-989-758-692-7, SciTePress, pages 209-215. DOI: 10.5220/0012554800003690

in Bibtex Style

@conference{iceis24,
author={Gian Jesi and Nicola Spazzoli and Andrea Odorizzi and Gianluca Mazzini},
title={What to Do when Privacy Issues Screw It Up: Ingestion Refactoring in a Big-Data Pipeline},
booktitle={Proceedings of the 26th International Conference on Enterprise Information Systems - Volume 1: ICEIS},
year={2024},
pages={209-215},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012554800003690},
isbn={978-989-758-692-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 26th International Conference on Enterprise Information Systems - Volume 1: ICEIS
TI - What to Do when Privacy Issues Screw It Up: Ingestion Refactoring in a Big-Data Pipeline
SN - 978-989-758-692-7
AU - Jesi G.
AU - Spazzoli N.
AU - Odorizzi A.
AU - Mazzini G.
PY - 2024
SP - 209
EP - 215
DO - 10.5220/0012554800003690
PB - SciTePress