loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Bruno Oliveira 1 ; Óscar Oliveira 1 ; Vasco Santos 1 and Orlando Belo 2

Affiliations: 1 CIICESI, School of Management and Technology, Porto Polytechnic, Felgueiras and Portugal ; 2 ALGORITMI R&D Centre, University of Minho, Campus de Gualtar, Braga and Portugal

Keyword(s): Data Warehousing Systems, ETL Patterns, ETL Component-Reuse, Services, ETL as a Service.

Related Ontology Subjects/Areas/Topics: Data Warehouses and OLAP ; Databases and Information Systems Integration ; Enterprise Information Systems

Abstract: Extract-Transform-Load (ETL) workflows are commonly developed using frameworks and tools that provide a set of useful pre-configured components to develop complete ETL packages. The pattern concept for ETL development is being studied as a way to simplify and improve the ETL development lifecycle. Patterns are independent composite tasks that can be changed without affecting the ETL structure. The pattern implementation reveals several challenges when used with existing ETL tools, mainly due to the monolith architectural style usually followed. The use of small and loosely-coupled components provided by the microservices architectural style can improve the way ETL patterns are used. In this paper, we present an analysis for the use of microservices for ETL application development using patterns.

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 18.116.47.111

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Oliveira, B.; Oliveira, Ó.; Santos, V. and Belo, O. (2019). ETL Development using Patterns: A Service-Oriented Approach. In Proceedings of the 21st International Conference on Enterprise Information Systems - Volume 1: ICEIS; ISBN 978-989-758-372-8; ISSN 2184-4984, SciTePress, pages 216-222. DOI: 10.5220/0007727502160222

@conference{iceis19,
author={Bruno Oliveira. and Óscar Oliveira. and Vasco Santos. and Orlando Belo.},
title={ETL Development using Patterns: A Service-Oriented Approach},
booktitle={Proceedings of the 21st International Conference on Enterprise Information Systems - Volume 1: ICEIS},
year={2019},
pages={216-222},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007727502160222},
isbn={978-989-758-372-8},
issn={2184-4984},
}

TY - CONF

JO - Proceedings of the 21st International Conference on Enterprise Information Systems - Volume 1: ICEIS
TI - ETL Development using Patterns: A Service-Oriented Approach
SN - 978-989-758-372-8
IS - 2184-4984
AU - Oliveira, B.
AU - Oliveira, Ó.
AU - Santos, V.
AU - Belo, O.
PY - 2019
SP - 216
EP - 222
DO - 10.5220/0007727502160222
PB - SciTePress