From ETL Conceptual Design to ETL Physical Sketching using Patterns

Bruno Oliveira, Orlando Belo

Abstract

The ETL systems development has been the focus of many research works, addressing the complexity and effort required for their implementation and maintenance, and proposing several techniques that represent valuable contributions to improve the ETL final quality. In the last few years, we presented a pattern-oriented approach for developing these systems based on patterns that encapsulate well-known design techniques. Basically, patterns embed common practices using abstract components that can be configured for enabling its instantiation according to each pattern rule. However, each ETL system is unique, dealing with very specific data structures and decision-making requirements. Thus, several operational requirements need to be considered and system correctness is hard to validate, which can result in several implementation problems. In this paper, we present a conceptual approach based on patterns covering the main ETL phases, ranging from the conceptual design to its enrichment at logical phases that can be used for the generation of executable programs.

Download


Paper Citation


in Harvard Style

Oliveira B. and Belo O. (2018). From ETL Conceptual Design to ETL Physical Sketching using Patterns.In Proceedings of the 20th International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-758-298-1, pages 262-269. DOI: 10.5220/0006807702620269


in Bibtex Style

@conference{iceis18,
author={Bruno Oliveira and Orlando Belo},
title={From ETL Conceptual Design to ETL Physical Sketching using Patterns},
booktitle={Proceedings of the 20th International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2018},
pages={262-269},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006807702620269},
isbn={978-989-758-298-1},
}


in EndNote Style

TY - CONF

JO - Proceedings of the 20th International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - From ETL Conceptual Design to ETL Physical Sketching using Patterns
SN - 978-989-758-298-1
AU - Oliveira B.
AU - Belo O.
PY - 2018
SP - 262
EP - 269
DO - 10.5220/0006807702620269