Open Data Analytic Querying using a Relation-Free API

Lucas F. de Oliveira, Alessandro Elias, Fabiola Santore, Diego Pasqualin, Luis Bona, Marcos Sunyé, Marcos Didonet Del Fabro

2020

Abstract

The large availability of tabular Open Data sources with hundreds of attributes and relations makes the query development a difficult task, where analytic queries are common. When writing such queries, often called SPJG (Select-Project-Join-GroupBy), it is necessary to understand a data model and to write JOIN operations. The most common approach is to use business intelligence frameworks, or recent solutions based on keywords or examples. However, they require the utilization of specific applications and there is a lack of support for web-based APIs. We present a solution that eases the task of query development for tabular Open Data analytics through an API, using a simplified query representation where it is not allowed to specify the data relations, and consequently neither the joins over them, called Relation-Free Query. We define a single virtual schema that captures the database structure, which allows the use of relation-free queries in existent DBMS’s. The concrete queries are exposed by a RESTful API, which is then translated into a database query language using known query generation solutions. The API is available as a microservice. We present a case study to describe solution, using a real world scenario to query in an integrated database of several Brazilian open databases with hundreds of attributes.

Paper Citation

in Harvard Style

F. de Oliveira L., Elias A., Santore F., Pasqualin D., Bona L., Sunyé M. and Didonet Del Fabro M. (2020). Open Data Analytic Querying using a Relation-Free API.In Proceedings of the 22nd International Conference on Enterprise Information Systems - Volume 1: ICEIS, ISBN 978-989-758-423-7, pages 148-155. DOI: 10.5220/0009413001480155

in Bibtex Style

@conference{iceis20,
author={Lucas F. de Oliveira and Alessandro Elias and Fabiola Santore and Diego Pasqualin and Luis Bona and Marcos Sunyé and Marcos Didonet Del Fabro},
title={Open Data Analytic Querying using a Relation-Free API},
booktitle={Proceedings of the 22nd International Conference on Enterprise Information Systems - Volume 1: ICEIS,},
year={2020},
pages={148-155},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009413001480155},
isbn={978-989-758-423-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 22nd International Conference on Enterprise Information Systems - Volume 1: ICEIS,
TI - Open Data Analytic Querying using a Relation-Free API
SN - 978-989-758-423-7
AU - F. de Oliveira L.
AU - Elias A.
AU - Santore F.
AU - Pasqualin D.
AU - Bona L.
AU - Sunyé M.
AU - Didonet Del Fabro M.
PY - 2020
SP - 148
EP - 155
DO - 10.5220/0009413001480155