Elcano: A Geospatial Big Data Processing System based on SparkSQL

Jonathan Engélinus, Thierry Badard

2018

Abstract

Big data are in the midst of many scientific and economic issues. Furthermore, their volume is continuously increasing. As a result, the need for management and processing solutions has become critical. Unfortunately, while most of these data have a spatial component, almost none of the current systems are able to manage it. For example, while Spark may be the most efficient environment for managing Big data, it is only used by five spatial data management systems. None of these solutions fully complies with ISO standards and OGC specifications in terms of spatial processing, and many of them are neither efficient enough nor extensible. The authors seek a way to overcome these limitations. Therefore, after a detailed study of the limitations of the existing systems, they define a system in greater accordance with the ISO-19125 standard. The proposed solution, Elcano, is an extension of Spark complying with this standard and allowing the SQL querying of spatial data. Finally, the tests demonstrate that the resulting system surpasses the current available solutions on the market.

Paper Citation

in Harvard Style

Engélinus J. and Badard T. (2018). Elcano: A Geospatial Big Data Processing System based on SparkSQL.In Proceedings of the 4th International Conference on Geographical Information Systems Theory, Applications and Management - Volume 1: GISTAM, ISBN 978-989-758-294-3, pages 119-128. DOI: 10.5220/0006794601190128

in Bibtex Style

@conference{gistam18,
author={Jonathan Engélinus and Thierry Badard},
title={Elcano: A Geospatial Big Data Processing System based on SparkSQL},
booktitle={Proceedings of the 4th International Conference on Geographical Information Systems Theory, Applications and Management - Volume 1: GISTAM,},
year={2018},
pages={119-128},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006794601190128},
isbn={978-989-758-294-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 4th International Conference on Geographical Information Systems Theory, Applications and Management - Volume 1: GISTAM,
TI - Elcano: A Geospatial Big Data Processing System based on SparkSQL
SN - 978-989-758-294-3
AU - Engélinus J.
AU - Badard T.
PY - 2018
SP - 119
EP - 128
DO - 10.5220/0006794601190128