Preprocessing of Terrain Data in the Cloud using a Workflow Management System

Marvin Kaster, Marvin Kaster, Hendrik Würz, Hendrik Würz

2022

Abstract

The preparation of terrain data for web visualization is time-consuming. We model the problem as a scientific workflow that can be executed by a workflow management system (WMS) in a cloud-based environment. Such a workflow management system provides easy access to the almost unlimited resources of cloud infrastructure and still allows a lot of freedom in the implementation of tasks. We take advantage of this and optimize the computation of individual tiles in the created level of detail (LOD) structure, as well as the scheduling of tasks in the scientific workflow. This enables us to utilize allocated resources very efficiently and improve computation time. In the evaluation, we analyze the impact of different storage endpoints, the number of threads, and the number of tasks on the run time. We show that our approach scales well and outperforms our previous work based on the framework GeoTrellis considerably (Krämer et al., 2020).

Paper Citation

in Harvard Style

Kaster M. and Würz H. (2022). Preprocessing of Terrain Data in the Cloud using a Workflow Management System. In Proceedings of the 11th International Conference on Data Science, Technology and Applications - Volume 1: DATA, ISBN 978-989-758-583-8, pages 40-49. DOI: 10.5220/0011145000003269

in Bibtex Style

@conference{data22,
author={Marvin Kaster and Hendrik Würz},
title={Preprocessing of Terrain Data in the Cloud using a Workflow Management System},
booktitle={Proceedings of the 11th International Conference on Data Science, Technology and Applications - Volume 1: DATA,},
year={2022},
pages={40-49},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011145000003269},
isbn={978-989-758-583-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Conference on Data Science, Technology and Applications - Volume 1: DATA,
TI - Preprocessing of Terrain Data in the Cloud using a Workflow Management System
SN - 978-989-758-583-8
AU - Kaster M.
AU - Würz H.
PY - 2022
SP - 40
EP - 49
DO - 10.5220/0011145000003269