Auto-scaling Walkability Analytics through Kubernetes and Docker SWARM on the Cloud

Lu Chen, Yiru Pan, Richard Sinnott

2020

Abstract

The Australian Urban Research Infrastructure Network (AURIN – www.aurin.org.au) provides a data-driven, Cloud-based research environment for researchers across Australasia. The platform offers seamless and secure access to over 5000 definitive data sets from over 100 major government agencies across Australia with over 100 targeted tools that can be used for data analysis. One such tool is the walkability tool environment. This offers a set of Cloud-based components that generate walkability indices at user-specified scales. The walkability tools utilize geospatial data to create walkability indices that can be used to establish the walkability of given locations. The walkability workflow tools are built on a range of specialised spatial and statistical functions delivered as part of the AURIN environment. However, the existing AURIN web-based tools are currently deployed on a single (large) virtual machine, which is a performance and scalability bottleneck. Container technologies such as Docker and associated container orchestration environments such as Docker Swarm and Kubernetes support Cloud-based scaling. This paper introduces the background to the walkability environment and describes how it was extended to support Docker in Swarm mode and Kubernetes to make the walkability environment more robust and scalable, especially under heavy workloads. Performance benchmarking and a case study are presented looking at the creation of large-scale walkability indexes for areas around Melbourne.

Paper Citation

in Harvard Style

Chen L., Pan Y. and Sinnott R. (2020). Auto-scaling Walkability Analytics through Kubernetes and Docker SWARM on the Cloud.In Proceedings of the 10th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-424-4, pages 261-272. DOI: 10.5220/0009337902610272

in Bibtex Style

@conference{closer20,
author={Lu Chen and Yiru Pan and Richard Sinnott},
title={Auto-scaling Walkability Analytics through Kubernetes and Docker SWARM on the Cloud},
booktitle={Proceedings of the 10th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2020},
pages={261-272},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009337902610272},
isbn={978-989-758-424-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 10th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - Auto-scaling Walkability Analytics through Kubernetes and Docker SWARM on the Cloud
SN - 978-989-758-424-4
AU - Chen L.
AU - Pan Y.
AU - Sinnott R.
PY - 2020
SP - 261
EP - 272
DO - 10.5220/0009337902610272