Reference Architecture for IoT Platforms towards Cloud Continuum based on Apache Kafka and Orchestration Methods

Zoltán Farkas, Róbert Lovas

2022

Abstract

Apache Kafka is a widely used, distributed, open-source event streaming platform, which is available as a basic reference architecture for IoT use cases of the Autonomous Systems National Laboratory and other initiatives in Hungary, e.g. related to development of cyber-medical systems. This reference architecture offers a base for setting up a multi-node Kafka cluster on a Hungarian research infrastructure, ELKH Cloud. However, the capacity, accessibility or the availability of a given deployment using a single data center might not be sufficient. In this case Apache Kafka can be extended with additional nodes provisioned in the given cloud, but our solution also enables the expansion of the cluster by involving other cloud providers. In this paper we present our proposed approach for enhancing the existing basic reference architecture towards cloud continuum, i.e. allowing the supported IoT use cases to expand the resources of an already deployed Apache Kafka cluster with resources allocated even in third-party commercial cloud providers, such as Microsoft Azure and AWS leveraging on the functionalities of the Occopus cloud orchestrator.

Paper Citation

in Harvard Style

Farkas Z. and Lovas R. (2022). Reference Architecture for IoT Platforms towards Cloud Continuum based on Apache Kafka and Orchestration Methods. In Proceedings of the 7th International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS, ISBN 978-989-758-564-7, pages 205-214. DOI: 10.5220/0011071300003194

in Bibtex Style

@conference{iotbds22,
author={Zoltán Farkas and Róbert Lovas},
title={Reference Architecture for IoT Platforms towards Cloud Continuum based on Apache Kafka and Orchestration Methods},
booktitle={Proceedings of the 7th International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS,},
year={2022},
pages={205-214},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011071300003194},
isbn={978-989-758-564-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 7th International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS,
TI - Reference Architecture for IoT Platforms towards Cloud Continuum based on Apache Kafka and Orchestration Methods
SN - 978-989-758-564-7
AU - Farkas Z.
AU - Lovas R.
PY - 2022
SP - 205
EP - 214
DO - 10.5220/0011071300003194