IndraFlow: Seamless Data Transfer and Transformation Between Internet of Things, Robot Systems and Cloud-Native Environments

Attila Marosi, Krisztián Póra, Krisztián Póra

2024

Abstract

In this paper we present our solution which aims to be a generic streaming data bridge. It utilizes a modular architecture with current support for MQTT, ROS1, ROS2, Kafka and relational database management systems (RDBMS), such as MySQL or PosgreSQL as data sources or destinations. Our solution also supports custom transformations of messages and using multiple sources and destinations within a single bridge instance. We compare our solution to existing generic streaming solutions (such as the GUI-based Apache NiFi) and custom-made bridge codes (such as a ROS to MQTT bridge). Next, we present two use cases for our solution from different projects. In the first use case ROS messages are received from drones, transformed and sent to a cloud-based Kafka cluster. The second use case is representing an industrial IoT use case where MQTT messages are received, transformed and sent to a PostgreSQL server for persistent storage. Finally, we evaluate the performance and reliability of our solution using the second use case.

Paper Citation

in Harvard Style

Marosi A. and Póra K. (2024). IndraFlow: Seamless Data Transfer and Transformation Between Internet of Things, Robot Systems and Cloud-Native Environments. In Proceedings of the 9th International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS; ISBN 978-989-758-699-6, SciTePress, pages 191-198. DOI: 10.5220/0012622600003705

in Bibtex Style

@conference{iotbds24,
author={Attila Marosi and Krisztián Póra},
title={IndraFlow: Seamless Data Transfer and Transformation Between Internet of Things, Robot Systems and Cloud-Native Environments},
booktitle={Proceedings of the 9th International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS},
year={2024},
pages={191-198},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012622600003705},
isbn={978-989-758-699-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 9th International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS
TI - IndraFlow: Seamless Data Transfer and Transformation Between Internet of Things, Robot Systems and Cloud-Native Environments
SN - 978-989-758-699-6
AU - Marosi A.
AU - Póra K.
PY - 2024
SP - 191
EP - 198
DO - 10.5220/0012622600003705
PB - SciTePress