Dynamic Data Streaming for an Appliance

Marta Patiño, Ainhoa Azqueta

2019

Abstract

Many applications require to analyse large amounts of continuous flows of data produced by different data sources before the data is stored. Data streaming engines emerged as a solution for processing data on the fly. At the same time, computer architectures have evolved to systems with several interconnected CPUs and Non Uniform Memory Access (NUMA), where the cost of accessing memory from a core depends on how CPUs are interconnected. In order to get better resource utilization and adaptiveness to the load dynamic migration of queries must be available in data streaming engines. Moreover, data streaming applications require high availability so that failures do not cause service interruption and losing data. This paper presents the dynamic migration and fault-tolerance capabilities of UPM-CEP, a data streaming engine designed to take advantage of NUMA architectures. The preliminary evaluation using Intel HiBench benchmark shows the effect of the query migration and fault-tolerance on the system performance.

Paper Citation

in Harvard Style

Patiño M. and Azqueta A. (2019). Dynamic Data Streaming for an Appliance.In Proceedings of the 8th International Conference on Data Science, Technology and Applications - Volume 1: ADITCA, ISBN 978-989-758-377-3, pages 470-477. DOI: 10.5220/0008319204700477

in Bibtex Style

@conference{aditca19,
author={Marta Patiño and Ainhoa Azqueta},
title={Dynamic Data Streaming for an Appliance},
booktitle={Proceedings of the 8th International Conference on Data Science, Technology and Applications - Volume 1: ADITCA,},
year={2019},
pages={470-477},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008319204700477},
isbn={978-989-758-377-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 8th International Conference on Data Science, Technology and Applications - Volume 1: ADITCA,
TI - Dynamic Data Streaming for an Appliance
SN - 978-989-758-377-3
AU - Patiño M.
AU - Azqueta A.
PY - 2019
SP - 470
EP - 477
DO - 10.5220/0008319204700477