loading
Documents

Research.Publish.Connect.

Paper

Scheduling of Streaming Data Processing with Overload of Resources using Genetic Algorithm

Topics: Applications: Image Processing and Artificial Vision, Pattern Recognition, Decision Making, Industrial and Real World applications, Financial Applications, Neural Prostheses and Medical Applications, Neural based Data Mining and Complex Information Proces; Genetic Algorithms; Multi-agent Intelligent Systems and Applications

Authors: Mikhail Melnik ; Denis Nasonov and Nikolay Butakov

Affiliation: ITMO University, Saint-Petersburg and Russia

ISBN: 978-989-758-327-8

Keyword(s): Stream Data Processing, Adaptive Scheduling, Performance Modeling, Simulation, Cloud Computing.

Abstract: The growing demand for processing of streaming data contributes to the development of distributed streaming platforms, such as Apache Storm or Flink. However, the volume of data and complexity of their processing is growing extremely fast, which poses new challenges and tasks for developing new tools and methods for improving the efficiency of streaming data processing. One of the main ways to improve a system performance is an effective scheduling and a proper configuration of the computing platform. Running large-scale streaming applications, especially in the clouds, requires a high cost of computing resources and additional efforts to deploy and support an application itself. Thus, there is a need for an opportunity to estimate the performance of the system and its behaviour before real calculations are made. Therefore, in this work we propose a model for distributed data stream processing, stream scheduling problem statement and a developed simulator of the streaming platform, im mediately allowing to explore the behaviour of the system under various conditions. In addition, we propose a genetic algorithm for efficient stream scheduling and conducting experimental studies. (More)

PDF ImageFull Text

Download
Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 34.229.24.100

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Melnik, M.; Nasonov, D. and Butakov, N. (2018). Scheduling of Streaming Data Processing with Overload of Resources using Genetic Algorithm.In Proceedings of the 10th International Joint Conference on Computational Intelligence - Volume 1: IJCCI, ISBN 978-989-758-327-8, pages 232-241. DOI: 10.5220/0006951902320241

@conference{ijcci18,
author={Mikhail Melnik. and Denis Nasonov. and Nikolay Butakov.},
title={Scheduling of Streaming Data Processing with Overload of Resources using Genetic Algorithm},
booktitle={Proceedings of the 10th International Joint Conference on Computational Intelligence - Volume 1: IJCCI,},
year={2018},
pages={232-241},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006951902320241},
isbn={978-989-758-327-8},
}

TY - CONF

JO - Proceedings of the 10th International Joint Conference on Computational Intelligence - Volume 1: IJCCI,
TI - Scheduling of Streaming Data Processing with Overload of Resources using Genetic Algorithm
SN - 978-989-758-327-8
AU - Melnik, M.
AU - Nasonov, D.
AU - Butakov, N.
PY - 2018
SP - 232
EP - 241
DO - 10.5220/0006951902320241

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.