loading
Papers

Research.Publish.Connect.

Paper

Authors: Marco Cavallo ; Giuseppe Di Modica ; Carmelo Polito and Orazio Tomarchio

Affiliation: University of Catania, Italy

ISBN: 978-989-758-245-5

Keyword(s): Big Data, MapReduce, Hierarchical Hadoop, Job Scheduling, LAHC.

Abstract: The wide spread adoption of IoT technologies has resulted in generation of huge amount of data, or Big Data, which has to be collected, stored and processed through new techniques to produce value in the best possible way. Distributed computing frameworks such as Hadoop, based on the MapReduce paradigm, have been used to process such amounts of data by exploiting the computing power of many cluster nodes. Unfortunately, in many real big data applications the data to be processed reside in various computationally heterogeneous data centers distributed in different locations. In this context the Hadoop performance collapses dramatically. To face this issue, we developed a Hierarchical Hadoop Framework (H2F) capable of scheduling and distributing tasks among geographically distant clusters in a way that minimizes the overall jobs execution time. In this work the focus is put on the definition of a job scheduling system based on a one-point iterative search algorithm that increases the fr amework scalability while guaranteeing good job performance. (More)

PDF ImageFull Text

Download
CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 34.236.216.93

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Cavallo, M.; Di Modica, G.; Polito, C. and Tomarchio, O. (2017). A LAHC-based Job Scheduling Strategy to Improve Big Data Processing in Geo-distributed Contexts.In Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS, ISBN 978-989-758-245-5, pages 92-101. DOI: 10.5220/0006307100920101

@conference{iotbds17,
author={Marco Cavallo. and Giuseppe Di Modica. and Carmelo Polito. and Orazio Tomarchio.},
title={A LAHC-based Job Scheduling Strategy to Improve Big Data Processing in Geo-distributed Contexts},
booktitle={Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS,},
year={2017},
pages={92-101},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006307100920101},
isbn={978-989-758-245-5},
}

TY - CONF

JO - Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS,
TI - A LAHC-based Job Scheduling Strategy to Improve Big Data Processing in Geo-distributed Contexts
SN - 978-989-758-245-5
AU - Cavallo, M.
AU - Di Modica, G.
AU - Polito, C.
AU - Tomarchio, O.
PY - 2017
SP - 92
EP - 101
DO - 10.5220/0006307100920101

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.