loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Marco Cavallo ; Giuseppe Di Modica ; Carmelo Polito and Orazio Tomarchio

Affiliation: University of Catania, Italy

Keyword(s): Big Data, MapReduce, Hierarchical Hadoop, Job Scheduling, LAHC.

Abstract: The wide spread adoption of IoT technologies has resulted in generation of huge amount of data, or Big Data, which has to be collected, stored and processed through new techniques to produce value in the best possible way. Distributed computing frameworks such as Hadoop, based on the MapReduce paradigm, have been used to process such amounts of data by exploiting the computing power of many cluster nodes. Unfortunately, in many real big data applications the data to be processed reside in various computationally heterogeneous data centers distributed in different locations. In this context the Hadoop performance collapses dramatically. To face this issue, we developed a Hierarchical Hadoop Framework (H2F) capable of scheduling and distributing tasks among geographically distant clusters in a way that minimizes the overall jobs execution time. In this work the focus is put on the definition of a job scheduling system based on a one-point iterative search algorithm that increases the f ramework scalability while guaranteeing good job performance. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 52.91.177.91

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Cavallo, M.; Di Modica, G.; Polito, C. and Tomarchio, O. (2017). A LAHC-based Job Scheduling Strategy to Improve Big Data Processing in Geo-distributed Contexts. In Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - IoTBDS; ISBN 978-989-758-245-5; ISSN 2184-4976, SciTePress, pages 92-101. DOI: 10.5220/0006307100920101

@conference{iotbds17,
author={Marco Cavallo. and Giuseppe {Di Modica}. and Carmelo Polito. and Orazio Tomarchio.},
title={A LAHC-based Job Scheduling Strategy to Improve Big Data Processing in Geo-distributed Contexts},
booktitle={Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - IoTBDS},
year={2017},
pages={92-101},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006307100920101},
isbn={978-989-758-245-5},
issn={2184-4976},
}

TY - CONF

JO - Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - IoTBDS
TI - A LAHC-based Job Scheduling Strategy to Improve Big Data Processing in Geo-distributed Contexts
SN - 978-989-758-245-5
IS - 2184-4976
AU - Cavallo, M.
AU - Di Modica, G.
AU - Polito, C.
AU - Tomarchio, O.
PY - 2017
SP - 92
EP - 101
DO - 10.5220/0006307100920101
PB - SciTePress