loading
Papers

Research.Publish.Connect.

Paper

Authors: Aleksey Burdakov ; Uriy Grigorev ; Victoria Proletarskaya and Artem Ustimov

Affiliation: Bauman Moscow State Technical University, Russian Federation

ISBN: 978-989-758-245-5

Keyword(s): MapReduce, Data Warehouse, MFRJ Access Method, Analytical Model, Adequacy.

Abstract: The growing number of MapReduce applications makes the Data Warehouse access time estimating an important task. The problem is that processing of large data requires significant time that may exceed the required thresholds. Fixing these problems discovered at the system operations stage is very costly. That is why it is beneficial to estimate the data processing time for peak loads at the design stage, i.e. before the MapReduce tasks implementation. This allows making timely design decisions. In this case mathematical models serve as an unreplaceable analytical instrument. This paper provides an overview of the n-dimensional MapReduce-based Data Warehouse Multi-Fragment-Replication Join (MFRJ) access method. It analyzes MapReduce workflow, and develops an analytical model that estimates Data Warehouse query execution average time. The modeling results allow a system designer to provide recommendations on the technical parameters of the query execution environment, Data Warehouse and t he query itself. This is important in cases where there are restrictions imposed on the query execution time. The experiment preparation and execution in a cloud environment for model adequacy analysis are evaluated and described. (More)

PDF ImageFull Text

Download
CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 34.204.173.45

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Burdakov, A.; Grigorev, U.; Proletarskaya, V. and Ustimov, A. (2017). Data Warehouse MFRJ Query Execution Model for MapReduce.In Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS, ISBN 978-989-758-245-5, pages 206-215. DOI: 10.5220/0006238502060215

@conference{iotbds17,
author={Aleksey Burdakov. and Uriy Grigorev. and Victoria Proletarskaya. and Artem Ustimov.},
title={Data Warehouse MFRJ Query Execution Model for MapReduce},
booktitle={Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS,},
year={2017},
pages={206-215},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006238502060215},
isbn={978-989-758-245-5},
}

TY - CONF

JO - Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS,
TI - Data Warehouse MFRJ Query Execution Model for MapReduce
SN - 978-989-758-245-5
AU - Burdakov, A.
AU - Grigorev, U.
AU - Proletarskaya, V.
AU - Ustimov, A.
PY - 2017
SP - 206
EP - 215
DO - 10.5220/0006238502060215

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.