loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Aleksey Burdakov ; Uriy Grigorev ; Victoria Proletarskaya and Artem Ustimov

Affiliation: Bauman Moscow State Technical University, Russian Federation

Keyword(s): MapReduce, Data Warehouse, MFRJ Access Method, Analytical Model, Adequacy.

Abstract: The growing number of MapReduce applications makes the Data Warehouse access time estimating an important task. The problem is that processing of large data requires significant time that may exceed the required thresholds. Fixing these problems discovered at the system operations stage is very costly. That is why it is beneficial to estimate the data processing time for peak loads at the design stage, i.e. before the MapReduce tasks implementation. This allows making timely design decisions. In this case mathematical models serve as an unreplaceable analytical instrument. This paper provides an overview of the n-dimensional MapReduce-based Data Warehouse Multi-Fragment-Replication Join (MFRJ) access method. It analyzes MapReduce workflow, and develops an analytical model that estimates Data Warehouse query execution average time. The modeling results allow a system designer to provide recommendations on the technical parameters of the query execution environment, Data Warehouse and the query itself. This is important in cases where there are restrictions imposed on the query execution time. The experiment preparation and execution in a cloud environment for model adequacy analysis are evaluated and described. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 18.116.42.208

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Burdakov, A.; Grigorev, U.; Proletarskaya, V. and Ustimov, A. (2017). Data Warehouse MFRJ Query Execution Model for MapReduce. In Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - IoTBDS; ISBN 978-989-758-245-5; ISSN 2184-4976, SciTePress, pages 206-215. DOI: 10.5220/0006238502060215

@conference{iotbds17,
author={Aleksey Burdakov. and Uriy Grigorev. and Victoria Proletarskaya. and Artem Ustimov.},
title={Data Warehouse MFRJ Query Execution Model for MapReduce},
booktitle={Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - IoTBDS},
year={2017},
pages={206-215},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006238502060215},
isbn={978-989-758-245-5},
issn={2184-4976},
}

TY - CONF

JO - Proceedings of the 2nd International Conference on Internet of Things, Big Data and Security - IoTBDS
TI - Data Warehouse MFRJ Query Execution Model for MapReduce
SN - 978-989-758-245-5
IS - 2184-4976
AU - Burdakov, A.
AU - Grigorev, U.
AU - Proletarskaya, V.
AU - Ustimov, A.
PY - 2017
SP - 206
EP - 215
DO - 10.5220/0006238502060215
PB - SciTePress