loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Bing Li and Ke Xu

Affiliation: Beijing University of Posts and Telecommunications, China

Keyword(s): Hadoop, HDFS, Network congestion, Hot spots detection, Adaptive replica control.

Abstract: With the development of Cloud Computing, Hadoop –an Infrastructure as a Service open source project of Apache – has been used more and more widely. As the basis of Hadoop, the Hadoop Distributed File System (HDFS) provides basic function of file storage. HDFS-an open source implementation of Google File System (GFS) –was designed for specific demand. Once the demand was changed, HDFS cannot fit it very well. Especially when the access demand of file is different, there will be hot spots and the existing replica will not be enough. It will lower the efficiency of the whole system. This paper introduced a system-level strategy which could adjust the replica number of specific file dynamically. And the experiment shows that this mechanism can prevent the problem of decline of user experience bring by hot spots and improve the overall efficiency.

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 44.221.46.132

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Li, B. and Xu, K. (2011). A METHOD OF ADJUSTING THE NUMBER OF REPLICA DYNAMICALLY IN HDFS. In Proceedings of the 13th International Conference on Enterprise Information Systems (ICEIS 2011) - Volume 2: SSE; ISBN 978-989-8425-53-9; ISSN 2184-4992, SciTePress, pages 529-533. DOI: 10.5220/0003587005290533

@conference{sse11,
author={Bing Li. and Ke Xu.},
title={A METHOD OF ADJUSTING THE NUMBER OF REPLICA DYNAMICALLY IN HDFS},
booktitle={Proceedings of the 13th International Conference on Enterprise Information Systems (ICEIS 2011) - Volume 2: SSE},
year={2011},
pages={529-533},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003587005290533},
isbn={978-989-8425-53-9},
issn={2184-4992},
}

TY - CONF

JO - Proceedings of the 13th International Conference on Enterprise Information Systems (ICEIS 2011) - Volume 2: SSE
TI - A METHOD OF ADJUSTING THE NUMBER OF REPLICA DYNAMICALLY IN HDFS
SN - 978-989-8425-53-9
IS - 2184-4992
AU - Li, B.
AU - Xu, K.
PY - 2011
SP - 529
EP - 533
DO - 10.5220/0003587005290533
PB - SciTePress