A METHOD OF ADJUSTING THE NUMBER OF REPLICA DYNAMICALLY IN HDFS

Bing Li; Ke Xu

Research.Publish.Connect.

*Please fill out at least one Field. *Value must be an number!

Title:
ISBN:
Year:
Acronym:
Subject:

Advanced Search Proceedings Search

If you're looking for an exact phrase use quotation marks on text fields.

*Please fill out at least one Field.

Title:
Author:
Affiliation:
Subject:

Advanced Search Papers Search

If you're looking for an exact phrase use quotation marks on text fields.

*Please fill out at least one Field.

Name:
Affiliation:
Country:
Conference:
Subject:

Advanced Search Authors Search

If you're looking for an exact phrase use quotation marks on text fields.

*Please fill out at least one Field.

Name:
Country:
Subject:

Advanced Search Affiliations Search

If you're looking for an exact phrase use quotation marks on text fields.

Proceedings

Proceedings Search *Please fill out at least one Field. *Value must be an number!

Title:
ISBN:
Year:
Acronym:
Subject:

Advanced Search Proceedings Search

If you're looking for an exact phrase use quotation marks on text fields.

Papers

Papers Search *Please fill out at least one Field.

Title:
Author:
Affiliation:
Subject:

Advanced Search Papers Search

If you're looking for an exact phrase use quotation marks on text fields.

Authors

Authors Search *Please fill out at least one Field.

Name:
Affiliation:
Country:
Conference:
Subject:

Advanced Search Authors Search

If you're looking for an exact phrase use quotation marks on text fields.

Advanced Search

Paper

A METHOD OF ADJUSTING THE NUMBER OF REPLICA DYNAMICALLY IN HDFS

In Proceedings of the 13th International Conference on Enterprise Information Systems - Volume 2: SSE, 529-533, 2011 , Beijing, China

Authors: Bing Li and Ke Xu

Affiliation: Beijing University of Posts and Telecommunications, China

Keyword(s): Hadoop, HDFS, Network congestion, Hot spots detection, Adaptive replica control.

Abstract: With the development of Cloud Computing, Hadoop –an Infrastructure as a Service open source project of Apache – has been used more and more widely. As the basis of Hadoop, the Hadoop Distributed File System (HDFS) provides basic function of file storage. HDFS-an open source implementation of Google File System (GFS) –was designed for specific demand. Once the demand was changed, HDFS cannot fit it very well. Especially when the access demand of file is different, there will be hot spots and the existing replica will not be enough. It will lower the efficiency of the whole system. This paper introduced a system-level strategy which could adjust the replica number of specific file dynamically. And the experiment shows that this mechanism can prevent the problem of decline of user experience bring by hot spots and improve the overall efficiency.

CC BY-NC-ND 4.0

Guest: Register as new SciTePress user now for free.

SciTePress user: please login.

My Papers

You are not signed in, therefore limits apply to your IP address 3.141.2.191

In the current month:

Recent papers: 100 available of 100 total

2⁺ years older papers: 200 available of 200 total

Paper citation in several formats:

Li, B. and Xu, K. (2011). A METHOD OF ADJUSTING THE NUMBER OF REPLICA DYNAMICALLY IN HDFS. In Proceedings of the 13th International Conference on Enterprise Information Systems (ICEIS 2011) - Volume 2: SSE; ISBN 978-989-8425-53-9; ISSN 2184-4992, SciTePress, pages 529-533. DOI: 10.5220/0003587005290533

@conference{sse11,
author={Bing Li. and Ke Xu.},
title={A METHOD OF ADJUSTING THE NUMBER OF REPLICA DYNAMICALLY IN HDFS},
booktitle={Proceedings of the 13th International Conference on Enterprise Information Systems (ICEIS 2011) - Volume 2: SSE},
year={2011},
pages={529-533},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003587005290533},
isbn={978-989-8425-53-9},
issn={2184-4992},
}

TY - CONF

JO - Proceedings of the 13th International Conference on Enterprise Information Systems (ICEIS 2011) - Volume 2: SSE
TI - A METHOD OF ADJUSTING THE NUMBER OF REPLICA DYNAMICALLY IN HDFS
SN - 978-989-8425-53-9
IS - 2184-4992
AU - Li, B.
AU - Xu, K.
PY - 2011
SP - 529
EP - 533
DO - 10.5220/0003587005290533
PB - SciTePress