User-based Load Balancer in HBase

Ahmad Ghandour, Mariam Moukalled, Mohamad Jaber, Yliès Falcone

2017

Abstract

Latency of read and write operations is an important measure in relational and non-relational databases. Load balancing is one of the features that manages the distribution of the load between nodes in case of distributed servers to improve the overall performance. In this paper, we introduce a new load balancer to HBase (a non-relation database), which monitors the most requested keys and dynamically acts to redistribute the regions by splitting and moving them. Our load balancer takes into account the average response time of clients’ requests and the most requested keys. Our method is fully implemented and can be integrated in HBase distribution. Experimental results show that we get on average an improvement of latency of 15%, and up to 35% in some scenarios.

References

  1. Chang, F., Dean, J., Ghemawat, S., Hsieh, W. C., Wallach, D. A., Burrows, M., Chandra, T., Fikes, A., and Gruber, R. E. (2008). Bigtable: A distributed storage system for structured data. ACM Trans. Comput. Syst., 26(2).
  2. Favored Node Load Balancer (2016). Favored Node Load Balancer. https://hbase.apache.org/ devapidocs/org/apache/hadoop/hbase/master/ balancer/FavoredNodeLoadBalancer.html.
  3. Ghemawat, S., Gobioff, H., and Leung, S. (2003). The google file system. In Proceedings of the 19th ACM Symposium on Operating Systems Principles 2003, SOSP 2003, Bolton Landing, NY, USA, October 19- 22, 2003, pages 29-43.
  4. Hadoop (2016). HDFS. https://hadoop.apache.org/ docs/r1.2.1/hdfs_design.html.
  5. Hannibal (2016). Hannibal HBase. https://github.com/ sentric/hannibal.
  6. Kewal Panchputre, P. C. and Garg, R. (2016). Localityaware load balancer for hbase. Technical report, University of Minnesota, Twin Cities.
  7. Sharov, A., Shraer, A., Merchant, A., and Stokely, M. (2015). Take me to your leader! online optimization of distributed storage configurations. PVLDB, 8(12):1490-1501.
  8. Simple Load Balancer (2016). Simple Load Balancer. https://hbase.apache.org/devapidocs/ org/apache/hadoop/hbase/master/balancer/ SimpleLoadBalancer.html.
  9. Stochastic Load Balancer (2016). Stochastic Load Balancer. https://hbase.apache.org/devapidocs/ org/apache/hadoop/hbase/master/balancer/ StochasticLoadBalancer.html.
Download


Paper Citation


in Harvard Style

Ghandour A., Moukalled M., Jaber M. and Falcone Y. (2017). User-based Load Balancer in HBase . In Proceedings of the 7th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-243-1, pages 392-396. DOI: 10.5220/0006290103920396


in Bibtex Style

@conference{closer17,
author={Ahmad Ghandour and Mariam Moukalled and Mohamad Jaber and Yliès Falcone},
title={User-based Load Balancer in HBase},
booktitle={Proceedings of the 7th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2017},
pages={392-396},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006290103920396},
isbn={978-989-758-243-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 7th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - User-based Load Balancer in HBase
SN - 978-989-758-243-1
AU - Ghandour A.
AU - Moukalled M.
AU - Jaber M.
AU - Falcone Y.
PY - 2017
SP - 392
EP - 396
DO - 10.5220/0006290103920396