An Elastic Cache Infrastructure through Multi-level Load-balancing

Carlos Lübbe, Bernhard Mitschang

2013

Abstract

An increasing demand for geographic data compels data providers to handle an enormous amount of range queries at their data tier. In answer to this, frequently used data can be cached in a distributed main memory store in which the load is balanced among multiple cache nodes. To make appropriate load-balancing decisions, several key-indicators such as expected and actual workload as well as data skew can be used. In this work, we make use of an abstract mathematical model to consolidate these indicators. Moreover, we propose a multi-level load-balancing algorithm which considers the different indicators in separate stages. Our evaluation shows that our multi-level approach significantly improves the resource utilization in comparison to existing technology.

References

  1. Aberer, K. et al. (2005). Indexing data-oriented overlay networks. In VLDB, pages 685-696. VLDB Endowment.
  2. Bose, P. et al. (1999). Online routing in triangulations. In ISAAC, pages 113-122, London, UK. SpringerVerlag.
  3. de Berg, M. et al. (2000). Computational Geometry: Algorithms and Applications. Springer.
  4. Grinstead, C. M. et al. (2006). Grinstead and Snell's Introduction to Probability. AMS.
  5. Lee, D.-Y. et al. (2008). Efficient and accurate protocols for distributed delaunay triangulation under churn. In ICNP, pages 124-136.
  6. Lübbe, C. et al. (2012). Elastic load-balancing in a distributed spatial cache overlay. In MDM 7812, pages 11-20, Washington, DC, USA. IEEE.
  7. Lübbe et al., C. (2011). DiSCO: A Distributed Semantic Cache Overlay for Location-based Services. In MDM 7811, pages 17-26, Washington, DC, USA. IEEE.
  8. Lübbe et al., C. (2013). Holistic Load-Balancing in a Distributed Spatial Cache. In MDM 7813, Washington, DC, USA. IEEE.
  9. Macqueen, J. B. (1967). Some methods of classification and analysis of multivariate observations. In Berkeley Symp. on Mathematical Statistics and Probability, pages 281-297.
  10. Montresor, A. et al. (2009). PeerSim: A scalable P2P simulator. In P2P, pages 99-100, Seattle, USA.
  11. Morton, G. (1966). A Computer Oriented Geodetic Data Base and a New Technique in File Sequencing. IBM.
  12. Scholl, T. et al. (2009). Workload-aware data partitioning in community-driven data grids. In EDBT, pages 36-47, New York, USA. ACM.
  13. Stoica, I. et al. (2001). Chord: A scalable peer-to-peer lookup service for internet appl. In SIGCOMM, pages 149-160, New York. ACM.
  14. Wang, H. et al. (2005). Aspen: an adaptive spatial peer-topeer network. In ACM GIS, pages 230-239, NY, USA. ACM.
Download


Paper Citation


in Harvard Style

Lübbe C. and Mitschang B. (2013). An Elastic Cache Infrastructure through Multi-level Load-balancing . In Proceedings of the 2nd International Conference on Data Technologies and Applications - Volume 1: DATA, ISBN 978-989-8565-67-9, pages 183-190. DOI: 10.5220/0004486001830190


in Bibtex Style

@conference{data13,
author={Carlos Lübbe and Bernhard Mitschang},
title={An Elastic Cache Infrastructure through Multi-level Load-balancing},
booktitle={Proceedings of the 2nd International Conference on Data Technologies and Applications - Volume 1: DATA,},
year={2013},
pages={183-190},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004486001830190},
isbn={978-989-8565-67-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Data Technologies and Applications - Volume 1: DATA,
TI - An Elastic Cache Infrastructure through Multi-level Load-balancing
SN - 978-989-8565-67-9
AU - Lübbe C.
AU - Mitschang B.
PY - 2013
SP - 183
EP - 190
DO - 10.5220/0004486001830190