Making Cloud-based Systems Elasticity Testing Reproducible

Michel Albonico, Jean-Marie Mottu, Gerson Sunyé, Frederico Alvares


Elastic Cloud infrastructures are capable of dynamically varying computational resources at large scale, which is error-prone by nature. Elasticity-related errors are detected thanks to tests that should run deterministically many times all along the development. However, elasticity testing reproduction requires several features not supported natively by the main cloud providers, such as Amazon EC2. We identify three requirements that we claim to be indispensable to ensure elasticity testing reproducibility: to control the elasticity behavior, to select specific resources to be unallocated, and coordinate events parallel to elasticity. In this paper, we propose an approach fulfilling those requirements and making the elasticity testing reproducible. Experimental results show that our approach successfully reproduces elasticity-related bugs that need the requirements we claim in this paper.


  1. Albonico, M., Mottu, J.-M., and Sunyé, G. (2016). Controlling the Elasticity of Web Applications on Cloud Computing. In The 31st SAC 2016, Pisa, Italy. ACM/SIGAPP.
  2. Banzai, T., Koizumi, H., Kanbayashi, R., Imada, T., Hanawa, T., and Sato, M. (2010). D-Cloud: Design of a Software Testing Environment for Reliable Distributed Systems Using Cloud Computing Technology. In Proceedings of CCGRID'10, Washington, USA.
  3. Bersani, M. M., Bianculli, D., Dustdar, S., Gambi, A., Ghezzi, C., and Krstic, S. (2014). Towards the Formalization of Properties of Cloud-based Elastic Systems. In Proceedings of PESOS 2014, New York, NY, USA. ACM.
  4. Cooper, B. F., Silberstein, A., Tam, E., Ramakrishnan, R., and Sears, R. (2010). Benchmarking Cloud Serving Systems with YCSB. In Proceedings of SoCC'10, New York, NY, USA. ACM.
  5. Engstrom, E., Runeson, P., and Skoglund, M. (2010). A systematic review on regression test selection techniques. Information and Software Technology, 52(1):14-30.
  6. Gambi, A., Hummer, W., and Dustdar, S. (2013a). Automated testing of cloud-based elastic systems with AUToCLES. In The proceedings of ASE'13, pages 714- 717. IEEE/ACM.
  7. Gambi, A., Hummer, W., Truong, H.-L., and Dustdar, S. (2013b). Testing Elastic Computing Systems. IEEE Internet Computing, 17(6):76-82.
  8. Herbst, N. R., Kounev, S., and Reussner, R. (2013). Elasticity in Cloud Computing: What It Is, and What It Is Not. ICAC.
  9. Hunt, P., Konar, M., Junqueira, F. P., and Reed, B. (2010). Zookeeper: Wait-free coordination for internet-scale systems. In 2010 USENIX, Boston, MA, USA, 2010.
  10. Li, K., Joshi, P., Gupta, A., and Ganai, M. K. (2014). ReproLite: A Lightweight Tool to Quickly Reproduce Hard System Bugs. In Proceedings of SOCC'14, New York, NY, USA.
  11. Thiery, A., Cerqueus, T., Thorpe, C., Sunye, G., and Murphy, J. (2014). A DSL for Deployment and Testing in the Cloud. In Proc. of the IEEE ICSTW 2014, pages 376-382.
  12. Vasar, M., Srirama, S. N., and Dumas, M. (2012). Framework for Monitoring and Testing Web Application Scalability on the Cloud. In Proc. of WICSA/ECSA Companion, NY, USA.
  13. Yin, L., Zeng, J., Liu, F., and Li, B. (2013). CTPV: A Cloud Testing Platform Based on Virtualization. In The proceedings of SOSE'13.

Paper Citation

in Harvard Style

Albonico M., Mottu J., Sunyé G. and Alvares F. (2017). Making Cloud-based Systems Elasticity Testing Reproducible . In Proceedings of the 7th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-243-1, pages 523-530. DOI: 10.5220/0006308905230530

in Bibtex Style

author={Michel Albonico and Jean-Marie Mottu and Gerson Sunyé and Frederico Alvares},
title={Making Cloud-based Systems Elasticity Testing Reproducible},
booktitle={Proceedings of the 7th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},

in EndNote Style

JO - Proceedings of the 7th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - Making Cloud-based Systems Elasticity Testing Reproducible
SN - 978-989-758-243-1
AU - Albonico M.
AU - Mottu J.
AU - Sunyé G.
AU - Alvares F.
PY - 2017
SP - 523
EP - 530
DO - 10.5220/0006308905230530