Towards Short Test Sequences for Performance Assessment of Elastic Cloud-based Systems

Michel Albonico, Paulo Varela

2019

Abstract

Elasticity is one of the main features of cloud-based systems (CBS), helping them to meet performance requirements under a varying workload. Given the great number of combinations among workload and elastic adaptation parameters, assessing their effect on CBS performance may be prohibitive. Existing systematic combinatorial testing approaches can help to reduce such combinations, though most of them only consider conventional software architectures. In the literature, we only find a single work on elastic CBS combinatorial testing, presented by some of the authors. However, the paper only presents experimental results on 2-wise elasticity parameter interactions and shallowly explores the performance issue causes. In this paper, we lead a further experiment by using our previous approach to generate performance test cases that cover three elasticity parameter interactions (i. e., 3-wise), one interaction longer than on the previous paper. Despite the significant increase in execution time and cost, new experimental results do not reveal any new critical performance issue by 3-wise, which enforces the acceptance of 2-wise elasticity parameter interactions.

Paper Citation

in Harvard Style

Albonico M. and Varela P. (2019). Towards Short Test Sequences for Performance Assessment of Elastic Cloud-based Systems.In Proceedings of the 9th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-365-0, pages 165-175. DOI: 10.5220/0007758501650175

in Bibtex Style

@conference{closer19,
author={Michel Albonico and Paulo Varela},
title={Towards Short Test Sequences for Performance Assessment of Elastic Cloud-based Systems},
booktitle={Proceedings of the 9th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2019},
pages={165-175},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007758501650175},
isbn={978-989-758-365-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 9th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - Towards Short Test Sequences for Performance Assessment of Elastic Cloud-based Systems
SN - 978-989-758-365-0
AU - Albonico M.
AU - Varela P.
PY - 2019
SP - 165
EP - 175
DO - 10.5220/0007758501650175