The Ability of Cloud Computing Performance Benchmarks to Measure Dependability

Eduardo Carvalho, Raul Barbosa, Jorge Bernardino

2017

Abstract

Current benchmarks focus on evaluating performance with little efforts made to evaluate the dependability characteristics of the cloud. Cloud computing has several advantages like scalability, elasticity and cost reduction, this led companies to move their applications to the cloud. The availability of applications and consequently businesses are then dependant on the cloud’s efforts to keep its services running. To guarantee reliability and trust, benchmarking dependability is a challenging task because of the cloud layered model which makes it difficult to predict the root of faults as higher layers are dependant of lower layers. By integrating dependability in benchmarks as a metric, we can evaluate how well does the cloud handle itself when faults occur, prevent those faults and check not only raw performance but also trust. In this paper, we study the following cloud benchmarks: Spec IaaS 2016, TPCx-V, YCSB, Perfkit Benchmarker, CloudBench, DS-Bench/D-Cloud, and evaluate if they are suitable for benchmarking dependability.

Paper Citation

in Harvard Style

Carvalho E., Barbosa R. and Bernardino J. (2017). The Ability of Cloud Computing Performance Benchmarks to Measure Dependability . In Proceedings of the 12th International Conference on Software Technologies - Volume 1: ICSOFT, ISBN 978-989-758-262-2, pages 447-452. DOI: 10.5220/0006472404470452

in Bibtex Style

@conference{icsoft17,
author={Eduardo Carvalho and Raul Barbosa and Jorge Bernardino},
title={The Ability of Cloud Computing Performance Benchmarks to Measure Dependability},
booktitle={Proceedings of the 12th International Conference on Software Technologies - Volume 1: ICSOFT,},
year={2017},
pages={447-452},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006472404470452},
isbn={978-989-758-262-2},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Conference on Software Technologies - Volume 1: ICSOFT,
TI - The Ability of Cloud Computing Performance Benchmarks to Measure Dependability
SN - 978-989-758-262-2
AU - Carvalho E.
AU - Barbosa R.
AU - Bernardino J.
PY - 2017
SP - 447
EP - 452
DO - 10.5220/0006472404470452