Evaluating the User Acceptance Testing for Multi-tenant Cloud Applications

Victor Hugo Santiago C. Pinto, Ricardo R. Oliveira, Ricardo F. Vilela, Simone R. S. Souza

Abstract

SaaS (Software as a Service) is a service delivery model in which an application can be provided on demand via the Internet. Multi-tenant architecture is essential for SaaS because it enables multiple customers, so-called tenants, to share the system's resources in a transparent way to reduce costs and customize the software layer, resulting in variant applications. Despite the popularity of this model, there have been few cases of evaluation of software testing in cloud computing. Many researchers argue that traditional software testing may not be a suitable way of validating cloud applications owing to the high degree of customization, its dynamic environment and multi-tenancy. User Acceptance Testing (UAT) evaluates the external quality of a product and complements previous testing activities. The main focus of this paper is on investigating the ability of the parallel and automated UAT to detect faults with regard to the number of tenants. Thus, our aim is to evaluate to what extent the ability to detect faults varies if a different number of variant applications is executed. A case study was designed with a multi-tenant application called iCardapio and a testing framework created through Selenium and JUnit extensions. The results showed a significant difference in terms of detected faults when test scenarios with a single-tenant and multi-tenant were included.

Download


Paper Citation


in Harvard Style

Hugo Santiago C. Pinto V., R. Oliveira R., F. Vilela R. and R. S. Souza S. (2018). Evaluating the User Acceptance Testing for Multi-tenant Cloud Applications.In Proceedings of the 8th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-295-0, pages 47-56. DOI: 10.5220/0006664000470056


in Bibtex Style

@conference{closer18,
author={Victor Hugo Santiago C. Pinto and Ricardo R. Oliveira and Ricardo F. Vilela and Simone R. S. Souza},
title={Evaluating the User Acceptance Testing for Multi-tenant Cloud Applications},
booktitle={Proceedings of the 8th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2018},
pages={47-56},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006664000470056},
isbn={978-989-758-295-0},
}


in EndNote Style

TY - CONF

JO - Proceedings of the 8th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - Evaluating the User Acceptance Testing for Multi-tenant Cloud Applications
SN - 978-989-758-295-0
AU - Hugo Santiago C. Pinto V.
AU - R. Oliveira R.
AU - F. Vilela R.
AU - R. S. Souza S.
PY - 2018
SP - 47
EP - 56
DO - 10.5220/0006664000470056