Orama: A Benchmark Framework for Function-as-a-Service

Leonardo Carvalho, Aleteia Araujo

2022

Abstract

The prominent Function-as-a-Service (FaaS) cloud service model has positioned itself as an alternative for solving several problems, and, interest in cloud-oriented architectural solutions that use FaaS has therefore grown rapidly. Consequently, the importance of knowing the behavior of FaaS-based architectures under different concurrency scenarios has also become significant, especially in implementation decision-making processes. In this work, the Orama framework is proposed, which helps in the execution of benchmarks in FaaS-based environments, orchestrating the deployment of pre-built architectures, as well as the execution of tests and statistical analysis. Experiments were carried out with architectures containing multiple cloud services in conjunction with FaaS in two public cloud providers (AWS and GCP). The results were analyzed using factorial design and t-test and showed that the use cases running on AWS obtained better results in runtime compared to their counterparts on GCP, but showed considerable error rates in competition situations. It is worth mentioning that the Orama framework was used from in the automated provisioning of use cases, execution of benchmarks, analysis of results and deprovisioning of the environment, supporting the entire process.

Paper Citation

in Harvard Style

Carvalho L. and Araujo A. (2022). Orama: A Benchmark Framework for Function-as-a-Service. In Proceedings of the 12th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-570-8, pages 313-322. DOI: 10.5220/0011113900003200

in Bibtex Style

@conference{closer22,
author={Leonardo Carvalho and Aleteia Araujo},
title={Orama: A Benchmark Framework for Function-as-a-Service},
booktitle={Proceedings of the 12th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2022},
pages={313-322},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011113900003200},
isbn={978-989-758-570-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 12th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - Orama: A Benchmark Framework for Function-as-a-Service
SN - 978-989-758-570-8
AU - Carvalho L.
AU - Araujo A.
PY - 2022
SP - 313
EP - 322
DO - 10.5220/0011113900003200