FaaS Benchmarking over Orama Framework's Distributed Architecture

Leonardo Rebouças de Carvalho, Bruno Kamienski, Aleteia Araujo

2023

Abstract

As the adoption of Function-as-a-Service-oriented solutions grows, interest in tools that enable the execution of benchmarks on these environments increases. The Orama framework stands out in this context by offering a highly configurable and scalable solution to aid in provisioning, running benchmarks and comparative and statistical analysis of results. In this work, a distributed architecture for the Orama framework is presented, through which it is possible to run benchmarks with high levels of concurrency, as well as with bursts of geographically dispersed requests, just as in real environments. The results of the experiment showed that the proposed architecture was able to divide the loads between the distributed workers and able to consolidate properly in the return of the results. In addition, it was possible to observe specific characteristics of the providers involved in the experiment, such as the excellent performance of Alibaba Function, whose average execution time was the lowest of the tests and free of failures. Google Cloud Function and AWS Lambda recorded intermediate results for average execution time and recorded failures. Finally, Azure Function had the worst results in average execution time and cold start.

Paper Citation

in Harvard Style

Rebouças de Carvalho L., Kamienski B. and Araujo A. (2023). FaaS Benchmarking over Orama Framework's Distributed Architecture. In Proceedings of the 13th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-650-7, SciTePress, pages 67-77. DOI: 10.5220/0011948400003488

in Bibtex Style

@conference{closer23,
author={Leonardo Rebouças de Carvalho and Bruno Kamienski and Aleteia Araujo},
title={FaaS Benchmarking over Orama Framework's Distributed Architecture},
booktitle={Proceedings of the 13th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2023},
pages={67-77},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011948400003488},
isbn={978-989-758-650-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - FaaS Benchmarking over Orama Framework's Distributed Architecture
SN - 978-989-758-650-7
AU - Rebouças de Carvalho L.
AU - Kamienski B.
AU - Araujo A.
PY - 2023
SP - 67
EP - 77
DO - 10.5220/0011948400003488
PB - SciTePress