Predicting and Avoiding SLA Violations of Containerized Applications using Machine Learning and Elasticity

Paulo Souza, Miguel Neves, Carlos Kayser, Felipe Rubin, Conrado Boeira, João Moreira, Bernardo Bordin, Tiago Ferreto

2022

Abstract

Container-based virtualization represents a low-overhead and easy-to-manage alternative to virtual machines. On the other hand, containers are more prone to performance interference and unpredictability. Consequently, there is growing interest in predicting and avoiding performance issues in containerized environments. Existing solutions tackle this challenge through proactive elasticity mechanisms based on workload variation predictions. Although this approach may yield satisfactory results in some scenarios, external factors such as resource contention can cause performance losses regardless of workload variations. This paper presents Flavor, a machine-learning-based system for predicting and avoiding performance issues in containerized applications. Rather than relying on workload variation prediction as existing approaches, Flavor predicts application-level metrics (e.g., query latency and throughput) through a deep neural network implemented using Tensorflow and scales applications accordingly. We evaluate Flavor by comparing it against a state-of-the-art resource scaling approach that relies solely on workload prediction. Our results show that Flavor can predict performance deviations effectively while assisting operators to wisely scale their services by increasing/decreasing the number of application containers to avoid performance issues and resource underutilization.

Paper Citation

in Harvard Style

Souza P., Neves M., Kayser C., Rubin F., Boeira C., Moreira J., Bordin B. and Ferreto T. (2022). Predicting and Avoiding SLA Violations of Containerized Applications using Machine Learning and Elasticity. In Proceedings of the 12th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-570-8, pages 74-85. DOI: 10.5220/0011085100003200

in Bibtex Style

@conference{closer22,
author={Paulo Souza and Miguel Neves and Carlos Kayser and Felipe Rubin and Conrado Boeira and João Moreira and Bernardo Bordin and Tiago Ferreto},
title={Predicting and Avoiding SLA Violations of Containerized Applications using Machine Learning and Elasticity},
booktitle={Proceedings of the 12th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2022},
pages={74-85},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011085100003200},
isbn={978-989-758-570-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 12th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - Predicting and Avoiding SLA Violations of Containerized Applications using Machine Learning and Elasticity
SN - 978-989-758-570-8
AU - Souza P.
AU - Neves M.
AU - Kayser C.
AU - Rubin F.
AU - Boeira C.
AU - Moreira J.
AU - Bordin B.
AU - Ferreto T.
PY - 2022
SP - 74
EP - 85
DO - 10.5220/0011085100003200