Edge Anomaly Detection Framework for AIOps in Cloud and IoT

Pieter Moens, Bavo Andriessen, Merlijn Sebrechts, Bruno Volckaert, Sofie Van Hoecke

2023

Abstract

Artificial Intelligence for IT Operations (AIOps) addresses the rising complexity of cloud computing and Internet of Things by assisting DevOps engineers to monitor and maintain applications. Machine Learning is an essential part of AIOps, enabling it to perform Anomaly Detection and Root Cause Analysis. These techniques are often executed in centralized components, however, which requires transferring vast amounts of data to a central location. This increase in network traffic causes strain on the network and results in higher latency. This paper leverages edge computing to address this issue by deploying ML models closer to the monitored services, reducing the network overhead. This paper investigates two architectural approaches: a sidecar architecture and a federated architecture, and highlights their advantages and shortcomings in different scenarios. Taking this into account, it proposes a framework that orchestrates the deployment and management of distributed edge ML models. Additionally, the paper introduces a Python library to assist data scientists during the development of AIOps techniques and concludes with a thorough evaluation of the resulting framework towards resource consumption and scalability. The results indicate up to 98.3% reduction in network usage depending on the configuration used while maintaining a minimal increase in resource usage at the edge.

Paper Citation

in Harvard Style

Moens P., Andriessen B., Sebrechts M., Volckaert B. and Van Hoecke S. (2023). Edge Anomaly Detection Framework for AIOps in Cloud and IoT. In Proceedings of the 13th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-650-7, SciTePress, pages 204-211. DOI: 10.5220/0011838600003488

in Bibtex Style

@conference{closer23,
author={Pieter Moens and Bavo Andriessen and Merlijn Sebrechts and Bruno Volckaert and Sofie Van Hoecke},
title={Edge Anomaly Detection Framework for AIOps in Cloud and IoT},
booktitle={Proceedings of the 13th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2023},
pages={204-211},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011838600003488},
isbn={978-989-758-650-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - Edge Anomaly Detection Framework for AIOps in Cloud and IoT
SN - 978-989-758-650-7
AU - Moens P.
AU - Andriessen B.
AU - Sebrechts M.
AU - Volckaert B.
AU - Van Hoecke S.
PY - 2023
SP - 204
EP - 211
DO - 10.5220/0011838600003488
PB - SciTePress