Ensembled Outlier Detection using Multi-Variable Correlation in WSN through Unsupervised Learning Techniques

Marc Roig, Marisa Catalan, Bernat Gastón

2019

Abstract

Outlier detection in Wireless Sensor Networks is a crucial aspect in IoT, since cheap sensors tend to be seriously exposed to errors and inaccuracies. Hence, there is the need of a solution to improve the quality of the data without increasing the cost of the sensors. In Big Data paradigms, it is difficult to exploit the temporal correlation of sensors since Big Data architectures and technologies do not process data in order. In this paper, a complete study of multi-variable based outlier detection is carried out. Firstly, three known unsupervised algorithms are analysed (Elliptic Envelope, Isolation Forest and Local Outlier Factor) and are tested in a big data architecture. Secondly, an ensemble outlier detector (EOD) is created with the outputs of these algorithms and it is compared, in a Lab environment, with previous results for different parameters of contamination of the training set. The analysis of the results show that for correlated variables, multi-variable EOD has a very good detection rate with a very low false alarm rate. Finally, the EOD is used in a real world scenario in the city of Barcelona and the results are analysed using spectral-decomposition techniques which indicate that EOD has a good performance in a real case.

Paper Citation

in Harvard Style

Roig M., Catalan M. and Gastón B. (2019). Ensembled Outlier Detection using Multi-Variable Correlation in WSN through Unsupervised Learning Techniques.In Proceedings of the 4th International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS, ISBN 978-989-758-369-8, pages 38-48. DOI: 10.5220/0007657400380048

in Bibtex Style

@conference{iotbds19,
author={Marc Roig and Marisa Catalan and Bernat Gastón},
title={Ensembled Outlier Detection using Multi-Variable Correlation in WSN through Unsupervised Learning Techniques},
booktitle={Proceedings of the 4th International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS,},
year={2019},
pages={38-48},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007657400380048},
isbn={978-989-758-369-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 4th International Conference on Internet of Things, Big Data and Security - Volume 1: IoTBDS,
TI - Ensembled Outlier Detection using Multi-Variable Correlation in WSN through Unsupervised Learning Techniques
SN - 978-989-758-369-8
AU - Roig M.
AU - Catalan M.
AU - Gastón B.
PY - 2019
SP - 38
EP - 48
DO - 10.5220/0007657400380048