A Taxonomy of Metrics and Tests to Evaluate and Validate Properties of Industrial Intrusion Detection Systems

Cyntia Martinez, Birgit Vogel-Heuser

2019

Abstract

The integration of Intrusion Detection Systems (IDS) in Industrial Automation Systems (IAS) has gained popularity over the past years. This has occurred due to their ability to detect intrusions at a device and network level. In order for these systems to provide effective and reliable protection, they must possess a set of specific properties. These properties are inherent characteristics that depend on the IDS application field, as different fields provide different deployment conditions. Unfortunately, the evaluation and validation of such properties for IAS has proven challenging, as current contributions often follow evaluation and validation approaches from the IT domain that focus solely on the effectiveness of intrusion detection approaches; hence, neglecting other aspects relevant to the industrial domain. This paper addresses this issue by presenting IDS properties derived from trends and characteristics of IAS; as well as a taxonomy of metrics and tests to evaluate and validate these properties. This taxonomy provides a foundation from which future IDS contributions for IAS can be improved and reinforced by providing an overview of pertinent metrics and tests.

Paper Citation

in Harvard Style

Martinez C. and Vogel-Heuser B. (2019). A Taxonomy of Metrics and Tests to Evaluate and Validate Properties of Industrial Intrusion Detection Systems.In Proceedings of the 16th International Joint Conference on e-Business and Telecommunications - Volume 2: SECRYPT, ISBN 978-989-758-378-0, pages 201-210. DOI: 10.5220/0007833902010210

in Bibtex Style

@conference{secrypt19,
author={Cyntia Martinez and Birgit Vogel-Heuser},
title={A Taxonomy of Metrics and Tests to Evaluate and Validate Properties of Industrial Intrusion Detection Systems},
booktitle={Proceedings of the 16th International Joint Conference on e-Business and Telecommunications - Volume 2: SECRYPT,},
year={2019},
pages={201-210},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007833902010210},
isbn={978-989-758-378-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on e-Business and Telecommunications - Volume 2: SECRYPT,
TI - A Taxonomy of Metrics and Tests to Evaluate and Validate Properties of Industrial Intrusion Detection Systems
SN - 978-989-758-378-0
AU - Martinez C.
AU - Vogel-Heuser B.
PY - 2019
SP - 201
EP - 210
DO - 10.5220/0007833902010210