A Practical Evaluation Method for Misbehavior Detection in the Presence of Selfish Attackers

Marek Wehmer, Ingmar Baumgart

2021

Abstract

With recent deployment activities of Vehicle-to-X systems, the need for practical misbehavior detection is growing. The academic discussion on related topics has progressed in the last years and delivered new evaluation approaches. Most research however concentrates on evaluations based on the confusion matrix of packet classifications, such as the precision-recall graph. We show that his approach has fundamental limitations and does not allow to derive valid statements about the real-world impact of a scheme. After reviewing the state of the art, we show that the physical manifestation of attacks must be considered when evaluating misbehaviour detection systems. We propose a shift of perspective towards an attacker-oriented evaluation and contribute a new metric for selfish attackers based on the physical impact of the attack. We further present a simulation framework to practically evaluate misbehavior detection systems.

Paper Citation

in Harvard Style

Wehmer M. and Baumgart I. (2021). A Practical Evaluation Method for Misbehavior Detection in the Presence of Selfish Attackers. In Proceedings of the 7th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS, ISBN 978-989-758-513-5, pages 529-537. DOI: 10.5220/0010451005290537

in Bibtex Style

@conference{vehits21,
author={Marek Wehmer and Ingmar Baumgart},
title={A Practical Evaluation Method for Misbehavior Detection in the Presence of Selfish Attackers},
booktitle={Proceedings of the 7th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS,},
year={2021},
pages={529-537},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010451005290537},
isbn={978-989-758-513-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 7th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS,
TI - A Practical Evaluation Method for Misbehavior Detection in the Presence of Selfish Attackers
SN - 978-989-758-513-5
AU - Wehmer M.
AU - Baumgart I.
PY - 2021
SP - 529
EP - 537
DO - 10.5220/0010451005290537