Better the Phish You Know: Evaluating Personalization in Anti-Phishing Learning Games

Rene Roepke, Vincent Drury, Ulrike Meyer, Ulrik Schroeder

2022

Abstract

Anti-phishing learning games present a motivating, interactive approach to user education and thus, various games have been developed and studied in the past. A common trend among these games is a limited use of game mechanics and no consideration of learners using methods of personalization. In this paper, we compare an anti-phishing learning game with its personalized version in the scope of a longitudinal user study with 89 participants. For personalization, the player’s familiarity with different services is used to provide personalized content in the form of URLs in the game. To further understand the effects of personalization, we analyze game log data and evaluate how players interact with personalized learning game content. While the comparison of both game versions did not yield significant differences in the participants’ performance in URL tests, the in-game analysis confirmed that players interact differently when confronted with URLs based on services they are not familiar with compared to those they use or know. These differences when handling unknown URLs in the in-game analysis might indicate, that personalization could be leveraged to improve awareness and the knowledge transfer to the real world.

Paper Citation

in Harvard Style

Roepke R., Drury V., Meyer U. and Schroeder U. (2022). Better the Phish You Know: Evaluating Personalization in Anti-Phishing Learning Games. In Proceedings of the 14th International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-758-562-3, pages 458-466. DOI: 10.5220/0011042100003182

in Bibtex Style

@conference{csedu22,
author={Rene Roepke and Vincent Drury and Ulrike Meyer and Ulrik Schroeder},
title={Better the Phish You Know: Evaluating Personalization in Anti-Phishing Learning Games},
booktitle={Proceedings of the 14th International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2022},
pages={458-466},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011042100003182},
isbn={978-989-758-562-3},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - Better the Phish You Know: Evaluating Personalization in Anti-Phishing Learning Games
SN - 978-989-758-562-3
AU - Roepke R.
AU - Drury V.
AU - Meyer U.
AU - Schroeder U.
PY - 2022
SP - 458
EP - 466
DO - 10.5220/0011042100003182