A Framework for Generating Playstyles of Game AI with Clustering of Play Logs

Yu Iwasaki, Koji Hasebe

2022

Abstract

Many attempts have been made to implement agents for playing games with particular playstyles. Most of these were aimed at generating agents with predetermined playstyles. To this end, they set the reward function to increase the reward as the agent acquires their intended playstyles. However, it is not easy to generate unexpected playstyles through this approach. In this study, we propose a framework to generate multiple playstyles without predefining them. The proposed framework first arranges a set of reward functions regarding the target game and repeats to select a function and make an agent learn with it. Each learned agent is made to play the game, and those whose scores are higher than a predetermined threshold are selected. Finally, each cluster obtained from clustering the play logs (i.e., metrics on the behavior in the game) of the selected agents is considered a playstyle. As a result, it is possible to generate playstyles that play the game well using this procedure. We also applied the proposed framework to a roguelike game, MiniDungeons, and observed that multiple playstyles were generated.

Paper Citation

in Harvard Style

Iwasaki Y. and Hasebe K. (2022). A Framework for Generating Playstyles of Game AI with Clustering of Play Logs. In Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART, ISBN 978-989-758-547-0, pages 605-612. DOI: 10.5220/0010869500003116

in Bibtex Style

@conference{icaart22,
author={Yu Iwasaki and Koji Hasebe},
title={A Framework for Generating Playstyles of Game AI with Clustering of Play Logs},
booktitle={Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART,},
year={2022},
pages={605-612},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010869500003116},
isbn={978-989-758-547-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 14th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART,
TI - A Framework for Generating Playstyles of Game AI with Clustering of Play Logs
SN - 978-989-758-547-0
AU - Iwasaki Y.
AU - Hasebe K.
PY - 2022
SP - 605
EP - 612
DO - 10.5220/0010869500003116