Strategising RoboCup in Real Time with Uppaal Stratego

Philip Holler, Magnus Jensen, Hannah Lockey, Michele Albano

2021

Abstract

The RoboCup simulator is a playing ground for Agents and Artificial Intelligence research. One of the main challenges provided by RoboCup is generating winning strategies for a set of agents playing soccer, given a partial and noisy view of the game state. Additionally, RoboCup is timing sensitive, and all decisions have to be sent to the server within each tick of 100ms. This paper presents a method for generating strategies by modelling players and scenarios as timed automata in the Uppaal environment. The newest extension of Uppaal, called Uppaal Stratego, allows for synthesising strategies optimising a reward function that is used to guide the decision process. In order to stay within the time frame of 100ms, two approaches were tested, namely forecasting the game state and generating a strategy asynchronously for a later point in time, and generating strategies beforehand and saving them in a lookup table. Four timed automata were developed, and were tested against publicly available methods. We found that strategies could be successfully generated and used within the time constraints of RoboCup using our proposed method. Especially when combined together, our strategies are able to outperform most published methods, but lose against the published world champions.

Paper Citation

in Harvard Style

Holler P., Jensen M., Lockey H. and Albano M. (2021). Strategising RoboCup in Real Time with Uppaal Stratego.In Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-758-484-8, pages 273-280. DOI: 10.5220/0010239602730280

in Bibtex Style

@conference{icaart21,
author={Philip Holler and Magnus Jensen and Hannah Lockey and Michele Albano},
title={Strategising RoboCup in Real Time with Uppaal Stratego},
booktitle={Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2021},
pages={273-280},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010239602730280},
isbn={978-989-758-484-8},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 13th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - Strategising RoboCup in Real Time with Uppaal Stratego
SN - 978-989-758-484-8
AU - Holler P.
AU - Jensen M.
AU - Lockey H.
AU - Albano M.
PY - 2021
SP - 273
EP - 280
DO - 10.5220/0010239602730280