Experimental Evaluation of a Method for Simulation based Learning for a Multi-Agent System Acting in a Physical Environment

Kun Qian, Robert Brehm, Lars Duggen

2019

Abstract

A method for simulation based reinforcement learning (RL) for a multi-agent system acting in a physical environment is introduced, which is based on Multi-Agent Actor-Critic (MAAC) reinforcement learning. In the proposed method, avatar agents learn in a simulated model of the physical environment and the learned experience is then used by agents in the actual physical environment. The proposed concept is verified using a laboratory benchmark setup in which multiple agents, acting within the same environment, are required to coordinate their movement actions to prevent collisions. Three state-of-the-art algorithms for multi-agent reinforcement learning (MARL) are evaluated, with respect to their applicability for a predefined benchmark scenario. Based on simulations it is shown that the MAAC method is most applicable for implementation as it provides effective distributed learning and suits well to the concept of learning in simulated environments. Our experimental results, which compare simulated learning and task execution in a simulated environment with that of task execution in a physical environment demonstrate the feasibility of the proposed concept.

Paper Citation

in Harvard Style

Qian K., Brehm R. and Duggen L. (2019). Experimental Evaluation of a Method for Simulation based Learning for a Multi-Agent System Acting in a Physical Environment.In Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-758-350-6, pages 103-109. DOI: 10.5220/0007250301030109

in Bibtex Style

@conference{icaart19,
author={Kun Qian and Robert Brehm and Lars Duggen},
title={Experimental Evaluation of a Method for Simulation based Learning for a Multi-Agent System Acting in a Physical Environment},
booktitle={Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2019},
pages={103-109},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0007250301030109},
isbn={978-989-758-350-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - Experimental Evaluation of a Method for Simulation based Learning for a Multi-Agent System Acting in a Physical Environment
SN - 978-989-758-350-6
AU - Qian K.
AU - Brehm R.
AU - Duggen L.
PY - 2019
SP - 103
EP - 109
DO - 10.5220/0007250301030109