A Delay-Aware DRL-Based Environment for Cooperative Multi-UAV Systems in Multi-Purpose Scenarios

Damiano Brunori, Luca Iocchi

2024

Abstract

We provide a customizable environment based on Deep Reinforcement Learning (DRL) strategies for handling cooperative multi-UAV (Unmanned Aerial Vehicles) scenarios when delays are involved in the decision-making process for tasks such as spotting, tracking, coverage and many others. Users can choose among various combinations of tasks and parameters and customize the scenarios by implementing new desired functionalities. This environment provides the opportunity to compare different approaches, taking into account either implicitly or explicitly the delays applied to actions and observations. The awareness of the delay, along with the possible usage of real-world-based external files, increases the reality level of the environment by possibly easing the knowledge transferability process of the learned policy from the simulated environment to the real one. Finally, we show that use cases could generate new benchmarking tools for collaborative multi-UAV scenarios where DRL solutions must consider delays.

Paper Citation

in Harvard Style

Brunori D. and Iocchi L. (2024). A Delay-Aware DRL-Based Environment for Cooperative Multi-UAV Systems in Multi-Purpose Scenarios. In Proceedings of the 16th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART; ISBN 978-989-758-680-4, SciTePress, pages 334-343. DOI: 10.5220/0012347900003636

in Bibtex Style

@conference{icaart24,
author={Damiano Brunori and Luca Iocchi},
title={A Delay-Aware DRL-Based Environment for Cooperative Multi-UAV Systems in Multi-Purpose Scenarios},
booktitle={Proceedings of the 16th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART},
year={2024},
pages={334-343},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012347900003636},
isbn={978-989-758-680-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART
TI - A Delay-Aware DRL-Based Environment for Cooperative Multi-UAV Systems in Multi-Purpose Scenarios
SN - 978-989-758-680-4
AU - Brunori D.
AU - Iocchi L.
PY - 2024
SP - 334
EP - 343
DO - 10.5220/0012347900003636
PB - SciTePress