loading
Documents

Research.Publish.Connect.

Paper

Authors: Gurpreet Singh 1 ; Daniel Lofaro 2 and Donald Sofge 2

Affiliations: 1 Robotics and Intelligent Systems Engineering (RISE) Laboratory, Naval Air Warfare Center Aircraft Division, Lakehurst NJ 08733, U.S.A. ; 2 Distributed Autonomous Systems Group, U.S. Naval Research Laboratory, 4555 Overlook Ave SW, Washington DC 20375, U.S.A.

ISBN: 978-989-758-395-7

ISSN: 2184-433X

Keyword(s): Swarm Robotics, Deep Reinforcement Learning, Continuous Space, Actor Critic.

Abstract: In this paper we address the pursuit-evasion problem using deep reinforcement learning techniques. The goal of this project is to train each agent in a swarm of pursuers to learn a control strategy to capture the evaders in optimal time while displaying collaborative behavior. Additional challenges addressed in this paper include the use of continuous agent state and action spaces, and the requirement that agents in the swarm must take actions in a decentralized fashion. Our technique builds on the actor-critic model-free Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm that operates over continuous spaces. The evader strategy is not learned and is based on Voronoi regions, which the pursuers try to minimize and the evader tries to maximize. We assume global visibility of all agents at all times. We implement the algorithm and train the models using Python Pytorch machine learning library. Our results show that the pursuers can learn a control strategy to capture evad ers. (More)

PDF ImageFull Text

Download
CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 34.239.149.34

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Singh, G.; Lofaro, D. and Sofge, D. (2020). Pursuit-evasion with Decentralized Robotic Swarm in Continuous State Space and Action Space via Deep Reinforcement Learning.In Proceedings of the 12th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-758-395-7, ISSN 2184-433X, pages 226-233. DOI: 10.5220/0008971502260233

@conference{icaart20,
author={Gurpreet Singh. and Daniel M. Lofaro. and Donald Sofge.},
title={Pursuit-evasion with Decentralized Robotic Swarm in Continuous State Space and Action Space via Deep Reinforcement Learning},
booktitle={Proceedings of the 12th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2020},
pages={226-233},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008971502260233},
isbn={978-989-758-395-7},
}

TY - CONF

JO - Proceedings of the 12th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - Pursuit-evasion with Decentralized Robotic Swarm in Continuous State Space and Action Space via Deep Reinforcement Learning
SN - 978-989-758-395-7
AU - Singh, G.
AU - Lofaro, D.
AU - Sofge, D.
PY - 2020
SP - 226
EP - 233
DO - 10.5220/0008971502260233

Login or register to post comments.

Comments on this Paper: Be the first to review this paper.