loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Authors: Theodora-Augustina Drăgan 1 ; Alexander Künzner 1 ; Robert Wille 2 and Jeanette Lorenz 1

Affiliations: 1 Fraunhofer Institute for Cognitive Systems, Munich, Germany ; 2 Technical University of Munich, Germany

Keyword(s): Quantum Reinforcement Learning, Continuous Action Space, LiDAR, Robot Navigation.

Abstract: One of the multiple facets of quantum reinforcement learning (QRL) is enhancing reinforcement learning (RL) algorithms with quantum submodules, namely with variational quantum circuits (VQC) as function approx-imators. QRL solutions are empirically proven to require fewer training iterations or adjustable parameters than their classical counterparts, but are usually restricted to applications that have a discrete action space and thus limited industrial relevance. We propose a hybrid quantum-classical (HQC) deep deterministic policy gradient (DDPG) approach for a robot to navigate through a maze using continuous states, continuous actions and using local observations from the robot’s LiDAR sensors. We show that this HQC method can lead to models of comparable test results to the neural network (NN)-based DDPG algorithm, that need around 200 times fewer weights. We also study the scalability of our solution with respect to the number of VQC layers and qubits, and find that in general results improve as the layer and qubit counts increase. The best rewards among all similarly sized HQC and classical DDPG methods correspond to a VQC of 8 qubits and 5 layers with no other NN. This work is another step towards continuous QRL, where literature has been sparse. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.142.245.16

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Drăgan, T.-A., Künzner, A., Wille, R. and Lorenz, J. (2025). Continuous Quantum Reinforcement Learning for Robot Navigation. In Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 1: QAIO; ISBN 978-989-758-737-5; ISSN 2184-433X, SciTePress, pages 807-814. DOI: 10.5220/0013371800003890

@conference{qaio25,
author={Theodora{-}Augustina Drăgan and Alexander Künzner and Robert Wille and Jeanette Lorenz},
title={Continuous Quantum Reinforcement Learning for Robot Navigation},
booktitle={Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 1: QAIO},
year={2025},
pages={807-814},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013371800003890},
isbn={978-989-758-737-5},
issn={2184-433X},
}

TY - CONF

JO - Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 1: QAIO
TI - Continuous Quantum Reinforcement Learning for Robot Navigation
SN - 978-989-758-737-5
IS - 2184-433X
AU - Drăgan, T.
AU - Künzner, A.
AU - Wille, R.
AU - Lorenz, J.
PY - 2025
SP - 807
EP - 814
DO - 10.5220/0013371800003890
PB - SciTePress

- Science and Technology Publications, Lda.
RESOURCES

Proceedings

Papers

Authors

Ontology

CONTACTS

Science and Technology Publications, Lda
Avenida de S. Francisco Xavier, Lote 7 Cv. C,
2900-616 Setúbal, Portugal.

Phone: +351 265 520 185 (National fixed network call)
Fax: +351 265 520 186
Email: info@scitepress.org

EXTERNAL LINKS

PRIMORIS

INSTICC

SCITEVENTS

CROSSREF

PROCEEDINGS SUBMITTED FOR INDEXATION BY:

dblp

Ei Compendex

SCOPUS

Semantic Scholar

Google Scholar

Microsoft Academic