loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Authors: Jonas Nüßlein ; Maximilian Zorn ; Fabian Ritz ; Jonas Stein ; Gerhard Stenzel ; Julian Schönberger ; Thomas Gabor and Claudia Linnhoff-Popien

Affiliation: Institute of Computer Science, LMU Munich, Germany

Keyword(s): Reinforcement Learning, Sensor Redundancy, Robustness, Optimization.

Abstract: Reinforcement Learning (RL) policies are designed to predict actions based on current observations to maximize cumulative future rewards. In real-world, i.e. not simulated, environments, sensors are essential for measuring the current state and providing the observations on which RL policies rely to make decisions. A significant challenge in deploying RL policies in real-world scenarios is handling sensor dropouts, which can result from hardware malfunctions, physical damage, or environmental factors like dust on a camera lens. A common strategy to mitigate this issue is to use backup sensors, though this comes with added costs. This paper explores the optimization of backup sensor configurations to maximize expected returns while keeping costs below a specified threshold, C. Our approach uses a second-order approximation of expected returns and includes penalties for exceeding cost constraints. The approach is evaluated across eight OpenAI Gym environments and a custom Unity-based r obotic environment (RobotArmGrasping). Empirical results demonstrate that our quadratic program effectively approximates real expected returns, facilitating the identification of optimal sensor configurations. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 18.225.34.193

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Nüßlein, J., Zorn, M., Ritz, F., Stein, J., Stenzel, G., Schönberger, J., Gabor, T. and Linnhoff-Popien, C. (2025). Optimizing Sensor Redundancy in Sequential Decision-Making Problems. In Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART; ISBN 978-989-758-737-5; ISSN 2184-433X, SciTePress, pages 245-252. DOI: 10.5220/0013086700003890

@conference{icaart25,
author={Jonas Nüßlein and Maximilian Zorn and Fabian Ritz and Jonas Stein and Gerhard Stenzel and Julian Schönberger and Thomas Gabor and Claudia Linnhoff{-}Popien},
title={Optimizing Sensor Redundancy in Sequential Decision-Making Problems},
booktitle={Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART},
year={2025},
pages={245-252},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013086700003890},
isbn={978-989-758-737-5},
issn={2184-433X},
}

TY - CONF

JO - Proceedings of the 17th International Conference on Agents and Artificial Intelligence - Volume 1: ICAART
TI - Optimizing Sensor Redundancy in Sequential Decision-Making Problems
SN - 978-989-758-737-5
IS - 2184-433X
AU - Nüßlein, J.
AU - Zorn, M.
AU - Ritz, F.
AU - Stein, J.
AU - Stenzel, G.
AU - Schönberger, J.
AU - Gabor, T.
AU - Linnhoff-Popien, C.
PY - 2025
SP - 245
EP - 252
DO - 10.5220/0013086700003890
PB - SciTePress

- Science and Technology Publications, Lda.
RESOURCES

Proceedings

Papers

Authors

Ontology

CONTACTS

Science and Technology Publications, Lda
Avenida de S. Francisco Xavier, Lote 7 Cv. C,
2900-616 Setúbal, Portugal.

Phone: +351 265 520 185 (National fixed network call)
Fax: +351 265 520 186
Email: info@scitepress.org

EXTERNAL LINKS

PRIMORIS

INSTICC

SCITEVENTS

CROSSREF

PROCEEDINGS SUBMITTED FOR INDEXATION BY:

dblp

Ei Compendex

SCOPUS

Semantic Scholar

Google Scholar

Microsoft Academic