Probabilistic Model Checking of Stochastic Reinforcement Learning Policies

Dennis Gross; Helge Spieker

Research.Publish.Connect.

*Please fill out at least one Field. *Value must be an number!

Title:
ISBN:
Year:
Acronym:
Subject:

Advanced Search Proceedings Search

If you're looking for an exact phrase use quotation marks on text fields.

*Please fill out at least one Field.

Title:
Author:
Affiliation:
Subject:

Advanced Search Papers Search

If you're looking for an exact phrase use quotation marks on text fields.

*Please fill out at least one Field.

Name:
Affiliation:
Country:
Conference:
Subject:

Advanced Search Authors Search

If you're looking for an exact phrase use quotation marks on text fields.

*Please fill out at least one Field.

Name:
Country:
Subject:

Advanced Search Affiliations Search

If you're looking for an exact phrase use quotation marks on text fields.

Proceedings

Proceedings Search *Please fill out at least one Field. *Value must be an number!

Title:
ISBN:
Year:
Acronym:
Subject:

Advanced Search Proceedings Search

If you're looking for an exact phrase use quotation marks on text fields.

Papers

Papers Search *Please fill out at least one Field.

Title:
Author:
Affiliation:
Subject:

Advanced Search Papers Search

If you're looking for an exact phrase use quotation marks on text fields.

Authors

Authors Search *Please fill out at least one Field.

Name:
Affiliation:
Country:
Conference:
Subject:

Advanced Search Authors Search

If you're looking for an exact phrase use quotation marks on text fields.

Advanced Search

Paper

Probabilistic Model Checking of Stochastic Reinforcement Learning Policies

Topics: Autonomous Systems; Deep Learning; Fairness and Reliability; Machine Learning; Privacy, Safety, Security, and Ethical Issues; Uncertainty in AI

In Proceedings of the 16th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART, 438-445, 2024 , Rome, Italy

Authors: Dennis Gross and Helge Spieker

Affiliation: Simula Research Laboratory, Norway

Keyword(s): Reinforcement Learning, Model Checking, Safety.

Abstract: We introduce a method to verify stochastic reinforcement learning (RL) policies. This approach is compatible with any RL algorithm as long as the algorithm and its corresponding environment collectively adhere to the Markov property. In this setting, the future state of the environment should depend solely on its current state and the action executed, independent of any previous states or actions. Our method integrates a verification technique, referred to as model checking, with RL, leveraging a Markov decision process, a trained RL policy, and a probabilistic computation tree logic (PCTL) formula to build a formal model that can be subsequently verified via the model checker Storm. We demonstrate our method’s applicability across multiple benchmarks, comparing it to baseline methods called deterministic safety estimates and naive monolithic model checking. Our results show that our method is suited to verify stochastic RL policies.

CC BY-NC-ND 4.0

Guest: Register as new SciTePress user now for free.

SciTePress user: please login.

My Papers

You are not signed in, therefore limits apply to your IP address 3.145.110.99

In the current month:

Recent papers: 100 available of 100 total

2⁺ years older papers: 200 available of 200 total

Paper citation in several formats:

Gross, D. and Spieker, H. (2024). Probabilistic Model Checking of Stochastic Reinforcement Learning Policies. In Proceedings of the 16th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART; ISBN 978-989-758-680-4; ISSN 2184-433X, SciTePress, pages 438-445. DOI: 10.5220/0012357700003636

@conference{icaart24,
author={Dennis Gross. and Helge Spieker.},
title={Probabilistic Model Checking of Stochastic Reinforcement Learning Policies},
booktitle={Proceedings of the 16th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART},
year={2024},
pages={438-445},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0012357700003636},
isbn={978-989-758-680-4},
issn={2184-433X},
}

TY - CONF

JO - Proceedings of the 16th International Conference on Agents and Artificial Intelligence - Volume 3: ICAART
TI - Probabilistic Model Checking of Stochastic Reinforcement Learning Policies
SN - 978-989-758-680-4
IS - 2184-433X
AU - Gross, D.
AU - Spieker, H.
PY - 2024
SP - 438
EP - 445
DO - 10.5220/0012357700003636
PB - SciTePress