loading
Papers Papers/2022 Papers Papers/2022

Research.Publish.Connect.

Paper

Paper Unlock

Authors: Mohammadsadegh Mohagheghi 1 and Khayyam Salehi 2

Affiliations: 1 Department of Computer Science, Vali-e-Asr University of Rafsanjan, Rafsanjan, Iran ; 2 Department of Computer Science, Shahrekord University, Shahrekord, Iran

Keyword(s): Probabilistic Model Checking, Expected Rewards, Markov Decision Processes, Interval Iteration.

Abstract: Reachability probabilities and expected rewards are two important classes of properties that are computed in probabilistic model checking. Iterative numerical methods are used to compute these properties. Interval iteration and sound value iteration are proposed in recent years to guarantee the precision of computed values. These methods consider upper and lower bounds of values and update each bound in every iteration until satisfying the convergence criterion. In this paper, we focus on the computation of the expected rewards of models and propose two heuristics to improve the performance of the interval iteration method. The first heuristic updates the upper and lower bounds separately to avoid redundant updates. The second heuristic uses the computed values of the lower bound to approximate a starting point for the upper bound. We also propose a criterion for the correctness of the approximated upper bound. The experiments show that in most cases, interval iteration with our appr oaches outperforms the standard interval iteration and sound value iteration methods. (More)

CC BY-NC-ND 4.0

Sign In Guest: Register as new SciTePress user now for free.

Sign In SciTePress user: please login.

PDF ImageMy Papers

You are not signed in, therefore limits apply to your IP address 3.141.31.240

In the current month:
Recent papers: 100 available of 100 total
2+ years older papers: 200 available of 200 total

Paper citation in several formats:
Mohagheghi, M. and Salehi, K. (2020). Accelerating Interval Iteration for Expected Rewards in Markov Decision Processes. In Proceedings of the 15th International Conference on Software Technologies - ICSOFT; ISBN 978-989-758-443-5; ISSN 2184-2833, SciTePress, pages 39-50. DOI: 10.5220/0009833700390050

@conference{icsoft20,
author={Mohammadsadegh Mohagheghi. and Khayyam Salehi.},
title={Accelerating Interval Iteration for Expected Rewards in Markov Decision Processes},
booktitle={Proceedings of the 15th International Conference on Software Technologies - ICSOFT},
year={2020},
pages={39-50},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009833700390050},
isbn={978-989-758-443-5},
issn={2184-2833},
}

TY - CONF

JO - Proceedings of the 15th International Conference on Software Technologies - ICSOFT
TI - Accelerating Interval Iteration for Expected Rewards in Markov Decision Processes
SN - 978-989-758-443-5
IS - 2184-2833
AU - Mohagheghi, M.
AU - Salehi, K.
PY - 2020
SP - 39
EP - 50
DO - 10.5220/0009833700390050
PB - SciTePress

- Science and Technology Publications, Lda.
RESOURCES

Proceedings

Papers

Authors

Ontology

CONTACTS

Science and Technology Publications, Lda
Avenida de S. Francisco Xavier, Lote 7 Cv. C,
2900-616 Setúbal, Portugal.

Phone: +351 265 520 185 (National fixed network call)
Fax: +351 265 520 186
Email: info@scitepress.org

EXTERNAL LINKS

PRIMORIS

INSTICC

SCITEVENTS

CROSSREF

PROCEEDINGS SUBMITTED FOR INDEXATION BY:

dblp

Ei Compendex

SCOPUS

Semantic Scholar

Google Scholar

Microsoft Academic