English

Markov Decision Processes with Sure Parity and Multiple Reachability Objectives

Computer Science and Game Theory 2024-08-05 v1

Abstract

This paper considers the problem of finding strategies that satisfy a mixture of sure and threshold objectives in Markov decision processes. We focus on a single ω\omega-regular objective expressed as parity that must be surely met while satisfying nn reachability objectives towards sink states with some probability thresholds too. We consider three variants of the problem: (a) strict and (b) non-strict thresholds on all reachability objectives, and (c) maximizing the thresholds with respect to a lexicographic order. We show that (a) and (c) can be reduced to solving parity games, and (b) can be solved in EXPTIME\sf{EXPTIME}. Strategy complexities as well as algorithms are provided for all cases.

Keywords

Cite

@article{arxiv.2408.01212,
  title  = {Markov Decision Processes with Sure Parity and Multiple Reachability Objectives},
  author = {Raphaël Berthon and Joost-Pieter Katoen and Tobias Winkler},
  journal= {arXiv preprint arXiv:2408.01212},
  year   = {2024}
}

Comments

Paper accepted to RP 2024 - Full version

R2 v1 2026-06-28T18:02:10.328Z