The Value Functions of Markov Decision Processes
Probability
2015-11-10 v1
Abstract
We provide a full characterization of the set of value functions of Markov decision processes.
Cite
@article{arxiv.1511.02377,
title = {The Value Functions of Markov Decision Processes},
author = {Ehud Lehrer and Eilon Solan and Omri N. Solan},
journal= {arXiv preprint arXiv:1511.02377},
year = {2015}
}
Related papers
View all related →
Artificial Intelligence · Computer Science
A Notation for Markov Decision Processes
Philip S. Thomas, Billy Okal
2016-09-09
Machine Learning · Computer Science
The Value Function Polytope in Reinforcement Learning
Robert Dadashi, Adrien Ali Taïga, Nicolas Le Roux, Dale Schuurmans +1
2019-05-17
Artificial Intelligence · Computer Science
Fast Value Iteration for Goal-Directed Markov Decision Processes
Nevin Lianwen Zhang, Weihong Zhang
2013-02-08
Theoretical Economics · Economics
Algorithmic Decision Processes
Carlo Baldassi, Fabio Maccheroni, Massimo Marinacci, Marco Pirazzini
2023-05-08
Operator Algebras · Mathematics
Quantum Markov Processes (Correspondences and Dilations)
Paul S. Muhly, Baruch Solel
2007-05-23
Complex Variables · Mathematics
A characterization of rational functions
Bao Qin Li
2017-12-13
Statistical Mechanics · Physics
Stochastic functionals and fluctuation theorem for the multi-kangaroo process
C. Van den Broeck, R. Toral
2014-06-25
Probability · Mathematics
Piecewise deterministic Markov processes in biological models
Ryszard Rudnicki, Marta Tyran-Kaminska
2015-12-08
Artificial Intelligence · Computer Science
On the Expressivity of Multidimensional Markov Reward
Shuwa Miura
2023-07-25
Optimization and Control · Mathematics
Linear programming for finite-horizon vector-valued Markov decision processes
Anas Mifrani, Dominikus Noll
2025-06-02
Optimization and Control · Mathematics
Markov control of continuous time Markov processes with long run functionals by time discretization
Lukasz Stettner
2025-08-12
Probability · Mathematics
Optimal stopping of strong Markov processes
Sören Christensen, Paavo Salminen, Bao Quoc Ta
2012-04-03
Artificial Intelligence · Computer Science
Choice functions based on sets of strict partial orders: an axiomatic characterisation
Jasper De Bock
2020-04-03
Risk Management · Quantitative Finance
Markov Decision Processes with Risk-Sensitive Criteria: An Overview
Nicole Bäuerle, Anna Jaśkiewicz
2025-09-23
Machine Learning · Computer Science
On Reward Structures of Markov Decision Processes
Falcon Z. Dai
2023-09-04
Machine Learning · Computer Science
Analysis of Value Iteration Through Absolute Probability Sequences
Arsenii Mustafin, Sebastien Colla, Alex Olshevsky, Ioannis Ch. Paschalidis
2025-02-06
Dynamical Systems · Mathematics
Supports of Invariant Measures for Piecewise Deterministic Markov Processes
Michel Benaïm, Fritz Colonius, Lettau Ralph
2018-04-05
Probability · Mathematics
On regularity of functions of Markov chains
Steven Berghout, Evgeny Verbitskiy
2021-01-05
Theoretical Economics · Economics
Rationalizable Implementation of Social Choice Functions: Complete Characterization
Siyang Xiong
2022-02-11
Optimization and Control · Mathematics
A Note on Optimization Formulations of Markov Decision Processes
Lexing Ying, Yuhua Zhu
2020-12-18
Probability · Mathematics
Markov cubature rules for polynomial processes
Damir Filipović, Martin Larsson, Sergio Pulido
2019-06-11
Probability · Mathematics
Overshoot functionals for almost semi-continuous processes defined on a Markov chain
Ievgen Karnaukh
2009-09-22
Probability · Mathematics
Markov Genealogy Processes
Aaron A. King, Qianying Lin, Edward L. Ionides
2022-01-26
Probability · Mathematics
Continuous-Time Higher Order Markov Chains: Formulation and Parameter Estimation
Suryadeepto Nag
2021-04-13
Optimization and Control · Mathematics
Markov Decision Processes with Incomplete Information and Semi-Uniform Feller Transition Probabilities
Eugene A. Feinberg, Pavlo O. Kasyanov, Michael Z. Zgurovsky
2022-08-30