A Notation for Markov Decision Processes
Artificial Intelligence
2016-09-09 v2
Abstract
This paper specifies a notation for Markov decision processes.
Cite
@article{arxiv.1512.09075,
title = {A Notation for Markov Decision Processes},
author = {Philip S. Thomas and Billy Okal},
journal= {arXiv preprint arXiv:1512.09075},
year = {2016}
}
Related papers
View all related →
Probability · Mathematics
The Value Functions of Markov Decision Processes
Ehud Lehrer, Eilon Solan, Omri N. Solan
2015-11-10
Optimization and Control · Mathematics
A Note on Optimization Formulations of Markov Decision Processes
Lexing Ying, Yuhua Zhu
2020-12-18
Machine Learning · Statistics
Markov substitute processes : a new model for linguistics and beyond
Olivier Catoni, Thomas Mainguy
2016-03-28
Operator Algebras · Mathematics
Quantum Markov Processes (Correspondences and Dilations)
Paul S. Muhly, Baruch Solel
2007-05-23
Artificial Intelligence · Computer Science
Fast Value Iteration for Goal-Directed Markov Decision Processes
Nevin Lianwen Zhang, Weihong Zhang
2013-02-08
Probability · Mathematics
On Markov--up processes and their recurrence properties
Alexander Veretennikov, Maria Veretennikova
2023-01-02
Optimization and Control · Mathematics
An Overview for Markov Decision Processes in Queues and Networks
Quan-Lin Li, Jing-Yu Ma, Rui-Na Fan, Li Xia
2019-08-26
Risk Management · Quantitative Finance
Markov Decision Processes with Risk-Sensitive Criteria: An Overview
Nicole Bäuerle, Anna Jaśkiewicz
2025-09-23
Probability · Mathematics
Continuous-Time Higher Order Markov Chains: Formulation and Parameter Estimation
Suryadeepto Nag
2021-04-13
Information Retrieval · Computer Science
Recommender Systems Notation: Proposed Common Notation for Teaching and Research
Michael D. Ekstrand, Joseph A. Konstan
2019-02-13
Optimization and Control · Mathematics
Reinforcement Learning: Stochastic Approximation Algorithms for Markov Decision Processes
Vikram Krishnamurthy
2015-12-25
Logic in Computer Science · Computer Science
Evidential Decision Theory via Partial Markov Categories
Elena Di Lavore, Mario Román
2025-04-21
Statistics Theory · Mathematics
Piecewise deterministic Markov process - recent results
Romain Azaïs, Jean-Baptiste Bardet, Alexandre Genadot, Nathalie Krell +1
2013-09-25
Combinatorics · Mathematics
Permutation patterns: basic definitions and notation
David Bevan
2015-06-23
Probability · Mathematics
Markov cubature rules for polynomial processes
Damir Filipović, Martin Larsson, Sergio Pulido
2019-06-11
Probability · Mathematics
Piecewise deterministic Markov processes in biological models
Ryszard Rudnicki, Marta Tyran-Kaminska
2015-12-08
Optimization and Control · Mathematics
Large Markov Decision Processes and Combinatorial Optimization
Ali Eshragh
2023-12-07
Optimization and Control · Mathematics
Finite-Horizon Markov Decision Processes with Sequentially-Observed Transitions
Mahmoud El Chamie, Behcet Acikmese
2015-07-07
Optimization and Control · Mathematics
Markov Decision Processes with Incomplete Information and Semi-Uniform Feller Transition Probabilities
Eugene A. Feinberg, Pavlo O. Kasyanov, Michael Z. Zgurovsky
2022-08-30
Formal Languages and Automata Theory · Computer Science
Comparing Labelled Markov Decision Processes
Stefan Kiefer, Qiyi Tang
2020-09-25
Artificial Intelligence · Computer Science
On the Complexity of Solving Markov Decision Problems
Michael L. Littman, Thomas L. Dean, Leslie Pack Kaelbling
2013-02-21
Signal Processing · Electrical Eng. & Systems
Matrix differentiation with diagrammatic notation
Kenji Nakahira
2022-07-12
Probability · Mathematics
On exponential recurrence of "Markov-up'' processes
D. O. Kalikaeva
2024-07-01
Probability · Mathematics
Explicit computations for some Markov modulated counting processes
Michel Mandjes, Peter Spreij
2023-02-27
Dynamical Systems · Mathematics
Supports of Invariant Measures for Piecewise Deterministic Markov Processes
Michel Benaïm, Fritz Colonius, Lettau Ralph
2018-04-05