Linear programming for finite-horizon vector-valued Markov decision processes
Optimization and Control
2025-06-02 v3
Abstract
We propose a vector linear programming formulation for a non-stationary, finite-horizon Markov decision process with vector-valued rewards. Pareto efficient policies are shown to correspond to efficient solutions of the linear program, and vector linear programming theory allows us to fully characterize deterministic efficient policies. An algorithm for enumerating all efficient deterministic policies is presented then tested numerically in an engineering application.
Cite
@article{arxiv.2502.13697,
title = {Linear programming for finite-horizon vector-valued Markov decision processes},
author = {Anas Mifrani and Dominikus Noll},
journal= {arXiv preprint arXiv:2502.13697},
year = {2025}
}