English
Related papers

Related papers: A Spectral Approach to Off-Policy Evaluation for P…

200 papers

Off-policy Evaluation (OPE), or offline evaluation in general, evaluates the performance of hypothetical policies leveraging only offline log data. It is particularly useful in applications where the online interaction involves high stakes…

Machine Learning · Statistics 2021-09-01 Yuta Saito , Takuma Udagawa , Haruka Kiyohara , Kazuki Mogi , Yusuke Narita , Kei Tateno

Off-policy evaluation (OPE) aims to estimate the benefit of following a counterfactual sequence of actions, given data collected from executed sequences. However, existing OPE estimators often exhibit high bias and high variance in problems…

Machine Learning · Computer Science 2023-07-17 Aaman Rebello , Shengpu Tang , Jenna Wiens , Sonali Parbhoo

Policies for Partially Observable Markov Decision Processes (POMDPs) are often designed using a nominal system model. In practice, this model can deviate from the true system during deployment due to factors such as calibration drift or…

Artificial Intelligence · Computer Science 2026-04-24 Benjamin Kraske , Qi Heng Ho , Federico Rossi , Morteza Lahijanian , Zachary Sunberg

We investigate partially observed Markov decision processes (POMDPs) with cost functions regularized by entropy terms describing state, observation, and control uncertainty. Standard POMDP techniques are shown to offer bounded-error…

Systems and Control · Electrical Eng. & Systems 2023-05-10 Timothy L. Molloy , Girish N. Nair

This paper addresses the problem of policy selection in domains with abundant logged data, but with a restricted interaction budget. Solving this problem would enable safe evaluation and deployment of offline reinforcement learning policies…

We consider a class of sequential decision-making problems under uncertainty that can encompass various types of supervised learning concepts. These problems have a completely observed state process and a partially observed modulation…

Optimization and Control · Mathematics 2021-08-24 R. Reid Bishop , Chelsea C. White

We consider the problem of off-policy evaluation in Markov decision processes. Off-policy evaluation is the task of evaluating the expected return of one policy with data generated by a different, behavior policy. Importance sampling is a…

Machine Learning · Computer Science 2019-05-13 Josiah P. Hanna , Scott Niekum , Peter Stone

Off-policy evaluation (OPE) estimates the value of a target treatment policy (e.g., a recommender system) using data collected by a different logging policy. It enables high-stakes experimentation without live deployment, yet in practice…

Machine Learning · Statistics 2026-05-18 Connor Douglas , Joel Persson , Foster Provost

Holdout validation and hyperparameter tuning from data is a long-standing problem in offline reinforcement learning (RL). A standard framework is to use off-policy evaluation (OPE) methods to evaluate and select the policies, but OPE either…

Machine Learning · Computer Science 2025-10-27 Pai Liu , Lingfeng Zhao , Shivangi Agarwal , Jinghan Liu , Audrey Huang , Philip Amortila , Nan Jiang

This article provides an introductory tutorial on structural results in partially observed Markov decision processes (POMDPs). Typically, computing the optimal policy of a POMDP is computationally intractable. We use lattice program- ming…

Optimization and Control · Mathematics 2015-12-15 Vikram Krishnamurthy

In many real-world decision problems there is partially observed, hidden or latent information that remains fixed throughout an interaction. Such decision problems can be modeled as Latent Markov Decision Processes (LMDPs), where a latent…

Machine Learning · Computer Science 2024-06-27 Jeongyeol Kwon , Shie Mannor , Constantine Caramanis , Yonathan Efroni

We consider the problem of off-policy evaluation (OPE) in reinforcement learning (RL), where the goal is to estimate the performance of an evaluation policy, $\pi_e$, using a fixed dataset, $\mathcal{D}$, collected by one or more policies…

Machine Learning · Computer Science 2022-12-16 Brahma S. Pavse , Josiah P. Hanna

Off-policy evaluation (OPE) methods aim to estimate the value of a new reinforcement learning (RL) policy prior to deployment. Recent advances have shown that leveraging auxiliary datasets, such as those synthesized by generative models,…

Machine Learning · Computer Science 2025-07-29 Aishwarya Mandyam , Jason Meng , Ge Gao , Jiankai Sun , Mac Schwager , Barbara E. Engelhardt , Emma Brunskill

POMDPs are useful models for systems where the true underlying state is not known completely to an outside observer; the outside observer incompletely knows the true state of the system, and observes a noisy version of the true system…

Machine Learning · Computer Science 2021-09-01 Caleb M. Bowyer

We consider the problem of evaluating the performance of a decision policy using past observational data. The outcome of a policy is measured in terms of a loss (aka. disutility or negative reward) and the main problem is making valid…

Machine Learning · Statistics 2023-07-03 Sofia Ek , Dave Zachariah , Fredrik D. Johansson , Petre Stoica

Off-policy evaluation (OPE) is critical for applying contextual bandit algorithms to high-stakes decision-making settings such as healthcare, where new treatment policies must be evaluated prior to deployment. Unfortunately, OPE techniques…

Machine Learning · Computer Science 2026-05-28 Aishwarya Mandyam , Shengpu Tang , Jiayu Yao , Jenna Wiens , Barbara E. Engelhardt

We consider off-policy policy evaluation when the trajectory data are generated by multiple behavior policies. Recent work has shown the key role played by the state or state-action stationary distribution corrections in the infinite…

Machine Learning · Computer Science 2019-10-14 Xinyun Chen , Lu Wang , Yizhe Hang , Heng Ge , Hongyuan Zha

Solving partially observable Markov decision processes (POMDPs) is highly intractable in general, at least in part because the optimal policy may be infinitely large. In this paper, we explore the problem of finding the optimal policy from…

Artificial Intelligence · Computer Science 2013-01-30 Nicolas Meuleau , Kee-Eung Kim , Leslie Pack Kaelbling , Anthony R. Cassandra

In the framework of Markov Decision Processes, off-policy learning, that is the problem of learning a linear approximation of the value function of some fixed policy from one trajectory possibly generated by some other policy. We briefly…

Artificial Intelligence · Computer Science 2013-04-16 Matthieu Geist , Bruno Scherrer

We study off-policy evaluation and learning from sequential data in a structured class of Markov decision processes that arise from repeated interactions with an exogenous sequence of arrivals with contexts, which generate unknown…

Machine Learning · Computer Science 2021-10-20 Nathan Kallus , Angela Zhou
‹ Prev 1 3 4 5 6 7 10 Next ›