English
Related papers

Related papers: Off-Policy Confidence Interval Estimation with Con…

200 papers

This paper addresses the challenge of offline policy learning in reinforcement learning with continuous action spaces when unmeasured confounders are present. While most existing research focuses on policy evaluation within partially…

Machine Learning · Statistics 2025-05-02 Yuhan Li , Eugene Han , Yifan Hu , Wenzhuo Zhou , Zhengling Qi , Yifan Cui , Ruoqing Zhu

We study the evaluation of a policy under best- and worst-case perturbations to a Markov decision process (MDP), using transition observations from the original MDP, whether they are generated under the same or a different policy. This is…

Artificial Intelligence · Computer Science 2024-11-05 Andrew Bennett , Nathan Kallus , Miruna Oprescu , Wen Sun , Kaiwen Wang

Decision makers often wish to use offline historical data to compare sequential-action policies at various world states. Importantly, computational tools should produce confidence values for such offline policy comparison (OPC) to account…

Machine Learning · Computer Science 2022-05-24 Anurag Koul , Mariano Phielipp , Alan Fern

Off-policy evaluation (OPE) is a critical challenge in robust decision-making that seeks to assess the performance of a new policy using data collected under a different policy. However, the existing OPE methodologies suffer from several…

Machine Learning · Statistics 2025-02-11 Muhammad Faaiz Taufiq

Off-policy evaluation (OPE) methods aim to estimate the value of a new reinforcement learning (RL) policy prior to deployment. Recent advances have shown that leveraging auxiliary datasets, such as those synthesized by generative models,…

Machine Learning · Computer Science 2025-07-29 Aishwarya Mandyam , Jason Meng , Ge Gao , Jiankai Sun , Mac Schwager , Barbara E. Engelhardt , Emma Brunskill

In many real-world decision problems there is partially observed, hidden or latent information that remains fixed throughout an interaction. Such decision problems can be modeled as Latent Markov Decision Processes (LMDPs), where a latent…

Machine Learning · Computer Science 2024-06-27 Jeongyeol Kwon , Shie Mannor , Constantine Caramanis , Yonathan Efroni

We consider the problem of evaluating the performance of a decision policy using past observational data. The outcome of a policy is measured in terms of a loss (aka. disutility or negative reward) and the main problem is making valid…

Machine Learning · Statistics 2023-07-03 Sofia Ek , Dave Zachariah , Fredrik D. Johansson , Petre Stoica

Off-policy evaluation of sequential decision policies from observational data is necessary in applications of batch reinforcement learning such as education and healthcare. In such settings, however, unobserved variables confound observed…

Machine Learning · Computer Science 2020-07-14 Nathan Kallus , Angela Zhou

When decision-makers can directly intervene, policy evaluation algorithms give valid causal estimates. In off-policy evaluation (OPE), there may exist unobserved variables that both impact the dynamics and are used by the unknown behavior…

Machine Learning · Computer Science 2022-04-05 David Bruns-Smith

The goal of off-policy evaluation (OPE) is to evaluate a new policy using historical data obtained via a behavior policy. However, because the contextual bandit algorithm updates the policy based on past observations, the samples are not…

Machine Learning · Computer Science 2020-10-27 Masahiro Kato , Yusuke Kaneko

We study the problem of offline policy optimization in stochastic contextual bandit problems, where the goal is to learn a near-optimal policy based on a dataset of decision data collected by a suboptimal behavior policy. Rather than making…

Machine Learning · Computer Science 2023-09-28 Germano Gabbianelli , Gergely Neu , Matteo Papini

To accumulate knowledge and improve its policy of behaviour, a reinforcement learning agent can learn `off-policy' about policies that differ from the policy used to generate its experience. This is important to learn counterfactuals, or…

Machine Learning · Computer Science 2022-02-03 Simon Schmitt , John Shawe-Taylor , Hado van Hasselt

Off-policy evaluation in reinforcement learning offers the chance of using observational data to improve future outcomes in domains such as healthcare and education, but safe deployment in high stakes settings requires ways of assessing its…

Machine Learning · Computer Science 2020-08-12 Omer Gottesman , Joseph Futoma , Yao Liu , Sonali Parbhoo , Leo Anthony Celi , Emma Brunskill , Finale Doshi-Velez

The off-policy paradigm casts recommendation as a counterfactual decision-making task, allowing practitioners to unbiasedly estimate online metrics using offline data. This leads to effective evaluation metrics, as well as learning…

Machine Learning · Computer Science 2024-09-17 Olivier Jeunen , Aleksei Ustimenko

We develop methods for estimating how infinitesimal policy changes affect long-term outcomes in dynamic systems. We show that dynamic marginal policy effects (MPEs) can be identified via tractable reduced-form expressions, and can be…

Methodology · Statistics 2026-05-26 I-han Lai , Stefan Wager

This paper studies the statistical theory of batch data reinforcement learning with function approximation. Consider the off-policy evaluation problem, which is to estimate the cumulative value of a new target policy from logged history…

Machine Learning · Computer Science 2020-02-25 Yaqi Duan , Mengdi Wang

Offline policy evaluation (OPE) is considered a fundamental and challenging problem in reinforcement learning (RL). This paper focuses on the value estimation of a target policy based on pre-collected data generated from a possibly…

Machine Learning · Computer Science 2022-06-13 Jiayi Wang , Zhengling Qi , Raymond K. W. Wong

We study the off-policy evaluation (OPE) problem in reinforcement learning with linear function approximation, which aims to estimate the value function of a target policy based on the offline data collected by a behavior policy. We propose…

Machine Learning · Computer Science 2022-01-05 Yifei Min , Tianhao Wang , Dongruo Zhou , Quanquan Gu

We introduce a novel doubly-robust (DR) off-policy evaluation (OPE) estimator for Markov decision processes, DRUnknown, designed for situations where both the logging policy and the value function are unknown. The proposed estimator…

Machine Learning · Statistics 2024-04-03 Kyungbok Lee , Myunghee Cho Paik

We consider off-policy evaluation (OPE), which evaluates the performance of a new policy from observed data collected from previous experiments, without requiring the execution of the new policy. This finds important applications in areas…

Machine Learning · Computer Science 2020-08-18 Yihao Feng , Tongzheng Ren , Ziyang Tang , Qiang Liu