English
Related papers

Related papers: IntOPE: Off-Policy Evaluation in the Presence of I…

200 papers

Evaluating policies using off-policy data is crucial for applying reinforcement learning to real-world problems such as healthcare and autonomous driving. Previous methods for off-policy evaluation (OPE) generally suffer from high variance…

Machine Learning · Computer Science 2024-10-04 Shreyas Chaudhari , Ameet Deshpande , Bruno Castro da Silva , Philip S. Thomas

There has been a recent surge in statistical methods for handling the lack of adequate positivity when using inverse probability weights (IPW). However, these nascent developments have raised a number of questions. Thus, we demonstrate the…

Methodology · Statistics 2024-02-05 Roland A. Matsouaka , Yi Liu , Yunji Zhou

We consider estimation of average treatment effects given observational data with high-dimensional pretreatment variables. Existing methods for this problem typically assume some form of sparsity for the regression functions. In this work,…

Methodology · Statistics 2024-04-12 Yuhao Wang , Rajen D. Shah

We consider off-policy evaluation in the contextual bandit setting for the purpose of obtaining a robust off-policy selection strategy, where the selection strategy is evaluated based on the value of the chosen policy in a set of proposal…

Machine Learning · Computer Science 2022-03-22 Ilja Kuzborskij , Claire Vernade , András György , Csaba Szepesvári

Evaluating causal effects in the presence of interference is challenging in network-based studies of hard-to-reach populations. Like many such populations, people who inject drugs (PWID) are embedded in social networks and often exert…

We study the off-policy evaluation problem---estimating the value of a target policy using data collected by another policy---under the contextual bandit model. We consider the general (agnostic) setting without access to a consistent model…

Machine Learning · Statistics 2017-11-15 Yu-Xiang Wang , Alekh Agarwal , Miroslav Dudik

This work studies the statistical limits of uniform convergence for offline policy evaluation (OPE) problems with model-based methods (for episodic MDP) and provides a unified framework towards optimal learning for several well-motivated…

Machine Learning · Computer Science 2021-06-25 Ming Yin , Yu-Xiang Wang

The evolving landscape of online multiplayer gaming presents unique challenges in assessing the causal impacts of game features. Traditional A/B testing methodologies fall short due to complex player interactions, leading to violations of…

Applications · Statistics 2024-02-15 Yu Zhu , Zehang Richard Li , Yang Su , Zhenyu Zhao

We study the problem of off-policy evaluation (OPE) in reinforcement learning (RL), where the goal is to estimate the performance of a policy from the data generated by another policy(ies). In particular, we focus on the doubly robust (DR)…

Artificial Intelligence · Computer Science 2018-05-25 Mehrdad Farajtabar , Yinlam Chow , Mohammad Ghavamzadeh

Off-policy learning (OPL) in contextual bandits aims to learn a decision-making policy that maximizes the target rewards by using only historical interaction data collected under previously developed policies. Unfortunately, when rewards…

Machine Learning · Computer Science 2025-06-18 Rikiya Takehi , Masahiro Asami , Kosuke Kawakami , Yuta Saito

In offline-to-online reinforcement learning (O2O-RL), policies are first safely trained offline using previously collected datasets and then further fine-tuned for tasks via limited online interactions. In a typical O2O-RL pipeline,…

Machine Learning · Computer Science 2026-05-07 Alper Kamil Bozkurt , Xiaoan Xu , Shangtong Zhang , Miroslav Pajic , Yuichi Motai

Off-policy evaluation (OPE) in reinforcement learning is notoriously difficult in long- and infinite-horizon settings due to diminishing overlap between behavior and target policies. In this paper, we study the role of Markovian and…

Machine Learning · Statistics 2023-01-18 Nathan Kallus , Masatoshi Uehara

This work focuses on off-policy evaluation (OPE) with function approximation in infinite-horizon undiscounted Markov decision processes (MDPs). For MDPs that are ergodic and linear (i.e. where rewards and dynamics are linear in some known…

Machine Learning · Computer Science 2020-06-24 Nevena Lazic , Dong Yin , Mehrdad Farajtabar , Nir Levine , Dilan Gorur , Chris Harris , Dale Schuurmans

AI models are often evaluated based on their ability to predict the outcome of interest. However, in many AI for social impact applications, the presence of an intervention that affects the outcome can bias the evaluation. Randomized…

Machine Learning · Computer Science 2025-11-18 Winston Chen , Michael W. Sjoding , Jenna Wiens

In recent years, mathematical models have become an indispensable tool in the planning, evaluation, and implementation of public health interventions. Models must often provide detailed information for many levels of population…

Dynamical Systems · Mathematics 2024-06-05 Alex Viguerie , Chiara Piazzola , Md Hafizul Islam , Evin Uzun Jacobson

Even when unable to run experiments, practitioners can evaluate prospective policies, using previously logged data. However, while the bandits literature has adopted a diverse set of objectives, most research on off-policy evaluation to…

Machine Learning · Computer Science 2021-06-30 Audrey Huang , Liu Leqi , Zachary C. Lipton , Kamyar Azizzadenesheli

We study the problem of conservative off-policy evaluation (COPE) where given an offline dataset of environment interactions, collected by other agents, we seek to obtain a (tight) lower bound on a policy's performance. This is crucial when…

Machine Learning · Computer Science 2023-05-29 Jonas Rothfuss , Bhavya Sukhija , Tobias Birchler , Parnian Kassraie , Andreas Krause

Observational data have been actively used to estimate treatment effect, driven by the growing availability of electronic health records (EHRs). However, EHRs typically consist of longitudinal records, often introducing time-dependent…

Machine Learning · Computer Science 2024-06-14 Junghwan Lee , Simin Ma , Nicoleta Serban , Shihao Yang

In randomized experiments, the classic Stable Unit Treatment Value Assumption (SUTVA) posits that the outcome for one experimental unit is unaffected by the treatment assignments of other units. However, this assumption is frequently…

Methodology · Statistics 2024-11-18 Yiming Jiang , He Wang

A key methodological challenge in observational studies with interference between units is twofold: (1) each unit's outcome may depend on many others' treatments, and (2) treatment assignments may exhibit complex dependencies across units.…

Methodology · Statistics 2025-12-17 Souhardya Sengupta , Kosuke Imai , Georgia Papadogeorgou