English
Related papers

Related papers: High-Confidence Off-Policy (or Counterfactual) Var…

200 papers

We consider off-policy selection and learning in contextual bandits, where the learner aims to select or train a reward-maximizing policy using data collected by a fixed behavior policy. Our contribution is two-fold. First, we propose a…

Machine Learning · Computer Science 2025-07-15 J. Jon Ryu , Jeongyeol Kwon , Benjamin Koppe , Kwang-Sung Jun

We introduce an off-policy evaluation procedure for highlighting episodes where applying a reinforcement learned (RL) policy is likely to have produced a substantially different outcome than the observed policy. In particular, we introduce…

Machine Learning · Computer Science 2021-03-04 Michael Oberst , David Sontag

Contextual bandit algorithms are ubiquitous tools for active sequential experimentation in healthcare and the tech industry. They involve online learning algorithms that adaptively learn policies over time to map observed contexts $X_t$ to…

Methodology · Statistics 2024-08-19 Ian Waudby-Smith , Lili Wu , Aaditya Ramdas , Nikos Karampatziakis , Paul Mineiro

Off-policy learning is key to scaling up reinforcement learning as it allows to learn about a target policy from the experience generated by a different behavior policy. Unfortunately, it has been challenging to combine off-policy learning…

Machine Learning · Computer Science 2019-01-04 Ahmed Touati , Pierre-Luc Bacon , Doina Precup , Pascal Vincent

We study off-policy evaluation (OPE) in partially observable environments with complex observations, with the goal of developing estimators whose guarantee avoids exponential dependence on the horizon. While such estimators exist for MDPs…

Machine Learning · Computer Science 2024-10-04 Yuheng Zhang , Nan Jiang

"Clipping" (a.k.a. importance weight truncation) is a widely used variance-reduction technique for counterfactual off-policy estimators. Like other variance-reduction techniques, clipping reduces variance at the cost of increased bias.…

Machine Learning · Computer Science 2023-09-06 Jan Malte Lichtenberg , Alexander Buchholz , Giuseppe Di Benedetto , Matteo Ruffini , Ben London

Most off-policy evaluation methods for contextual bandits have focused on the expected outcome of a policy, which is estimated via methods that at best provide only asymptotic guarantees. However, in many applications, the expectation may…

Machine Learning · Statistics 2022-10-27 Muhammad Faaiz Taufiq , Jean-Francois Ton , Rob Cornish , Yee Whye Teh , Arnaud Doucet

Off-policy evaluation (OPE) estimates the value of a contextual bandit policy prior to deployment. As such, OPE plays a critical role in ensuring safety in high-stakes domains such as healthcare. However, standard OPE approaches are limited…

Machine Learning · Computer Science 2025-11-25 Aishwarya Mandyam , Kalyani Limaye , Barbara E. Engelhardt , Emily Alsentzer

Counterfactual estimators are critical for learning and refining policies using logged data, a process known as Off-Policy Evaluation (OPE). OPE allows researchers to assess new policies without costly experiments, speeding up the…

Artificial Intelligence · Computer Science 2025-01-10 Ritam Guha , Nilavra Pathak

Infinite horizon off-policy policy evaluation is a highly challenging task due to the excessively large variance of typical importance sampling (IS) estimators. Recently, Liu et al. (2018a) proposed an approach that significantly reduces…

Machine Learning · Computer Science 2019-10-17 Ziyang Tang , Yihao Feng , Lihong Li , Dengyong Zhou , Qiang Liu

Off-policy learning from multistep returns is crucial for sample-efficient reinforcement learning, but counteracting off-policy bias without exacerbating variance is challenging. Classically, off-policy bias is corrected in a per-decision…

Machine Learning · Computer Science 2025-12-23 Brett Daley , Martha White , Christopher Amato , Marlos C. Machado

Policy learning algorithms are widely used in areas such as personalized medicine and advertising to develop individualized treatment regimes. However, most methods force a decision even when predictions are uncertain, which is risky in…

Machine Learning · Computer Science 2026-01-30 Ayush Sawarni , Jikai Jin , Justin Whitehouse , Vasilis Syrgkanis

Recommendation strategies are typically evaluated by using previously logged data, employing off-policy evaluation methods to estimate their expected performance. However, for strategies that present users with slates of multiple items, the…

Information Retrieval · Computer Science 2023-12-29 Shreyas Chaudhari , David Arbour , Georgios Theocharous , Nikos Vlassis

Estimating an individual's potential outcomes under counterfactual treatments is a challenging task for traditional causal inference and supervised learning approaches when the outcome is high-dimensional (e.g. gene expressions, impulse…

Machine Learning · Statistics 2025-02-13 Yulun Wu , Layne C. Price , Zichen Wang , Vassilis N. Ioannidis , Robert A. Barton , George Karypis

Importance sampling (IS) is a popular technique in off-policy evaluation, which re-weights the return of trajectories in the replay buffer to boost sample efficiency. However, training with IS can be unstable and previous attempts to…

Machine Learning · Computer Science 2025-05-20 Chengyang Ying , Zhongkai Hao , Xinning Zhou , Hang Su , Dong Yan , Jun Zhu

We propose a robust regression approach to off-policy evaluation (OPE) for contextual bandits. We frame OPE as a covariate-shift problem and leverage modern robust regression tools. Ours is a general approach that can be used to augment any…

Machine Learning · Computer Science 2019-11-19 Anqi Liu , Hao Liu , Anima Anandkumar , Yisong Yue

Recommender systems exemplify sequential decision-making under uncertainty, strategically deciding what content to serve to users, to optimise a range of potential objectives. To balance the explore-exploit trade-off successfully, Thompson…

Information Retrieval · Computer Science 2025-07-09 Olivier Jeunen

Designing effective model-based reinforcement learning algorithms is difficult because the ease of data generation must be weighed against the bias of model-generated data. In this paper, we study the role of model usage in policy…

Machine Learning · Computer Science 2021-11-30 Michael Janner , Justin Fu , Marvin Zhang , Sergey Levine

In applying reinforcement learning (RL) to high-stakes domains, quantitative and qualitative evaluation using observational data can help practitioners understand the generalization performance of new policies. However, this type of…

Machine Learning · Computer Science 2023-10-27 Shengpu Tang , Jenna Wiens

Off-policy evaluation can leverage logged data to estimate the effectiveness of new policies in e-commerce, search engines, media streaming services, or automatic diagnostic tools in healthcare. However, the performance of baseline…

Machine Learning · Computer Science 2025-03-03 Daniel Guzman-Olivares , Philipp Schmidt , Jacek Golebiowski , Artur Bekasov