English
Related papers

Related papers: Off-Policy Risk Assessment in Contextual Bandits

200 papers

We study the problem of online learning in adversarial bandit problems under a partial observability model called off-policy feedback. In this sequential decision making problem, the learner cannot directly observe its rewards, but instead…

Machine Learning · Computer Science 2022-07-20 Germano Gabbianelli , Matteo Papini , Gergely Neu

We develop confidence bounds that hold uniformly over time for off-policy evaluation in the contextual bandit setting. These confidence sequences are based on recent ideas from martingale analysis and are non-asymptotic, non-parametric, and…

Machine Learning · Computer Science 2021-02-19 Nikos Karampatziakis , Paul Mineiro , Aaditya Ramdas

Off-policy evaluation (OPE) attempts to predict the performance of counterfactual policies using log data from a different policy. We extend its applicability by developing an OPE method for a class of both full support and deficient…

Machine Learning · Computer Science 2022-12-06 Yusuke Narita , Kyohei Okumura , Akihiro Shimizu , Kohei Yata

We present and prove properties of a new offline policy evaluator for an exploration learning setting which is superior to previous evaluators. In particular, it simultaneously and correctly incorporates techniques from importance…

Machine Learning · Computer Science 2012-10-19 Miroslav Dudik , Dumitru Erhan , John Langford , Lihong Li

When data are collected adaptively, such as in bandit algorithms, classical statistical approaches such as ordinary least squares and $M$-estimation will often fail to achieve asymptotic normality. Although recent lines of work have…

Methodology · Statistics 2026-02-10 James Leiner , Robin Dunn , Aaditya Ramdas

Off-policy learning is a framework for evaluating and optimizing policies without deploying them, from data collected by another policy. Real-world environments are typically non-stationary and the offline learned policies should adapt to…

Machine Learning · Computer Science 2021-04-06 Joey Hong , Branislav Kveton , Manzil Zaheer , Yinlam Chow , Amr Ahmed

Improving the sample efficiency of reinforcement learning algorithms requires effective exploration. Following the principle of $\textit{optimism in the face of uncertainty}$ (OFU), we train a separate exploration policy to maximize the…

Machine Learning · Computer Science 2022-11-23 Jiachen Li , Shuo Cheng , Zhenyu Liao , Huayan Wang , William Yang Wang , Qinxun Bai

Contextual bandit algorithms have become popular for online recommendation systems such as Digg, Yahoo! Buzz, and news recommendation in general. \emph{Offline} evaluation of the effectiveness of new algorithms in these applications is…

Machine Learning · Computer Science 2015-03-13 Lihong Li , Wei Chu , John Langford , Xuanhui Wang

This work investigates the offline formulation of the contextual bandit problem, where the goal is to leverage past interactions collected under a behavior policy to evaluate, select, and learn new, potentially better-performing, policies.…

Machine Learning · Statistics 2024-11-01 Otmane Sakhi , Imad Aouali , Pierre Alquier , Nicolas Chopin

We develop a generic data-driven method for estimator selection in off-policy policy evaluation settings. We establish a strong performance guarantee for the method, showing that it is competitive with the oracle estimator, up to a constant…

Machine Learning · Computer Science 2020-08-25 Yi Su , Pavithra Srinath , Akshay Krishnamurthy

Off-policy learning and evaluation leverage logged bandit feedback datasets, which contain context, action, propensity score, and feedback for each data point. These scenarios face significant challenges due to high variance and poor…

Machine Learning · Computer Science 2025-06-10 Armin Behnamnia , Gholamali Aminian , Alireza Aghaei , Chengchun Shi , Vincent Y. F. Tan , Hamid R. Rabiee

We study the problem of off-policy evaluation in the multi-armed bandit model with bounded rewards, and develop minimax rate-optimal procedures under three settings. First, when the behavior policy is known, we show that the Switch…

Machine Learning · Statistics 2021-01-20 Cong Ma , Banghua Zhu , Jiantao Jiao , Martin J. Wainwright

Off-policy evaluation (OPE) is critical for applying contextual bandit algorithms to high-stakes decision-making settings such as healthcare, where new treatment policies must be evaluated prior to deployment. Unfortunately, OPE techniques…

Machine Learning · Computer Science 2026-05-28 Aishwarya Mandyam , Shengpu Tang , Jiayu Yao , Jenna Wiens , Barbara E. Engelhardt

Off-policy evaluation (OPE) aims to estimate the performance of hypothetical policies using data generated by a different policy. Because of its huge potential impact in practice, there has been growing research interest in this field.…

Machine Learning · Computer Science 2021-10-27 Yuta Saito , Shunsuke Aihara , Megumi Matsutani , Yusuke Narita

We study off-policy evaluation (OPE) of contextual bandit policies for large discrete action spaces where conventional importance-weighting approaches suffer from excessive variance. To circumvent this variance issue, we propose a new…

Machine Learning · Statistics 2023-06-12 Yuta Saito , Qingyang Ren , Thorsten Joachims

A major research direction in contextual bandits is to develop algorithms that are computationally efficient, yet support flexible, general-purpose function approximation. Algorithms based on modeling rewards have shown strong empirical…

Machine Learning · Computer Science 2021-07-14 Dylan J. Foster , Claudio Gentile , Mehryar Mohri , Julian Zimmert

We consider off-policy policy evaluation with function approximation (FA) in average-reward MDPs, where the goal is to estimate both the reward rate and the differential value function. For this problem, bootstrapping is necessary and,…

Machine Learning · Computer Science 2022-10-19 Shangtong Zhang , Yi Wan , Richard S. Sutton , Shimon Whiteson

What is the most statistically efficient way to do off-policy evaluation and optimization with batch data from bandit feedback? For log data generated by contextual bandit algorithms, we consider offline estimators for the expected reward…

Machine Learning · Computer Science 2018-12-07 Yusuke Narita , Shota Yasui , Kohei Yata

The principal contribution of this paper is a conceptual framework for off-policy reinforcement learning, based on conditional expectations of importance sampling ratios. This framework yields new perspectives and understanding of existing…

Machine Learning · Computer Science 2020-07-31 Mark Rowland , Anna Harutyunyan , Hado van Hasselt , Diana Borsa , Tom Schaul , Rémi Munos , Will Dabney

Off-policy evaluation and learning in contextual bandits use logged interaction data to estimate and optimize the value of a target policy. Most existing methods require sufficient action overlap between the logging and target policies, and…

Machine Learning · Statistics 2026-02-03 Shu Tamano