English
Related papers

Related papers: Balanced off-policy evaluation in general action s…

200 papers

Value function estimation is an indispensable subroutine in reinforcement learning, which becomes more challenging in the offline setting. In this paper, we propose Hybrid Value Estimation (HVE) to reduce value estimation error, which…

Machine Learning · Computer Science 2022-06-07 Xue-Kun Jin , Xu-Hui Liu , Shengyi Jiang , Yang Yu

Offline contextual bandits allow one to learn policies from historical/offline data without requiring online interaction. However, offline policy optimization that maximizes overall expected rewards can unintentionally amplify the reward…

Machine Learning · Computer Science 2026-01-07 Yihong Guo , Junjie Luo , Guodong Gao , Ritu Agarwal , Anqi Liu

Methods for sequential decision-making are often built upon a foundational assumption that the underlying decision process is stationary. This limits the application of such methods because real-world problems are often subject to changes…

Machine Learning · Computer Science 2023-01-26 Yash Chandak , Shiv Shankar , Nathaniel D. Bastian , Bruno Castro da Silva , Emma Brunskil , Philip S. Thomas

Off-policy learning and evaluation leverage logged bandit feedback datasets, which contain context, action, propensity score, and feedback for each data point. These scenarios face significant challenges due to high variance and poor…

Machine Learning · Computer Science 2025-06-10 Armin Behnamnia , Gholamali Aminian , Alireza Aghaei , Chengchun Shi , Vincent Y. F. Tan , Hamid R. Rabiee

We present a new approach to the problems of evaluating and learning personalized decision policies from observational data of past contexts, decisions, and outcomes. Only the outcome of the enacted decision is available and the historical…

Machine Learning · Statistics 2019-06-04 Nathan Kallus

We consider offline policy optimization (OPO) in contextual bandits, where one is given a fixed dataset of logged interactions. While pessimistic regularizers are typically used to mitigate distribution shift, prior implementations thereof…

Machine Learning · Computer Science 2023-10-27 Lequn Wang , Akshay Krishnamurthy , Aleksandrs Slivkins

We study risk-aware offline policy learning, aiming to learn a decision rule from logged data that is optimal under general risk criteria. This problem is crucial in high-stakes domains where online interaction is infeasible and adverse…

Machine Learning · Statistics 2026-05-18 Yilong Wan , Yuqiang Li , Xianyi Wu

Recent work on policy learning from observational data has highlighted the importance of efficient policy evaluation and has proposed reductions to weighted (cost-sensitive) classification. But, efficient policy evaluation need not yield…

Machine Learning · Computer Science 2020-02-13 Andrew Bennett , Nathan Kallus

We study the problem of off-policy policy optimization in Markov decision processes, and develop a novel off-policy policy gradient method. Prior off-policy policy gradient approaches have generally ignored the mismatch between the…

Machine Learning · Computer Science 2019-07-09 Yao Liu , Adith Swaminathan , Alekh Agarwal , Emma Brunskill

We study the novel problem of future off-policy evaluation (F-OPE) and learning (F-OPL) for estimating and optimizing the future value of policies in non-stationary environments, where distributions vary over time. In e-commerce…

Machine Learning · Computer Science 2025-06-26 Tatsuhiro Shimizu , Kazuki Kawamura , Takanori Muroi , Yusuke Narita , Kei Tateno , Takuma Udagawa , Yuta Saito

Off-policy evaluation (OPE) estimates the performance of a target policy using offline data collected from a behavior policy, and is crucial in domains such as robotics or healthcare where direct interaction with the environment is costly…

We study off-policy evaluation and learning from sequential data in a structured class of Markov decision processes that arise from repeated interactions with an exogenous sequence of arrivals with contexts, which generate unknown…

Machine Learning · Computer Science 2021-10-20 Nathan Kallus , Angela Zhou

Off-policy policy evaluation (OPE), an essential component of reinforcement learning, has long suffered from stationary state distribution mismatch, undermining both stability and accuracy of OPE estimates. While existing methods correct…

Machine Learning · Computer Science 2025-08-12 Fengdi Che , Bryan Chan , Chen Ma , A. Rupam Mahmood

In many real-world pattern recognition scenarios, such as in medical applications, the corresponding classification tasks can be of an imbalanced nature. In the current study, we focus on binary, imbalanced classification tasks, i.e.~binary…

Machine Learning · Computer Science 2020-12-01 Peter Bellmann , Heinke Hihn , Daniel A. Braun , Friedhelm Schwenker

Even when unable to run experiments, practitioners can evaluate prospective policies, using previously logged data. However, while the bandits literature has adopted a diverse set of objectives, most research on off-policy evaluation to…

Machine Learning · Computer Science 2021-06-30 Audrey Huang , Liu Leqi , Zachary C. Lipton , Kamyar Azizzadenesheli

Optimizing survival outcomes, such as patient survival or customer retention, is a critical objective in data-driven decision-making. Off-Policy Evaluation~(OPE) provides a powerful framework for assessing such decision-making policies…

Methodology · Statistics 2026-03-25 Kohsuke Kubota , Mitsuhiro Takahashi , Yuta Saito

The (contextual) multi-armed bandit problem (MAB) provides a formalization of sequential decision-making which has many applications. However, validly evaluating MAB policies is challenging; we either resort to simulations which inherently…

Machine Learning · Computer Science 2019-08-22 Jules Kruijswijk , Petri Parvinen , Maurits Kaptein

We consider the problem of off-policy evaluation for reinforcement learning, where the goal is to estimate the expected reward of a target policy $\pi$ using offline data collected by running a logging policy $\mu$. Standard…

Machine Learning · Computer Science 2020-07-09 Ming Yin , Yu-Xiang Wang

Ensemble learning plays a crucial role in practical applications of online learning due to its enhanced classification performance and adaptable adjustment mechanisms. However, most weight allocation strategies in ensemble learning are…

Machine Learning · Computer Science 2025-03-21 Songqiao Hu , Zeyi Liu , Xiao He

We address the problem of A/B testing, a widely used protocol for evaluating the potential improvement achieved by a new decision system compared to a baseline. This protocol segments the population into two subgroups, each exposed to a…

Machine Learning · Statistics 2025-06-16 Otmane Sakhi , Alexandre Gilotte , David Rohde