English
Related papers

Related papers: Off-Policy Evaluation Under Nonignorable Missing D…

200 papers

Motivated by the many real-world applications of reinforcement learning (RL) that require safe-policy iterations, we consider the problem of off-policy evaluation (OPE) -- the problem of evaluating a new policy using the historical data…

Machine Learning · Computer Science 2020-04-02 Tengyang Xie , Yifei Ma , Yu-Xiang Wang

This paper studies off-policy evaluation (OPE) in the presence of unmeasured confounders. Inspired by the two-way fixed effects regression model widely used in the panel data literature, we propose a two-way unmeasured confounding…

Machine Learning · Computer Science 2024-12-10 Shuguang Yu , Shuxing Fang , Ruixin Peng , Zhengling Qi , Fan Zhou , Chengchun Shi

Many sequential decision making problems are high-stakes and require off-policy evaluation (OPE) of a new policy using historical data collected using some other policy. One of the most common OPE techniques that provides unbiased estimates…

Machine Learning · Computer Science 2021-12-06 Christina J. Yuan , Yash Chandak , Stephen Giguere , Philip S. Thomas , Scott Niekum

We study the problem of offline policy optimization in stochastic contextual bandit problems, where the goal is to learn a near-optimal policy based on a dataset of decision data collected by a suboptimal behavior policy. Rather than making…

Machine Learning · Computer Science 2023-09-28 Germano Gabbianelli , Gergely Neu , Matteo Papini

We consider the off-policy evaluation (OPE) problem in contextual bandits, where the goal is to estimate the value of a target policy using the data collected by a logging policy. Most popular approaches to the OPE are variants of the…

Machine Learning · Statistics 2024-08-20 Sutanoy Dasgupta , Yabo Niu , Kishan Panaganti , Dileep Kalathil , Debdeep Pati , Bani Mallick

Optimizing survival outcomes, such as patient survival or customer retention, is a critical objective in data-driven decision-making. Off-Policy Evaluation~(OPE) provides a powerful framework for assessing such decision-making policies…

Methodology · Statistics 2026-03-25 Kohsuke Kubota , Mitsuhiro Takahashi , Yuta Saito

Offline policy optimization could have a large impact on many real-world decision-making problems, as online learning may be infeasible in many applications. Importance sampling and its variants are a commonly used type of estimator in…

Machine Learning · Computer Science 2022-07-05 Yao Liu , Yannis Flet-Berliac , Emma Brunskill

Evaluating and optimizing policies in the presence of unobserved confounders is a problem of growing interest in offline reinforcement learning. Using conventional methods for offline RL in the presence of confounding can not only lead to…

Machine Learning · Statistics 2023-11-08 Chinmaya Kausik , Yangyi Lu , Kevin Tan , Maggie Makar , Yixin Wang , Ambuj Tewari

We study the novel problem of future off-policy evaluation (F-OPE) and learning (F-OPL) for estimating and optimizing the future value of policies in non-stationary environments, where distributions vary over time. In e-commerce…

Machine Learning · Computer Science 2025-06-26 Tatsuhiro Shimizu , Kazuki Kawamura , Takanori Muroi , Yusuke Narita , Kei Tateno , Takuma Udagawa , Yuta Saito

We introduce a novel doubly-robust (DR) off-policy evaluation (OPE) estimator for Markov decision processes, DRUnknown, designed for situations where both the logging policy and the value function are unknown. The proposed estimator…

Machine Learning · Statistics 2024-04-03 Kyungbok Lee , Myunghee Cho Paik

We study the problem of estimating the distribution of the return of a policy using an offline dataset that is not generated from the policy, i.e., distributional offline policy evaluation (OPE). We propose an algorithm called Fitted…

Machine Learning · Computer Science 2024-01-01 Runzhe Wu , Masatoshi Uehara , Wen Sun

Evaluating the value of a hypothetical target policy with only a logged dataset is important but challenging. On the one hand, it brings opportunities for safe policy improvement under high-stakes scenarios like clinical guidelines. On the…

Machine Learning · Computer Science 2024-10-30 Hao Sun , Alex J. Chan , Nabeel Seedat , Alihan Hüyük , Mihaela van der Schaar

Holdout validation and hyperparameter tuning from data is a long-standing problem in offline reinforcement learning (RL). A standard framework is to use off-policy evaluation (OPE) methods to evaluate and select the policies, but OPE either…

Machine Learning · Computer Science 2025-10-27 Pai Liu , Lingfeng Zhao , Shivangi Agarwal , Jinghan Liu , Audrey Huang , Philip Amortila , Nan Jiang

Developing theoretical guarantees on the sample complexity of offline RL methods is an important step towards making data-hungry RL algorithms practically viable. Currently, most results hinge on unrealistic assumptions about the data…

Machine Learning · Computer Science 2024-05-02 Sunil Madhow , Dan Qiao , Ming Yin , Yu-Xiang Wang

Value function estimation is an indispensable subroutine in reinforcement learning, which becomes more challenging in the offline setting. In this paper, we propose Hybrid Value Estimation (HVE) to reduce value estimation error, which…

Machine Learning · Computer Science 2022-06-07 Xue-Kun Jin , Xu-Hui Liu , Shengyi Jiang , Yang Yu

In reinforcement learning, off-policy evaluation (OPE) is the problem of estimating the expected return of an evaluation policy given a fixed dataset that was collected by running one or more different policies. One of the more empirically…

Machine Learning · Computer Science 2023-10-31 Brahma S. Pavse , Josiah P. Hanna

In an Markov decision process (MDP), unobservable confounders may exist and have impacts on the data generating process, so that the classic off-policy evaluation (OPE) estimators may fail to identify the true value function of the target…

Machine Learning · Statistics 2022-09-13 Miao Lu , Wenhao Yang , Liangyu Zhang , Zhihua Zhang

Off-policy evaluation (OPE) is widely applied in sectors such as pharmaceuticals and e-commerce to evaluate the efficacy of novel products or policies from offline datasets. This paper introduces a causal deepset framework that relaxes…

Machine Learning · Statistics 2024-07-26 Runpeng Dai , Jianing Wang , Fan Zhou , Shikai Luo , Zhiwei Qin , Chengchun Shi , Hongtu Zhu

We consider off-policy evaluation (OPE) of deterministic target policies for reinforcement learning (RL) in environments with continuous action spaces. While it is common to use importance sampling for OPE, it suffers from high variance…

Machine Learning · Computer Science 2024-05-30 Haanvid Lee , Tri Wahyu Guntara , Jongmin Lee , Yung-Kyun Noh , Kee-Eung Kim

In this work, we present a novel way of computing IPS using a position-bias model for deterministic logging policies. This technique significantly widens the policies on which OPE can be used. We validate this technique using two different…

Information Retrieval · Computer Science 2022-09-01 Nick Wood , Sumit Sidana
‹ Prev 1 3 4 5 6 7 10 Next ›