English
Related papers

Related papers: Off-Policy Evaluation and Learning for Matching Ma…

200 papers

We study the problem of off-policy evaluation (OPE) in Reinforcement Learning (RL), where the aim is to estimate the performance of a new policy given historical data that may have been generated by a different policy, or policies. In…

Machine Learning · Computer Science 2019-12-16 Aurélien F. Bibaut , Ivana Malenica , Nikos Vlassis , Mark J. van der Laan

The Off-Policy Evaluation (OPE) problem consists of evaluating the performance of counterfactual policies with data collected by another one. To solve the OPE problem, we resort to estimators, which aim to estimate in the most accurate way…

Machine Learning · Computer Science 2024-11-12 Nicolò Felicioni , Michael Benigni , Maurizio Ferrari Dacrema

This paper addresses the problem of policy selection in domains with abundant logged data, but with a restricted interaction budget. Solving this problem would enable safe evaluation and deployment of offline reinforcement learning policies…

Off-policy evaluation (OPE) in ranking settings with large ranking action spaces, which stems from an increase in both the number of unique actions and length of the ranking, is essential for assessing new recommender policies using only…

Machine Learning · Statistics 2025-06-03 Tatsuki Takahashi , Chihiro Maru , Hiroko Shoji

Off-policy evaluation (OPE) in contextual bandits has seen rapid adoption in real-world systems, since it enables offline evaluation of new policies using only historic log data. Unfortunately, when the number of actions is large, existing…

Machine Learning · Computer Science 2022-06-17 Yuta Saito , Thorsten Joachims

In real-world recommender systems and search engines, optimizing ranking decisions to present a ranked list of relevant items is critical. Off-policy evaluation (OPE) for ranking policies is thus gaining a growing interest because it…

Machine Learning · Statistics 2022-02-04 Haruka Kiyohara , Yuta Saito , Tatsuya Matsuhiro , Yusuke Narita , Nobuyuki Shimizu , Yasuo Yamamoto

We offer an experimental benchmark and empirical study for off-policy policy evaluation (OPE) in reinforcement learning, which is a key problem in many safety critical applications. Given the increasing interest in deploying learning-based…

Machine Learning · Computer Science 2021-11-30 Cameron Voloshin , Hoang M. Le , Nan Jiang , Yisong Yue

Off-Policy Evaluation (OPE) aims to estimate the value of a target policy using offline data collected from potentially different policies. In real-world applications, however, logged data often suffers from missingness. While OPE has been…

Machine Learning · Statistics 2025-07-10 Han Wang , Yang Xu , Wenbin Lu , Rui Song

Off-policy evaluation (OPE) is the problem of estimating the value of a target policy using historical data collected under a different logging policy. OPE methods typically assume overlap between the target and logging policy, enabling…

Methodology · Statistics 2024-03-12 Samir Khan , Martin Saveski , Johan Ugander

Off-policy Evaluation (OPE) methods are crucial tools for evaluating policies in high-stakes domains such as healthcare, where direct deployment is often infeasible, unethical, or expensive. When deployment environments are expected to…

Machine Learning · Computer Science 2022-09-20 Harvineet Singh , Shalmali Joshi , Finale Doshi-Velez , Himabindu Lakkaraju

Off-policy evaluation (OPE) is the problem of estimating the value of a target policy from samples obtained via different policies. Recently, applying OPE methods for bandit problems has garnered attention. For the theoretical guarantees of…

Machine Learning · Computer Science 2020-10-26 Masahiro Kato , Kenshi Abe , Kaito Ariu , Shota Yasui

Off-policy evaluation (OPE) is a critical challenge in robust decision-making that seeks to assess the performance of a new policy using data collected under a different policy. However, the existing OPE methodologies suffer from several…

Machine Learning · Statistics 2025-02-11 Muhammad Faaiz Taufiq

Reinforcement learning (RL) can be used to learn treatment policies and aid decision making in healthcare. However, given the need for generalization over complex state/action spaces, the incorporation of function approximators (e.g., deep…

Machine Learning · Computer Science 2021-07-26 Shengpu Tang , Jenna Wiens

This paper demonstrates the successful application of Off-Policy Evaluation (OPE) to accelerate recommender system development and optimization at Adyen, a global leader in financial payment processing. Facing the limitations of traditional…

Machine Learning · Computer Science 2025-01-22 Alex Egg

Off-Policy evaluation (OPE) is concerned with evaluating a new target policy using offline data generated by a potentially different behavior policy. It is critical in a number of sequential decision making problems ranging from healthcare…

Machine Learning · Statistics 2023-01-02 Yang Xu , Chengchun Shi , Shikai Luo , Lan Wang , Rui Song

Holdout validation and hyperparameter tuning from data is a long-standing problem in offline reinforcement learning (RL). A standard framework is to use off-policy evaluation (OPE) methods to evaluate and select the policies, but OPE either…

Machine Learning · Computer Science 2025-10-27 Pai Liu , Lingfeng Zhao , Shivangi Agarwal , Jinghan Liu , Audrey Huang , Philip Amortila , Nan Jiang

Off-policy evaluation (OPE) methods aim to estimate the value of a new reinforcement learning (RL) policy prior to deployment. Recent advances have shown that leveraging auxiliary datasets, such as those synthesized by generative models,…

Machine Learning · Computer Science 2025-07-29 Aishwarya Mandyam , Jason Meng , Ge Gao , Jiankai Sun , Mac Schwager , Barbara E. Engelhardt , Emma Brunskill

We study the off-policy evaluation (OPE) problem in reinforcement learning with linear function approximation, which aims to estimate the value function of a target policy based on the offline data collected by a behavior policy. We propose…

Machine Learning · Computer Science 2022-01-05 Yifei Min , Tianhao Wang , Dongruo Zhou , Quanquan Gu

Developing theoretical guarantees on the sample complexity of offline RL methods is an important step towards making data-hungry RL algorithms practically viable. Currently, most results hinge on unrealistic assumptions about the data…

Machine Learning · Computer Science 2024-05-02 Sunil Madhow , Dan Qiao , Ming Yin , Yu-Xiang Wang

We consider the off-policy evaluation (OPE) problem in contextual bandits, where the goal is to estimate the value of a target policy using the data collected by a logging policy. Most popular approaches to the OPE are variants of the…

Machine Learning · Statistics 2024-08-20 Sutanoy Dasgupta , Yabo Niu , Kishan Panaganti , Dileep Kalathil , Debdeep Pati , Bani Mallick