English
Related papers

Related papers: Offline Recommender System Evaluation under Unobse…

200 papers

On a variety of complex decision-making tasks, from doctors prescribing treatment to judges setting bail, machine learning algorithms have been shown to outperform expert human judgments. One complication, however, is that it is often…

Methodology · Statistics 2018-05-07 Jongbin Jung , Ravi Shroff , Avi Feller , Sharad Goel

Off-policy evaluation (OPE) attempts to predict the performance of counterfactual policies using log data from a different policy. We extend its applicability by developing an OPE method for a class of both full support and deficient…

Machine Learning · Computer Science 2022-12-06 Yusuke Narita , Kyohei Okumura , Akihiro Shimizu , Kohei Yata

Off-policy evaluation (OPE) is the method that attempts to estimate the performance of decision making policies using historical data generated by different policies without conducting costly online A/B tests. Accurate OPE is essential in…

Artificial Intelligence · Computer Science 2021-09-20 Yuta Saito , Takuma Udagawa , Kei Tateno

Offline evaluation of language models from usage logs is biased when model choice is confounded: the same user-side factors that influence which model is used can also influence how its output is judged, so raw comparisons of logged scores…

Machine Learning · Computer Science 2026-05-05 Jikai Jin , Vasilis Syrgkanis

Assessing the effects of a policy based on observational data from a different policy is a common problem across several high-stake decision-making domains, and several off-policy evaluation (OPE) techniques have been proposed. However,…

Machine Learning · Computer Science 2022-01-21 Sonali Parbhoo , Shalmali Joshi , Finale Doshi-Velez

In this work, we consider the problem of estimating a behaviour policy for use in Off-Policy Policy Evaluation (OPE) when the true behaviour policy is unknown. Via a series of empirical studies, we demonstrate how accurate OPE is strongly…

Machine Learning · Computer Science 2018-07-11 Aniruddh Raghu , Omer Gottesman , Yao Liu , Matthieu Komorowski , Aldo Faisal , Finale Doshi-Velez , Emma Brunskill

This paper addresses the problem of policy selection in domains with abundant logged data, but with a restricted interaction budget. Solving this problem would enable safe evaluation and deployment of offline reinforcement learning policies…

Evaluating novel contextual bandit policies using logged data is crucial in applications where exploration is costly, such as medicine. But it usually relies on the assumption of no unobserved confounders, which is bound to fail in…

Machine Learning · Statistics 2019-08-07 Andrew Bennett , Nathan Kallus

Off-policy evaluation (OPE) holds the promise of being able to leverage large, offline datasets for both evaluating and selecting complex policies for decision making. The ability to learn offline is particularly important in many…

In real-world recommender systems and search engines, optimizing ranking decisions to present a ranked list of relevant items is critical. Off-policy evaluation (OPE) for ranking policies is thus gaining a growing interest because it…

Machine Learning · Statistics 2022-02-04 Haruka Kiyohara , Yuta Saito , Tatsuya Matsuhiro , Yusuke Narita , Nobuyuki Shimizu , Yasuo Yamamoto

Off-policy evaluation of sequential decision policies from observational data is necessary in applications of batch reinforcement learning such as education and healthcare. In such settings, however, unobserved variables confound observed…

Machine Learning · Computer Science 2020-07-14 Nathan Kallus , Angela Zhou

Off-policy evaluation (OPE) in contextual bandits has seen rapid adoption in real-world systems, since it enables offline evaluation of new policies using only historic log data. Unfortunately, when the number of actions is large, existing…

Machine Learning · Computer Science 2022-06-17 Yuta Saito , Thorsten Joachims

Off-policy evaluation (OPE) is a critical challenge in robust decision-making that seeks to assess the performance of a new policy using data collected under a different policy. However, the existing OPE methodologies suffer from several…

Machine Learning · Statistics 2025-02-11 Muhammad Faaiz Taufiq

Off-policy learning, referring to the procedure of policy optimization with access only to logged feedback data, has shown importance in various real-world applications, such as search engines, recommender systems, and etc. While the…

Machine Learning · Computer Science 2023-09-28 Xiaoying Zhang , Junpu Chen , Hongning Wang , Hong Xie , Yang Liu , John C. S. Lui , Hang Li

Offline reinforcement learning is important in domains such as medicine, economics, and e-commerce where online experimentation is costly, dangerous or unethical, and where the true model is unknown. However, most methods assume all…

Machine Learning · Statistics 2025-10-30 David Bruns-Smith , Angela Zhou

Off-policy evaluation (OPE) is a method for estimating the return of a target policy using some pre-collected observational data generated by a potentially different behavior policy. In some cases, there may be unmeasured variables that can…

Machine Learning · Statistics 2023-02-03 Yang Xu , Jin Zhu , Chengchun Shi , Shikai Luo , Rui Song

This paper develops a robust and efficient method for policy learning from observational data in the presence of unobserved confounding, complementing existing instrumental variable (IV) based approaches. We employ the marginal sensitivity…

Econometrics · Economics 2025-07-29 Zequn Jin , Gaoqian Xu , Xi Zheng , Yahong Zhou

We consider off-policy evaluation (OPE) in Partially Observable Markov Decision Processes (POMDPs), where the evaluation policy depends only on observable variables and the behavior policy depends on unobservable latent variables. Existing…

Machine Learning · Computer Science 2022-06-17 Chengchun Shi , Masatoshi Uehara , Jiawei Huang , Nan Jiang

In an Markov decision process (MDP), unobservable confounders may exist and have impacts on the data generating process, so that the classic off-policy evaluation (OPE) estimators may fail to identify the true value function of the target…

Machine Learning · Statistics 2022-09-13 Miao Lu , Wenhao Yang , Liangyu Zhang , Zhihua Zhang

This paper investigates the problem of online prediction learning, where learning proceeds continuously as the agent interacts with an environment. The predictions made by the agent are contingent on a particular way of behaving,…

Machine Learning · Computer Science 2018-11-08 Sina Ghiassian , Andrew Patterson , Martha White , Richard S. Sutton , Adam White