English
Related papers

Related papers: Off-Policy Evaluation in Embedded Spaces

200 papers

Off-policy evaluation (OPE) methods allow us to compute the expected reward of a policy by using the logged data collected by a different policy. OPE is a viable alternative to running expensive online A/B tests: it can speed up the…

Machine Learning · Computer Science 2024-10-23 Matej Cief , Jacek Golebiowski , Philipp Schmidt , Ziawasch Abedjan , Artur Bekasov

Off-Policy Estimation (OPE) methods allow us to learn and evaluate decision-making policies from logged data. This makes them an attractive choice for the offline evaluation of recommender systems, and several recent works have reported…

Machine Learning · Computer Science 2023-09-11 Olivier Jeunen , Ben London

We study the efficient off-policy evaluation of natural stochastic policies, which are defined in terms of deviations from the behavior policy. This is a departure from the literature on off-policy evaluation where most work consider the…

Machine Learning · Computer Science 2020-11-05 Nathan Kallus , Masatoshi Uehara

The principal contribution of this paper is a conceptual framework for off-policy reinforcement learning, based on conditional expectations of importance sampling ratios. This framework yields new perspectives and understanding of existing…

Machine Learning · Computer Science 2020-07-31 Mark Rowland , Anna Harutyunyan , Hado van Hasselt , Diana Borsa , Tom Schaul , Rémi Munos , Will Dabney

Off-policy evaluation (OPE) holds the promise of being able to leverage large, offline datasets for both evaluating and selecting complex policies for decision making. The ability to learn offline is particularly important in many…

In offline reinforcement learning, weighted regression is a common method to ensure the learned policy stays close to the behavior policy and to prevent selecting out-of-sample actions. In this work, we show that due to the limited…

Machine Learning · Computer Science 2023-03-01 Huayu Chen , Cheng Lu , Chengyang Ying , Hang Su , Jun Zhu

Many reinforcement learning applications involve the use of data that is sensitive, such as medical records of patients or financial information. However, most current reinforcement learning methods can leak information contained within the…

Machine Learning · Computer Science 2019-02-04 Tengyang Xie , Philip S. Thomas , Gerome Miklau

We study estimator selection and hyper-parameter tuning in off-policy evaluation. Although cross-validation is the most popular method for model selection in supervised learning, off-policy evaluation relies mostly on theory, which provides…

Machine Learning · Computer Science 2024-12-23 Matej Cief , Branislav Kveton , Michal Kompan

Evaluating and optimizing policies in the presence of unobserved confounders is a problem of growing interest in offline reinforcement learning. Using conventional methods for offline RL in the presence of confounding can not only lead to…

Machine Learning · Statistics 2023-11-08 Chinmaya Kausik , Yangyi Lu , Kevin Tan , Maggie Makar , Yixin Wang , Ambuj Tewari

By reusing data throughout training, off-policy deep reinforcement learning algorithms offer improved sample efficiency relative to on-policy approaches. For continuous action spaces, the most popular methods for off-policy learning include…

Machine Learning · Computer Science 2023-12-01 Jared Markowitz , Jesse Silverberg , Gary Collins

A critical need for industrial recommender systems is the ability to evaluate recommendation policies offline, before deploying them to production. Unfortunately, widely used off-policy evaluation methods either make strong assumptions…

Machine Learning · Computer Science 2022-10-19 Alexander Buchholz , Ben London , Giuseppe di Benedetto , Thorsten Joachims

Evaluating a policy by deploying it in the real world can be risky and costly. Off-policy policy evaluation (OPE) algorithms use historical data collected from running a previous policy to evaluate a new policy, which provides a means for…

Artificial Intelligence · Computer Science 2017-12-07 Zhaohan Daniel Guo , Philip S. Thomas , Emma Brunskill

We study the problem of training diffusion models to sample from a distribution with a given unnormalized density or energy function. We benchmark several diffusion-structured inference methods, including simulation-based variational…

Improving the sample efficiency of reinforcement learning algorithms requires effective exploration. Following the principle of $\textit{optimism in the face of uncertainty}$ (OFU), we train a separate exploration policy to maximize the…

Machine Learning · Computer Science 2022-11-23 Jiachen Li , Shuo Cheng , Zhenyu Liao , Huayan Wang , William Yang Wang , Qinxun Bai

Accurately evaluating new policies (e.g. ad-placement models, ranking functions, recommendation functions) is one of the key prerequisites for improving interactive systems. While the conventional approach to evaluation relies on online A/B…

Machine Learning · Computer Science 2017-06-27 Aman Agarwal , Soumya Basu , Tobias Schnabel , Thorsten Joachims

We consider a model-based approach to perform batch off-policy evaluation in reinforcement learning. Our method takes a mixture-of-experts approach to combine parametric and non-parametric models of the environment such that the final value…

Machine Learning · Computer Science 2020-02-19 Omer Gottesman , Yao Liu , Scott Sussex , Emma Brunskill , Finale Doshi-Velez

This paper presents the first actor-critic algorithm for off-policy reinforcement learning. Our algorithm is online and incremental, and its per-time-step complexity scales linearly with the number of learned weights. Previous work on…

Machine Learning · Computer Science 2015-03-20 Thomas Degris , Martha White , Richard S. Sutton

Searching the space of policies directly for the optimal policy has been one popular method for solving partially observable reinforcement learning problems. Typically, with each change of the target policy, its value is estimated from the…

Artificial Intelligence · Computer Science 2007-05-23 Leonid Peshkin , Christian R. Shelton

Policy gradient methods are widely adopted reinforcement learning algorithms for tasks with continuous action spaces. These methods succeeded in many application domains, however, because of their notorious sample inefficiency their use…

Machine Learning · Statistics 2024-02-20 Davide Mambelli , Stephan Bongers , Onno Zoeter , Matthijs T. J. Spaan , Frans A. Oliehoek

In this paper, we study the convergence properties of off-policy policy improvement algorithms with state-action density ratio correction under function approximation setting, where the objective function is formulated as a max-max-min…

Machine Learning · Computer Science 2022-02-15 Jiawei Huang , Nan Jiang