English
Related papers

Related papers: Consistent On-Line Off-Policy Evaluation

200 papers

Off-policy evaluation (OPE) is the task of estimating the expected reward of a given policy based on offline data previously collected under different policies. Therefore, OPE is a key step in applying reinforcement learning to real-world…

Machine Learning · Computer Science 2021-03-11 Yihao Feng , Ziyang Tang , Na Zhang , Qiang Liu

In reinforcement learning, the TD($\lambda$) algorithm is a fundamental policy evaluation method with an efficient online implementation that is suitable for large-scale problems. One practical drawback of TD($\lambda$) is its sensitivity…

Machine Learning · Statistics 2014-12-23 Aviv Tamar , Panos Toulis , Shie Mannor , Edoardo M. Airoldi

We consider the off-policy evaluation (OPE) problem in contextual bandits, where the goal is to estimate the value of a target policy using the data collected by a logging policy. Most popular approaches to the OPE are variants of the…

Machine Learning · Statistics 2024-08-20 Sutanoy Dasgupta , Yabo Niu , Kishan Panaganti , Dileep Kalathil , Debdeep Pati , Bani Mallick

Off-policy evaluation (OPE) attempts to predict the performance of counterfactual policies using log data from a different policy. We extend its applicability by developing an OPE method for a class of both full support and deficient…

Machine Learning · Computer Science 2022-12-06 Yusuke Narita , Kyohei Okumura , Akihiro Shimizu , Kohei Yata

Off-policy evaluation (OPE) is the problem of estimating the value of a target policy from samples obtained via different policies. Recently, applying OPE methods for bandit problems has garnered attention. For the theoretical guarantees of…

Machine Learning · Computer Science 2020-10-26 Masahiro Kato , Kenshi Abe , Kaito Ariu , Shota Yasui

The problem of Offline Policy Evaluation (OPE) in Reinforcement Learning (RL) is a critical step towards applying RL in real-life applications. Existing work on OPE mostly focus on evaluating a fixed target policy $\pi$, which does not…

Machine Learning · Computer Science 2020-12-02 Ming Yin , Yu Bai , Yu-Xiang Wang

The goal of off-policy evaluation (OPE) is to evaluate a new policy using historical data obtained via a behavior policy. However, because the contextual bandit algorithm updates the policy based on past observations, the samples are not…

Machine Learning · Computer Science 2020-10-27 Masahiro Kato , Yusuke Kaneko

This document is a guide to the implementation of true online emphatic TD($\lambda$), a model-free temporal-difference algorithm for learning to make long-term predictions which combines the emphasis idea (Sutton, Mahmood & White 2015) and…

Machine Learning · Computer Science 2015-07-28 Richard S. Sutton

Off-policy evaluation (OPE) holds the promise of being able to leverage large, offline datasets for both evaluating and selecting complex policies for decision making. The ability to learn offline is particularly important in many…

Temporal difference learning and Residual Gradient methods are the most widely used temporal difference based learning algorithms; however, it has been shown that none of their objective functions is optimal w.r.t approximating the true…

Machine Learning · Computer Science 2017-04-21 Bo Liu , Daoming Lyu , Wen Dong , Saad Biaz

In this paper we revisit the method of off-policy corrections for reinforcement learning (COP-TD) pioneered by Hallak et al. (2017). Under this method, online updates to the value function are reweighted to avoid divergence issues typical…

Machine Learning · Computer Science 2019-01-29 Carles Gelada , Marc G. Bellemare

When learning policies for real-world domains, two important questions arise: (i) how to efficiently use pre-collected off-policy, non-optimal behavior data; and (ii) how to mediate among different competing objectives and constraints. We…

Machine Learning · Computer Science 2019-03-22 Hoang M. Le , Cameron Voloshin , Yisong Yue

Learning the value function of a given policy from data samples is an important problem in Reinforcement Learning. TD($\lambda$) is a popular class of algorithms to solve this problem. However, the weights assigned to different $n$-step…

Machine Learning · Computer Science 2021-11-24 Rohan Deb , Meet Gandhi , Shalabh Bhatnagar

Off-policy evaluation (OPE) is a method for estimating the return of a target policy using some pre-collected observational data generated by a potentially different behavior policy. In some cases, there may be unmeasured variables that can…

Machine Learning · Statistics 2023-02-03 Yang Xu , Jin Zhu , Chengchun Shi , Shikai Luo , Rui Song

We consider off-policy temporal-difference (TD) learning in discounted Markov decision processes, where the goal is to evaluate a policy in a model-free way by using observations of a state process generated without executing the policy. To…

Machine Learning · Computer Science 2018-11-27 Huizhen Yu , A. Rupam Mahmood , Richard S. Sutton

We present a novel $l_1$ regularized off-policy convergent TD-learning method (termed RO-TD), which is able to learn sparse representations of value functions with low computational complexity. The algorithmic framework underlying RO-TD…

Machine Learning · Computer Science 2020-06-11 Bo Liu , Sridhar Mahadevan , Ji Liu

Off-policy evaluation (OPE) is a critical challenge in robust decision-making that seeks to assess the performance of a new policy using data collected under a different policy. However, the existing OPE methodologies suffer from several…

Machine Learning · Statistics 2025-02-11 Muhammad Faaiz Taufiq

In this paper we provide a rigorous convergence analysis of a "off"-policy temporal difference learning algorithm with linear function approximation and per time-step linear computational complexity in "online" learning environment. The…

Machine Learning · Computer Science 2016-05-20 Prasenjit Karmakar , Rajkumar Maity , Shalabh Bhatnagar

This work studies the statistical limits of uniform convergence for offline policy evaluation (OPE) problems with model-based methods (for episodic MDP) and provides a unified framework towards optimal learning for several well-motivated…

Machine Learning · Computer Science 2021-06-25 Ming Yin , Yu-Xiang Wang

Offline policy evaluation (OPE) allows us to evaluate and estimate a new sequential decision-making policy's performance by leveraging historical interaction data collected from other policies. Evaluating a new policy online without a…

Machine Learning · Computer Science 2024-11-04 Allen Nie , Yash Chandak , Christina J. Yuan , Anirudhan Badrinath , Yannis Flet-Berliac , Emma Brunskil