English
Related papers

Related papers: Off-Policy Evaluation for Episodic Partially Obser…

200 papers

Off-policy evaluation (OPE) in contextual bandits has seen rapid adoption in real-world systems, since it enables offline evaluation of new policies using only historic log data. Unfortunately, when the number of actions is large, existing…

Machine Learning · Computer Science 2022-06-17 Yuta Saito , Thorsten Joachims

We consider off-policy evaluation and optimization with continuous action spaces. We focus on observational data where the data collection policy is unknown and needs to be estimated. We take a semi-parametric approach where the value…

Econometrics · Economics 2019-07-23 Mert Demirer , Vasilis Syrgkanis , Greg Lewis , Victor Chernozhukov

Off-policy evaluation (OPE) is to evaluate a target policy with data generated by other policies. Most previous OPE methods focus on precisely estimating the true performance of a policy. We observe that in many applications, (1) the end…

Machine Learning · Computer Science 2022-06-22 Yue Jin , Yue Zhang , Tao Qin , Xudong Zhang , Jian Yuan , Houqiang Li , Tie-Yan Liu

Partially Observable Monte-Carlo Planning (POMCP) is a powerful online algorithm able to generate approximate policies for large Partially Observable Markov Decision Processes. The online nature of this method supports scalability by…

Artificial Intelligence · Computer Science 2021-04-29 Giulio Mazzi , Alberto Castellini , Alessandro Farinelli

Partially-observable Markov decision processes (POMDPs) with discounted-sum payoff are a standard framework to model a wide range of problems related to decision making under uncertainty. Traditionally, the goal has been to obtain policies…

Artificial Intelligence · Computer Science 2018-05-01 Krishnendu Chatterjee , Adrián Elgyütt , Petr Novotný , Owen Rouillé

Offline policy evaluation (OPE) allows us to evaluate and estimate a new sequential decision-making policy's performance by leveraging historical interaction data collected from other policies. Evaluating a new policy online without a…

Machine Learning · Computer Science 2024-11-04 Allen Nie , Yash Chandak , Christina J. Yuan , Anirudhan Badrinath , Yannis Flet-Berliac , Emma Brunskil

Off-policy evaluation (OPE) in ranking settings with large ranking action spaces, which stems from an increase in both the number of unique actions and length of the ranking, is essential for assessing new recommender policies using only…

Machine Learning · Statistics 2025-06-03 Tatsuki Takahashi , Chihiro Maru , Hiroko Shoji

Constrained partially observable Markov decision processes (CPOMDPs) have been used to model various real-world phenomena. However, they are notoriously difficult to solve to optimality, and there exist only a few approximation methods for…

Artificial Intelligence · Computer Science 2023-06-27 Robert K. Helmeczi , Can Kavaklioglu , Mucahit Cevik

Holdout validation and hyperparameter tuning from data is a long-standing problem in offline reinforcement learning (RL). A standard framework is to use off-policy evaluation (OPE) methods to evaluate and select the policies, but OPE either…

Machine Learning · Computer Science 2025-10-27 Pai Liu , Lingfeng Zhao , Shivangi Agarwal , Jinghan Liu , Audrey Huang , Philip Amortila , Nan Jiang

We consider the reinforcement learning problem for partially observed Markov decision processes (POMDPs) with large or even countably infinite state spaces, where the controller has access to only noisy observations of the underlying…

Machine Learning · Computer Science 2023-07-20 Semih Cayci , Niao He , R. Srikant

We study the $(\varepsilon, \delta)$-PAC policy identification problem in finite-horizon episodic Markov Decision Processes. Existing approaches provide finite-time guarantees for approximate settings ($\varepsilon>0$) but suffer from high…

Machine Learning · Computer Science 2026-05-06 Cyrille Kone , Kevin Jamieson

Off-policy evaluation (OPE) aims to accurately evaluate the performance of counterfactual policies using only offline logged data. Although many estimators have been developed, there is no single estimator that dominates the others, because…

Machine Learning · Computer Science 2023-01-31 Takuma Udagawa , Haruka Kiyohara , Yusuke Narita , Yuta Saito , Kei Tateno

Evaluating off-policy decisions using batch data poses significant challenges due to limited sample sizes leading to high variance. To improve Off-Policy Evaluation (OPE), we must identify and address the sources of this variance. Recent…

Machine Learning · Statistics 2024-12-02 Ritam Majumdar , Jack Teversham , Sonali Parbhoo

Partially observable Markov decision processes (POMDPs) are standard models for dynamic systems with probabilistic and nondeterministic behaviour in uncertain environments. We prove that in POMDPs with long-run average objective, the…

Computer Science and Game Theory · Computer Science 2022-09-29 Krishnendu Chatterjee , Raimundo Saona , Bruno Ziliotto

This paper describes sufficient conditions for the existence of optimal policies for Partially Observable Markov Decision Processes (POMDPs) with Borel state, observation, and action sets and with the expected total costs. Action sets may…

Optimization and Control · Mathematics 2014-07-02 Eugene A. Feinberg , Pavlo O. Kasyanov , Michael Z. Zgurovsky

Off-policy Evaluation (OPE) methods are crucial tools for evaluating policies in high-stakes domains such as healthcare, where direct deployment is often infeasible, unethical, or expensive. When deployment environments are expected to…

Machine Learning · Computer Science 2022-09-20 Harvineet Singh , Shalmali Joshi , Finale Doshi-Velez , Himabindu Lakkaraju

We introduce an off-policy evaluation procedure for highlighting episodes where applying a reinforcement learned (RL) policy is likely to have produced a substantially different outcome than the observed policy. In particular, we introduce…

Machine Learning · Computer Science 2021-03-04 Michael Oberst , David Sontag

Off-policy evaluation (OPE) in reinforcement learning is notoriously difficult in long- and infinite-horizon settings due to diminishing overlap between behavior and target policies. In this paper, we study the role of Markovian and…

Machine Learning · Statistics 2023-01-18 Nathan Kallus , Masatoshi Uehara

Risk averse decision making under uncertainty in partially observable domains is a fundamental problem in AI and essential for reliable autonomous agents. In our case, the problem is modeled using partially observable Markov decision…

Artificial Intelligence · Computer Science 2024-06-11 Yaacov Pariente , Vadim Indelman

Partially Observable Markov Decision Processes (POMDPs) are a natural and general model in reinforcement learning that take into account the agent's uncertainty about its current state. In the literature on POMDPs, it is customary to assume…

Machine Learning · Computer Science 2022-03-24 Noah Golowich , Ankur Moitra , Dhruv Rohatgi
‹ Prev 1 3 4 5 6 7 10 Next ›