English
Related papers

Related papers: On Well-posedness and Minimax Optimal Rates of Non…

200 papers

Matching users based on mutual preferences is a fundamental aspect of services driven by reciprocal recommendations, such as job search and dating applications. Although A/B tests remain the gold standard for evaluating new policies in…

Machine Learning · Computer Science 2025-07-21 Yudai Hayashi , Shuhei Goda , Yuta Saito

Off-policy policy evaluation (OPE) estimates the outcome of a new policy using historical data collected from a different policy. However, existing OPE methods cannot handle cases when the new policy introduces novel actions. This issue…

Artificial Intelligence · Computer Science 2025-02-04 Hyunji Nam , Allen Nie , Ge Gao , Vasilis Syrgkanis , Emma Brunskill

Developing accurate off-policy estimators is crucial for both evaluating and optimizing for new policies. The main challenge in off-policy estimation is the distribution shift between the logging policy that generates data and the target…

Machine Learning · Computer Science 2023-10-25 Noveen Sachdeva , Lequn Wang , Dawen Liang , Nathan Kallus , Julian McAuley

Developing theoretical guarantees on the sample complexity of offline RL methods is an important step towards making data-hungry RL algorithms practically viable. Currently, most results hinge on unrealistic assumptions about the data…

Machine Learning · Computer Science 2024-05-02 Sunil Madhow , Dan Qiao , Ming Yin , Yu-Xiang Wang

Multi-objective optimization is a type of decision making problems where multiple conflicting objectives are optimized. We study offline optimization of multi-objective policies from data collected by an existing policy. We propose a…

Machine Learning · Computer Science 2023-10-31 Shima Alizadeh , Aniruddha Bhargava , Karthick Gopalswamy , Lalit Jain , Branislav Kveton , Ge Liu

Bootstrapping provides a flexible and effective approach for assessing the quality of batch reinforcement learning, yet its theoretical property is less understood. In this paper, we study the use of bootstrapping in off-policy evaluation…

Machine Learning · Statistics 2022-05-24 Botao Hao , Xiang Ji , Yaqi Duan , Hao Lu , Csaba Szepesvári , Mengdi Wang

Several causal parameters in short panel data models are functionals of a nested nonparametric instrumental variable regression (nested NPIV). Recent examples include mediated, time varying, and long term treatment effects identified using…

Machine Learning · Statistics 2025-06-02 Isaac Meza , Rahul Singh

Off-policy evaluation (OPE) is important for closing the gap between offline training and evaluation of reinforcement learning (RL), by estimating performance and/or rank of target (evaluation) policies using offline trajectories only. It…

Machine Learning · Computer Science 2023-10-17 Qitong Gao , Ge Gao , Juncheng Dong , Vahid Tarokh , Min Chi , Miroslav Pajic

We develop methods for nonparametric uniform inference in cost-sensitive binary classification, a framework that encompasses maximum score estimation, predicting utility maximizing actions, and policy learning. These problems are well known…

Econometrics · Economics 2025-12-16 Nan Liu , Yanbo Liu , Yuya Sasaki , Yuanyuan Wan

Off-policy evaluation (OPE) is crucial for assessing a target policy's impact offline before its deployment. However, achieving accurate OPE in large state spaces remains challenging. This paper studies state abstractions -- originally…

Machine Learning · Statistics 2025-03-05 Meiling Hao , Pingfan Su , Liyuan Hu , Zoltan Szabo , Qingyuan Zhao , Chengchun Shi

Off-policy evaluation in reinforcement learning offers the chance of using observational data to improve future outcomes in domains such as healthcare and education, but safe deployment in high stakes settings requires ways of assessing its…

Machine Learning · Computer Science 2020-08-12 Omer Gottesman , Joseph Futoma , Yao Liu , Sonali Parbhoo , Leo Anthony Celi , Emma Brunskill , Finale Doshi-Velez

We study the problem of nonparametric estimation of the fractional derivative of unknown distribution function and of spectral function and show that these problems are well posed when the order of derivative is less than 0.5. We prove also…

Statistics Theory · Mathematics 2014-12-23 E. Ostrovsky , L. Sirota

We study the problem of off-policy evaluation (OPE) in reinforcement learning (RL), where the goal is to estimate the performance of a policy from the data generated by another policy(ies). In particular, we focus on the doubly robust (DR)…

Artificial Intelligence · Computer Science 2018-05-25 Mehrdad Farajtabar , Yinlam Chow , Mohammad Ghavamzadeh

Off-policy evaluation (OPE) and off-policy learning (OPL) are foundational for decision-making in offline contextual bandits. Recent advances in OPL primarily optimize OPE estimators with improved statistical properties, assuming that…

Machine Learning · Statistics 2025-09-04 Imad Aouali , Otmane Sakhi

Off-policy evaluation (OPE) is widely applied in sectors such as pharmaceuticals and e-commerce to evaluate the efficacy of novel products or policies from offline datasets. This paper introduces a causal deepset framework that relaxes…

Machine Learning · Statistics 2024-07-26 Runpeng Dai , Jianing Wang , Fan Zhou , Shikai Luo , Zhiwei Qin , Chengchun Shi , Hongtu Zhu

Reinforcement learning has traditionally been studied with exponential discounting or the average reward setup, mainly due to their mathematical tractability. However, such frameworks fall short of accurately capturing human behavior, which…

Machine Learning · Computer Science 2024-09-18 S. R. Eshwar , Mayank Motwani , Nibedita Roy , Gugan Thoppe

In this paper, we propose a novel $K$-nearest neighbor resampling procedure for estimating the performance of a policy from historical data containing realized episodes of a decision process generated under a different policy. We provide…

Machine Learning · Statistics 2024-01-11 Michael Giegrich , Roel Oomen , Christoph Reisinger

Optimizing survival outcomes, such as patient survival or customer retention, is a critical objective in data-driven decision-making. Off-Policy Evaluation~(OPE) provides a powerful framework for assessing such decision-making policies…

Methodology · Statistics 2026-03-25 Kohsuke Kubota , Mitsuhiro Takahashi , Yuta Saito

We study the policy testing problem in discounted Markov decision processes (MDPs) in the fixed-confidence setting under a generative model with static sampling. The goal is to decide whether the value of a given policy exceeds a specified…

Machine Learning · Statistics 2026-04-21 Kaito Ariu , Po-An Wang , Alexandre Proutiere , Kenshi Abe

We study the regret of reinforcement learning from offline data generated by a fixed behavior policy in an infinite-horizon discounted Markov decision process (MDP). While existing analyses of common approaches, such as fitted $Q$-iteration…

Machine Learning · Computer Science 2023-07-13 Yichun Hu , Nathan Kallus , Masatoshi Uehara