English
Related papers

Related papers: Adaptive Off-Policy Inference for M-Estimators Und…

200 papers

Off-policy evaluation is critical in a number of applications where new policies need to be evaluated offline before online deployment. Most existing methods focus on the expected return, define the target parameter through averaging and…

Machine Learning · Statistics 2023-02-10 Yingying Zhang , Chengchun Shi , Shikai Luo

Conformal prediction is a valuable tool for quantifying predictive uncertainty of machine learning models. However, its applicability relies on the assumption of data exchangeability, a condition which is often not met in real-world…

Machine Learning · Statistics 2024-12-30 Aleksandr Podkopaev , Darren Xu , Kuang-Chih Lee

We consider off-policy policy evaluation when the trajectory data are generated by multiple behavior policies. Recent work has shown the key role played by the state or state-action stationary distribution corrections in the infinite…

Machine Learning · Computer Science 2019-10-14 Xinyun Chen , Lu Wang , Yizhe Hang , Heng Ge , Hongyuan Zha

Developing accurate off-policy estimators is crucial for both evaluating and optimizing for new policies. The main challenge in off-policy estimation is the distribution shift between the logging policy that generates data and the target…

Machine Learning · Computer Science 2023-10-25 Noveen Sachdeva , Lequn Wang , Dawen Liang , Nathan Kallus , Julian McAuley

In statistical inference, it is rarely realistic that the hypothesized statistical model is well-specified, and consequently it is important to understand the effects of misspecification on inferential procedures. When the hypothesized…

Methodology · Statistics 2025-09-01 Beomjo Park , Sivaraman Balakrishnan , Larry Wasserman

Off-policy evaluation (OPE) is the problem of estimating the value of a target policy from samples obtained via different policies. Recently, applying OPE methods for bandit problems has garnered attention. For the theoretical guarantees of…

Machine Learning · Computer Science 2020-10-26 Masahiro Kato , Kenshi Abe , Kaito Ariu , Shota Yasui

Data that is gathered adaptively --- via bandit algorithms, for example --- exhibits bias. This is true both when gathering simple numeric valued data --- the empirical means kept track of by stochastic bandit algorithms are biased…

Machine Learning · Computer Science 2018-06-07 Seth Neel , Aaron Roth

We study the problem of online learning in adversarial bandit problems under a partial observability model called off-policy feedback. In this sequential decision making problem, the learner cannot directly observe its rewards, but instead…

Machine Learning · Computer Science 2022-07-20 Germano Gabbianelli , Matteo Papini , Gergely Neu

From a model-building perspective, we propose a paradigm shift for fitting over-parameterized models. Philosophically, the mindset is to fit models to future observations rather than to the observed sample. Technically, given an imputation…

Methodology · Statistics 2024-12-09 Yiran Jiang , Chuanhai Liu

We study the problem of off-policy evaluation for slate bandits, for the typical case in which the logging policy factorizes over the slots of the slate. We slightly depart from the existing literature by taking Bayes risk as the criterion…

Machine Learning · Computer Science 2021-01-08 Nikos Vlassis , Fernando Amat Gil , Ashok Chandrashekar

We study high-confidence off-policy evaluation in the context of infinite-horizon Markov decision processes, where the objective is to establish a confidence interval (CI) for the target policy value using only offline data pre-collected…

Machine Learning · Statistics 2023-10-03 Wenzhuo Zhou , Yuhan Li , Ruoqing Zhu , Annie Qu

Misspecified models often provide useful information about the true data generating distribution. For example, if $y$ is a non-linear function of $x$ the least squares estimator $\hat{\beta}$ is an estimate of $\beta$, the slope of the best…

Methodology · Statistics 2017-05-17 James P. Long

Adaptive experiments, including efficient average treatment effect estimation and multi-armed bandit algorithms, have garnered attention in various applications, such as social experiments, clinical trials, and online advertisement…

Methodology · Statistics 2021-03-24 Masahiro Kato

In this paper, we consider a best action identification problem in the stochastic linear bandit setup with a fixed confident constraint. In the considered best action identification problem, instead of minimizing the accumulative regret as…

Machine Learning · Computer Science 2018-12-04 Jun Geng , Lifeng Lai

Model selection in contextual bandits is an important complementary problem to regret minimization with respect to a fixed model class. We consider the simplest non-trivial instance of model-selection: distinguishing a simple multi-armed…

Machine Learning · Computer Science 2022-07-01 Vidya Muthukumar , Akshay Krishnamurthy

Methods for sequential decision-making are often built upon a foundational assumption that the underlying decision process is stationary. This limits the application of such methods because real-world problems are often subject to changes…

Machine Learning · Computer Science 2023-01-26 Yash Chandak , Shiv Shankar , Nathaniel D. Bastian , Bruno Castro da Silva , Emma Brunskil , Philip S. Thomas

Developing theoretical guarantees on the sample complexity of offline RL methods is an important step towards making data-hungry RL algorithms practically viable. Currently, most results hinge on unrealistic assumptions about the data…

Machine Learning · Computer Science 2024-05-02 Sunil Madhow , Dan Qiao , Ming Yin , Yu-Xiang Wang

Offline policy optimization could have a large impact on many real-world decision-making problems, as online learning may be infeasible in many applications. Importance sampling and its variants are a commonly used type of estimator in…

Machine Learning · Computer Science 2022-07-05 Yao Liu , Yannis Flet-Berliac , Emma Brunskill

We propose a robust regression approach to off-policy evaluation (OPE) for contextual bandits. We frame OPE as a covariate-shift problem and leverage modern robust regression tools. Ours is a general approach that can be used to augment any…

Machine Learning · Computer Science 2019-11-19 Anqi Liu , Hao Liu , Anima Anandkumar , Yisong Yue

Many standard estimators, when applied to adaptively collected data, fail to be asymptotically normal, thereby complicating the construction of confidence intervals. We address this challenge in a semi-parametric context: estimating the…

Statistics Theory · Mathematics 2025-03-04 Licong Lin , Koulik Khamaru , Martin J. Wainwright