English
Related papers

Related papers: Dealing With Misspecification In Fixed-Confidence …

200 papers

In the classical best arm identification (Best-$1$-Arm) problem, we are given $n$ stochastic bandit arms, each associated with a reward distribution with an unknown mean. We would like to identify the arm with the largest mean with…

Machine Learning · Computer Science 2017-05-25 Lijie Chen , Jian Li , Mingda Qiao

Model selection in contextual bandits is an important complementary problem to regret minimization with respect to a fixed model class. We consider the simplest non-trivial instance of model-selection: distinguishing a simple multi-armed…

Machine Learning · Computer Science 2022-07-01 Vidya Muthukumar , Akshay Krishnamurthy

Interpretable and explainable machine learning has seen a recent surge of interest. We focus on safety as a key motivation behind the surge and make the relationship between interpretability and safety more quantitative. Toward assessing…

Machine Learning · Computer Science 2022-11-04 Dennis Wei , Rahul Nair , Amit Dhurandhar , Kush R. Varshney , Elizabeth M. Daly , Moninder Singh

The Minimum Description Length (MDL) principle is solidly based on a provably ideal method of inference using Kolmogorov complexity. We test how the theory behaves in practice on a general problem in model selection: that of learning the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Qiong Gao , Ming Li , Paul Vitanyi

This paper studies active learning in the context of robust statistics. Specifically, we propose a variant of the Best Arm Identification problem for \emph{contaminated bandits}, where each arm pull has probability $\varepsilon$ of…

Statistics Theory · Mathematics 2021-11-16 Jason Altschuler , Victor-Emmanuel Brunel , Alan Malek

This study investigates the misclassification excess risk bound in the context of 1-bit matrix completion, a significant problem in machine learning involving the recovery of an unknown matrix from a limited subset of its entries. Matrix…

Machine Learning · Computer Science 2024-10-02 The Tien Mai

In the Best-$k$-Arm problem, we are given $n$ stochastic bandit arms, each associated with an unknown reward distribution. We are required to identify the $k$ arms with the largest means by taking as few samples as possible. In this paper,…

Machine Learning · Computer Science 2017-02-15 Lijie Chen , Jian Li , Mingda Qiao

Estimation under model misspecification arises in many signal processing problems, where the assumed observation model deviates from the true data-generating mechanism due to errors or simplifications. The misspecified Cram\'er-Rao bound…

Statistics Theory · Mathematics 2026-05-21 Malaak Khatib , Nadav Harel , Joseph Tabrikian , Tirza Routtenberg

The identification of a linear system model from data has wide applications in control theory. The existing work that provides finite sample guarantees for linear system identification typically uses data from a single long system…

Machine Learning · Statistics 2025-05-09 Lei Xin , Baike She , Qi Dou , George Chiu , Shreyas Sundaram

This paper investigates a hitherto unaddressed aspect of best arm identification (BAI) in stochastic multi-armed bandits in the fixed-confidence setting. Two key metrics for assessing bandit algorithms are computational efficiency and…

Machine Learning · Statistics 2023-06-26 Arpan Mukherjee , Ali Tajer

As an extension of the classical multi-armed bandit problem, multi-fidelity multi-armed bandits (MF-MAB) enable individual arms to be evaluated using diverse feedback sources that vary in both cost and accuracy. Prior stochastic models…

Machine Learning · Computer Science 2026-05-12 Muyun Lu , Haoyang Hong , Huazheng Wang , Ying Lin

In linear bandits, how can a learner effectively learn when facing corrupted rewards? While significant work has explored this question, a holistic understanding across different adversarial models and corruption measures is lacking, as is…

Machine Learning · Computer Science 2024-10-21 Haolin Liu , Artin Tajdini , Andrew Wagenmaker , Chen-Yu Wei

We introduce the safe best-arm identification framework with linear feedback, where the agent is subject to some stage-wise safety constraint that linearly depends on an unknown parameter vector. The agent must take actions in a…

Machine Learning · Statistics 2023-09-19 Xuedong Shang , Igor Colin , Merwan Barlier , Hamza Cherkaoui

We address the problem of finding the maximizer of a nonlinear smooth function, that can only be evaluated point-wise, subject to constraints on the number of permitted function evaluations. This problem is also known as fixed-budget best…

Machine Learning · Statistics 2013-11-12 Matthew W. Hoffman , Bobak Shahriari , Nando de Freitas

We design new algorithms for the combinatorial pure exploration problem in the multi-arm bandit framework. In this problem, we are given $K$ distributions and a collection of subsets $\mathcal{V} \subset 2^{[K]}$ of these distributions, and…

Machine Learning · Statistics 2019-05-29 Tongyi Cao , Akshay Krishnamurthy

We consider the problem of identifying the best arm in a multi-armed bandit model. Despite a wealth of literature in the traditional fixed budget and fixed confidence regimes of the best arm identification problem, it still remains a…

Machine Learning · Statistics 2025-12-08 Michael O. Harding , Kirthevasan Kandasamy

This paper investigates the identification of the top-m user-scheduling sets in multi-user MIMO downlink, which is cast as a combinatorial pure-exploration problem in stochastic linear bandits. Because the action space grows exponentially,…

Machine Learning · Computer Science 2025-10-07 Mohsen Amiri , V Venktesh , Sindri Magnússon

Best Arm Identification (BAI) problems are progressively used for data-sensitive applications, such as designing adaptive clinical trials, tuning hyper-parameters, and conducting user studies to name a few. Motivated by the data privacy…

Machine Learning · Statistics 2023-09-06 Achraf Azize , Marc Jourdan , Aymen Al Marjani , Debabrota Basu

We analyze the sample complexity of the thresholding bandit problem, with and without the assumption that the mean values of the arms are increasing. In each case, we provide a lower bound valid for any risk $\delta$ and any…

Statistics Theory · Mathematics 2018-07-25 Aurélien Garivier , Pierre Ménard , Laurent Rossi , Pierre Menard

We consider fixed-budget best-arm identification in two-armed Gaussian bandit problems. One of the longstanding open questions is the existence of an optimal strategy under which the probability of misidentification matches a lower bound.…

Machine Learning · Statistics 2023-01-02 Masahiro Kato , Kaito Ariu , Masaaki Imaizumi , Masahiro Nomura , Chao Qin