English
Related papers

Related papers: Robust Best-arm Identification in Linear Bandits

200 papers

We study the problem of best-arm identification with fixed confidence in stochastic linear bandits. The objective is to identify the best arm with a given level of certainty while minimizing the sampling budget. We devise a simple algorithm…

Machine Learning · Statistics 2020-06-30 Yassir Jedra , Alexandre Proutiere

We study the best-arm identification problem in linear bandit, where the rewards of the arms depend linearly on an unknown parameter $\theta^*$ and the objective is to return the arm with the largest reward. We characterize the complexity…

Machine Learning · Computer Science 2014-11-05 Marta Soare , Alessandro Lazaric , Rémi Munos

We investigate the fixed-budget best-arm identification (BAI) problem for linear bandits in a potentially non-stationary environment. Given a finite arm set $\mathcal{X}\subset\mathbb{R}^d$, a fixed budget $T$, and an unpredictable sequence…

Machine Learning · Computer Science 2024-02-16 Zhihan Xiong , Romain Camilleri , Maryam Fazel , Lalit Jain , Kevin Jamieson

We consider the problem of best arm identification in a variant of multi-armed bandits called linked bandits. In a single interaction with linked bandits, multiple arms are played sequentially until one of them receives a positive reward.…

Machine Learning · Computer Science 2019-01-29 Anant Gupta

In bandit best-arm identification, an algorithm is tasked with finding the arm with highest mean reward with a specified accuracy as fast as possible. We study multi-fidelity best-arm identification, in which the algorithm can choose to…

Machine Learning · Computer Science 2025-05-27 Riccardo Poiani , Rémy Degenne , Emilie Kaufmann , Alberto Maria Metelli , Marcello Restelli

We study best-arm identification with fixed confidence in bandit models with graph smoothness constraint. We provide and analyze an efficient gradient ascent algorithm to compute the sample complexity of this problem as a solution of a…

Machine Learning · Computer Science 2020-05-21 Tomáš Kocák , Aurélien Garivier

Best-arm identification (BAI) in a fixed-budget setting is a bandit problem where the learning agent maximizes the probability of identifying the optimal (best) arm after a fixed number of observations. Most works on this topic study…

Machine Learning · Computer Science 2023-07-06 Mohammad Javad Azizi , Branislav Kveton , Mohammad Ghavamzadeh

We study the fixed-budget best-arm identification (BAI) problem in non-stationary linear bandits. Concretely, given a fixed time budget $T\in \mathbb{N}$, finite arm set $\mathcal{X} \subset \mathbb{R}^d$, and a potentially adversarial…

Machine Learning · Statistics 2026-03-12 Leo Maynard-Zhang , Zhihan Xiong , Kevin Jamieson , Maryam Fazel

We consider a novel stochastic multi-armed bandit problem called {\em good arm identification} (GAI), where a good arm is defined as an arm with expected reward greater than or equal to a given threshold. GAI is a pure-exploration problem…

We give a new algorithm for best arm identification in linearly parameterised bandits in the fixed confidence setting. The algorithm generalises the well-known LUCB algorithm of Kalyanakrishnan et al. (2012) by playing an arm which…

Machine Learning · Computer Science 2019-11-11 Mohammadi Zaki , Avinash Mohan , Aditya Gopalan

This paper investigates a hitherto unaddressed aspect of best arm identification (BAI) in stochastic multi-armed bandits in the fixed-confidence setting. Two key metrics for assessing bandit algorithms are computational efficiency and…

Machine Learning · Statistics 2023-06-26 Arpan Mukherjee , Ali Tajer

We study the fixed-confidence best arm identification (BAI) problem within the multi-armed bandit (MAB) framework under the Entropic Value-at-Risk (EVaR) criterion. Our analysis considers a nonparametric setting, allowing for general reward…

Machine Learning · Computer Science 2025-10-07 Mehrasa Ahmadipour , Aurélien Garivier

We study the best-arm identification problem in multi-armed bandits with stochastic, potentially private rewards, when the goal is to identify the arm with the highest quantile at a fixed, prescribed level. First, we propose a (non-private)…

Machine Learning · Statistics 2022-12-06 Kontantinos E. Nikolakakis , Dionysios S. Kalogerias , Or Sheffet , Anand D. Sarwate

Traditional multi-armed bandit (MAB) formulations usually make certain assumptions about the underlying arms' distributions, such as bounds on the support or their tail behaviour. Moreover, such parametric information is usually 'baked'…

Machine Learning · Computer Science 2022-03-29 Anmol Kagrecha , Jayakrishnan Nair , Krishna Jagannathan

Best arm identification (BAI) aims to identify the highest-performance arm among a set of $K$ arms by collecting stochastic samples from each arm. In real-world problems, the best arm needs to satisfy additional feasibility constraints.…

Machine Learning · Computer Science 2026-01-26 Ting Cai , Kirthevasan Kandasamy

The best arm identification problem in the multi-armed bandit setting is an excellent model of many real-world decision-making problems, yet it fails to capture the fact that in the real-world, safety constraints often must be met while…

Machine Learning · Computer Science 2021-11-25 Zhenlin Wang , Andrew Wagenmaker , Kevin Jamieson

Stochastic Rising Bandits (SRBs) model sequential decision-making problems in which the expected reward of the available options increases every time they are selected. This setting captures a wide range of scenarios in which the available…

Machine Learning · Computer Science 2024-05-29 Marco Mussi , Alessandro Montenegro , Francesco Trovó , Marcello Restelli , Alberto Maria Metelli

We study fixed-confidence Best Arm Identification (BAI) in semiparametric bandits, where rewards are linear in arm features plus an unknown additive baseline shift. Unlike linear-bandit BAI, this setting requires orthogonalized regression,…

Machine Learning · Statistics 2026-04-07 Seok-Jin Kim

We consider a variant of the best arm identification (BAI) problem in multi-armed bandits (MAB) in which there are two sets of arms (source and target), and the objective is to determine the best target arm while only pulling source arms.…

Machine Learning · Computer Science 2021-12-09 Ojash Neopane , Aaditya Ramdas , Aarti Singh

We study bandit best-arm identification with arbitrary and potentially adversarial rewards. A simple random uniform learner obtains the optimal rate of error in the adversarial scenario. However, this type of strategy is suboptimal when the…

Machine Learning · Statistics 2026-04-17 Yasin Abbasi-Yadkori , Peter L. Bartlett , Victor Gabillon , Alan Malek , Michal Valko
‹ Prev 1 2 3 10 Next ›