中文
相关论文

相关论文: Fixed-Budget Constrained Best Arm Identification i…

200 篇论文

We give a new algorithm for best arm identification in linearly parameterised bandits in the fixed confidence setting. The algorithm generalises the well-known LUCB algorithm of Kalyanakrishnan et al. (2012) by playing an arm which…

机器学习 · 计算机科学 2019-11-11 Mohammadi Zaki , Avinash Mohan , Aditya Gopalan

We investigate the fixed-budget best-arm identification (BAI) problem for linear bandits in a potentially non-stationary environment. Given a finite arm set $\mathcal{X}\subset\mathbb{R}^d$, a fixed budget $T$, and an unpredictable sequence…

机器学习 · 计算机科学 2024-02-16 Zhihan Xiong , Romain Camilleri , Maryam Fazel , Lalit Jain , Kevin Jamieson

We propose EB-TC$\varepsilon$, a novel sampling rule for $\varepsilon$-best arm identification in stochastic bandits. It is the first instance of Top Two algorithm analyzed for approximate best arm identification. EB-TC$\varepsilon$ is an…

机器学习 · 统计学 2023-11-07 Marc Jourdan , Rémy Degenne , Emilie Kaufmann

This paper investigates the problem of best arm identification in $\textit{contaminated}$ stochastic multi-arm bandits. In this setting, the rewards obtained from any arm are replaced by samples from an adversarial model with probability…

机器学习 · 计算机科学 2021-11-16 Arpan Mukherjee , Ali Tajer , Pin-Yu Chen , Payel Das

This paper investigates the best arm identification (BAI) problem in stochastic multi-armed bandits in the fixed confidence setting. The general class of the exponential family of bandits is considered. The existing algorithms for the…

机器学习 · 统计学 2023-06-26 Arpan Mukherjee , Ali Tajer

We study the fixed-confidence best arm identification (BAI) problem within the multi-armed bandit (MAB) framework under the Entropic Value-at-Risk (EVaR) criterion. Our analysis considers a nonparametric setting, allowing for general reward…

机器学习 · 计算机科学 2025-10-07 Mehrasa Ahmadipour , Aurélien Garivier

We study the best-arm identification problem in linear bandit, where the rewards of the arms depend linearly on an unknown parameter $\theta^*$ and the objective is to return the arm with the largest reward. We characterize the complexity…

机器学习 · 计算机科学 2014-11-05 Marta Soare , Alessandro Lazaric , Rémi Munos

We study best arm identification in a restless multi-armed bandit setting with finitely many arms. The discrete-time data generated by each arm forms a homogeneous Markov chain taking values in a common, finite state space. The state…

机器学习 · 统计学 2024-06-25 P. N. Karthik , Vincent Y. F. Tan , Arpan Mukherjee , Ali Tajer

We consider the problem of best arm identification in a variant of multi-armed bandits called linked bandits. In a single interaction with linked bandits, multiple arms are played sequentially until one of them receives a positive reward.…

机器学习 · 计算机科学 2019-01-29 Anant Gupta

We focus on the problem of best-arm identification in a stochastic multi-arm bandit with temporally decreasing variances for the arms' rewards. We model arm rewards as Gaussian random variables with fixed means and variances that decrease…

机器学习 · 计算机科学 2025-02-12 Tamojeet Roychowdhury , Kota Srinivas Reddy , Krishna P Jagannathan , Sharayu Moharir

We consider the best arm identification problem, where the goal is to identify the arm with the highest mean reward from a set of $K$ arms under a limited sampling budget. This problem models many practical scenarios such as A/B testing. We…

机器学习 · 统计学 2026-05-05 Junpei Komiyama , Kyoungseok Jang , Junya Honda

The best arm identification problem in the multi-armed bandit setting is an excellent model of many real-world decision-making problems, yet it fails to capture the fact that in the real-world, safety constraints often must be met while…

机器学习 · 计算机科学 2021-11-25 Zhenlin Wang , Andrew Wagenmaker , Kevin Jamieson

Motivated by drug design, we consider the best-arm identification problem in generalized linear bandits. More specifically, we assume each arm has a vector of covariates, there is an unknown vector of parameters that is common across the…

机器学习 · 计算机科学 2019-05-21 Abbas Kazerouni , Lawrence M. Wein

We study best arm identification in a variant of the multi-armed bandit problem where the learner has limited precision in arm selection. The learner can only sample arms via certain exploration bundles, which we refer to as boxes. In…

机器学习 · 计算机科学 2023-05-11 Kota Srinivas Reddy , P. N. Karthik , Nikhil Karamchandani , Jayakrishnan Nair

We examine a multi-armed bandit problem with contextual information, where the objective is to ensure that each arm receives a minimum aggregated reward across contexts while simultaneously maximizing the total cumulative reward. This…

机器学习 · 计算机科学 2025-10-15 Ahmed Ben Yahmed , Hafedh El Ferchichi , Marc Abeille , Vianney Perchet

In this paper, we introduce a multi-armed bandit problem termed max-min grouped bandits, in which the arms are arranged in possibly-overlapping groups, and the goal is to find the group whose worst arm has the highest mean reward. This…

机器学习 · 统计学 2022-03-16 Zhenlin Wang , Jonathan Scarlett

We lay the foundations of a non-parametric theory of best-arm identification in multi-armed bandits with a fixed budget T. We consider general, possibly non-parametric, models D for distributions over the arms; an overarching example is the…

机器学习 · 计算机科学 2023-02-07 Antoine Barrier , Aurélien Garivier , Gilles Stoltz

In this paper we consider the problem of best-arm identification in multi-armed bandits in the fixed confidence setting, where the goal is to identify, with probability $1-\delta$ for some $\delta>0$, the arm with the highest mean reward in…

机器学习 · 统计学 2021-09-13 Samarth Gupta , Gauri Joshi , Osman Yağan

We consider the question introduced by \cite{Mason2020} of identifying all the $\varepsilon$-optimal arms in a finite stochastic multi-armed bandit with Gaussian rewards. We give two lower bounds on the sample complexity of any algorithm…

机器学习 · 统计学 2022-04-07 Aymen Al Marjani , Tomáš Kocák , Aurélien Garivier

We study the problem of Bayesian fixed-budget best-arm identification (BAI) in structured bandits. We propose an algorithm that uses fixed allocations based on the prior information and the structure of the environment. We provide…

机器学习 · 统计学 2025-04-28 Nicolas Nguyen , Imad Aouali , András György , Claire Vernade