中文
相关论文

相关论文: Constrained Best Arm Identification with Tests for…

200 篇论文

This paper presents a comprehensive study on the problem of Best Arm Retention (BAR), which has recently found applications in streaming algorithms for multi-armed bandits. In the BAR problem, the goal is to retain $m$ arms with the best…

机器学习 · 计算机科学 2025-04-17 Houshuang Chen , Yuchen He , Chihao Zhang

Motivated by the task of hyperparameter optimization, we introduce the non-stochastic best-arm identification problem. Within the multi-armed bandit literature, the cumulative regret objective enjoys algorithms and analyses for both the…

机器学习 · 计算机科学 2015-03-02 Kevin Jamieson , Ameet Talwalkar

In this paper, we introduce the constrained best mixed arm identification (CBMAI) problem with a fixed budget. This is a pure exploration problem in a stochastic finite armed bandit model. Each arm is associated with a reward and multiple…

机器学习 · 计算机科学 2024-05-27 Dengwang Tang , Rahul Jain , Ashutosh Nayyar , Pierluigi Nuzzo

The best arm identification problem requires identifying the best alternative (i.e., arm) in active experimentation using the smallest number of experiments (i.e., arm pulls), which is crucial for cost-efficient and timely decision-making…

机器学习 · 计算机科学 2025-06-17 Kapilan Balagopalan , Tuan Ngo Nguyen , Yao Zhao , Kwang-Sung Jun

We study the problem of Robust Outlier Arm Identification (ROAI), where the goal is to identify arms whose expected rewards deviate substantially from the majority, by adaptively sampling from their reward distributions. We compute the…

机器学习 · 统计学 2020-09-22 Yinglun Zhu , Sumeet Katariya , Robert Nowak

This paper studies the problem of identifying any $k$ distinct arms among the top $\rho$ fraction (e.g., top 5\%) of arms from a finite or infinite set with a probably approximately correct (PAC) tolerance $\epsilon$. We consider two cases:…

机器学习 · 计算机科学 2020-11-20 Wenbo Ren , Jia Liu , Ness Shroff

We consider the problem of identifying any $k$ out of the best $m$ arms in an $n$-armed stochastic multi-armed bandit. Framed in the PAC setting, this particular problem generalises both the problem of `best subset selection' and that of…

机器学习 · 计算机科学 2019-01-25 Arghya Roy Chaudhuri , Shivaram Kalyanakrishnan

We design and analyze VA-LUCB, a parameter-free algorithm, for identifying the best arm under the fixed-confidence setup and under a stringent constraint that the variance of the chosen arm is strictly smaller than a given threshold. An…

机器学习 · 计算机科学 2022-11-16 Yunlong Hou , Vincent Y. F. Tan , Zixin Zhong

We investigate the problem of batched best arm identification in multi-armed bandits, where we aim to identify the best arm from a set of $n$ arms while minimizing both the number of samples and batches. We introduce an algorithm that…

机器学习 · 计算机科学 2025-01-30 Tianyuan Jin , Qin Zhang , Dongruo Zhou

Good arm identification (GAI) is a pure-exploration bandit problem in which a single learner outputs an arm as soon as it is identified as a good arm. A good arm is defined as an arm with an expected reward greater than or equal to a given…

机器学习 · 计算机科学 2024-03-13 Tzu-Hsien Tsai , Yun-Da Tsai , Shou-De Lin

Stochastic Rising Bandits (SRBs) model sequential decision-making problems in which the expected reward of the available options increases every time they are selected. This setting captures a wide range of scenarios in which the available…

We consider a variant of the best arm identification task in stochastic multi-armed bandits. Motivated by risk-averse decision-making problems, our goal is to identify a set of $m$ arms with the highest $\tau$-quantile values within a fixed…

机器学习 · 计算机科学 2023-02-22 Mengyan Zhang , Cheng Soon Ong

We study the problem of best arm identification in linear bandits in the fixed-budget setting. By leveraging properties of the G-optimal design and incorporating it into the arm allocation rule, we design a parameter-free algorithm, Optimal…

机器学习 · 计算机科学 2022-09-22 Junwen Yang , Vincent Y. F. Tan

We give a complete characterization of the complexity of best-arm identification in one-parameter bandit problems. We prove a new, tight lower bound on the sample complexity. We propose the `Track-and-Stop' strategy, which we prove to be…

统计理论 · 数学 2016-06-02 Aurélien Garivier , Emilie Kaufmann

We address the problem of identifying the optimal policy with a fixed confidence level in a multi-armed bandit setup, when \emph{the arms are subject to linear constraints}. Unlike the standard best-arm identification problem which is well…

机器学习 · 计算机科学 2024-01-26 Emil Carlsson , Debabrota Basu , Fredrik D. Johansson , Devdatt Dubhashi

We consider the question introduced by \cite{Mason2020} of identifying all the $\varepsilon$-optimal arms in a finite stochastic multi-armed bandit with Gaussian rewards. We give two lower bounds on the sample complexity of any algorithm…

机器学习 · 统计学 2022-04-07 Aymen Al Marjani , Tomáš Kocák , Aurélien Garivier

We consider the classic problem of $(\epsilon,\delta)$-PAC learning a best arm where the goal is to identify with confidence $1-\delta$ an arm whose mean is an $\epsilon$-approximation to that of the highest mean arm in a multi-armed bandit…

机器学习 · 计算机科学 2020-06-23 Avinatan Hassidim , Ron Kupfer , Yaron Singer

The knowledge gradient (KG) algorithm is a popular and effective algorithm for the best arm identification (BAI) problem. Due to the complex calculation of KG, theoretical analysis of this algorithm is difficult, and existing results are…

机器学习 · 统计学 2022-11-23 Yanwen Li , Siyang Gao

This paper studies active learning in the context of robust statistics. Specifically, we propose a variant of the Best Arm Identification problem for \emph{contaminated bandits}, where each arm pull has probability $\varepsilon$ of…

统计理论 · 数学 2021-11-16 Jason Altschuler , Victor-Emmanuel Brunel , Alan Malek

We study best arm identification in a restless multi-armed bandit setting with finitely many arms. The discrete-time data generated by each arm forms a homogeneous Markov chain taking values in a common, finite state space. The state…

机器学习 · 统计学 2024-06-25 P. N. Karthik , Vincent Y. F. Tan , Arpan Mukherjee , Ali Tajer