中文
相关论文

相关论文: On the complexity of All $\varepsilon$-Best Arms I…

200 篇论文

This study investigates minimax and Bayes optimal strategies for fixed-budget best-arm identification. We consider an adaptive procedure consisting of a sampling phase followed by a recommendation phase, and we design an adaptive experiment…

计量经济学 · 经济学 2026-02-05 Masahiro Kato

We consider a good arm identification problem in a stochastic bandit setting with multi-objectives, where each arm $i \in [K]$ is associated with a distribution $D_i$ defined over $R^M$. For each round $t$, the player pulls an arm $i_t$ and…

机器学习 · 计算机科学 2025-06-30 Xuanke Jiang , Sherief Hashima , Kohei Hatano , Eiji Takimoto

In this paper, we study a variant of best-arm identification involving elements of risk sensitivity and communication constraints. Specifically, the goal of the learner is to identify the arm with the highest quantile reward, while the…

机器学习 · 统计学 2025-02-11 Ivan Lau , Jonathan Scarlett

We consider a novel stochastic multi-armed bandit problem called {\em good arm identification} (GAI), where a good arm is defined as an arm with expected reward greater than or equal to a given threshold. GAI is a pure-exploration problem…

Combinatorial Multi-Armed Bandit with fairness constraints is a framework where multiple arms form a super arm and can be pulled in each round under uncertainty to maximize cumulative rewards while ensuring the minimum average reward…

机器学习 · 计算机科学 2025-01-14 Xiaoyi Wu , Bo Ji , Bin Li

This paper studies a multi-armed bandit (MAB) version of the range-searching problem. In its basic form, range searching considers as input a set of points (on the real line) and a collection of (real) intervals. Here, with each specified…

机器学习 · 计算机科学 2021-05-05 Siddharth Barman , Ramakrishnan Krishnamurthy , Saladi Rahul

Fixed-budget best-arm identification (BAI) is a bandit problem where the agent maximizes the probability of identifying the optimal arm within a fixed budget of observations. In this work, we study this problem in the Bayesian setting. We…

机器学习 · 计算机科学 2023-06-16 Alexia Atsidakou , Sumeet Katariya , Sujay Sanghavi , Branislav Kveton

In the infinite-armed bandit problem, each arm's average reward is sampled from an unknown distribution, and each arm can be sampled further to obtain noisy estimates of the average reward of that arm. Prior work focuses on identifying the…

机器学习 · 计算机科学 2022-11-04 Yifei Wang , Tavor Baharav , Yanjun Han , Jiantao Jiao , David Tse

We consider fixed-budget best-arm identification in two-armed Gaussian bandit problems. One of the longstanding open questions is the existence of an optimal strategy under which the probability of misidentification matches a lower bound.…

机器学习 · 统计学 2023-01-02 Masahiro Kato , Kaito Ariu , Masaaki Imaizumi , Masahiro Nomura , Chao Qin

We consider a constrained, pure exploration, stochastic multi-armed bandit formulation under a fixed budget. Each arm is associated with an unknown, possibly multi-dimensional distribution and is described by multiple attributes that are a…

机器学习 · 计算机科学 2022-11-29 Fathima Zarin Faizal , Jayakrishnan Nair

We study stochastic linear optimization problem with bandit feedback. The set of arms take values in an $N$-dimensional space and belong to a bounded polyhedron described by finitely many linear inequalities. We provide a lower bound for…

机器学习 · 计算机科学 2015-09-29 Manjesh K. Hanawal , Amir Leshem , Venkatesh Saligrama

In multi-objective decision-making with hierarchical preferences, lexicographic bandits provide a natural framework for optimizing multiple objectives in a prioritized order. In this setting, a learner repeatedly selects arms and observes…

机器学习 · 计算机科学 2025-11-11 Bo Xue , Yuanyu Wan , Zhichao Lu , Qingfu Zhang

We consider incentivized exploration: a version of multi-armed bandits where the choice of arms is controlled by self-interested agents, and the algorithm can only issue recommendations. The algorithm controls the flow of information, and…

计算机科学与博弈论 · 计算机科学 2022-06-14 Mark Sellke , Aleksandrs Slivkins

We study the batched best arm identification (BBAI) problem, where the learner's goal is to identify the best arm while switching the policy as less as possible. In particular, we aim to find the best arm with probability $1-\delta$ for…

机器学习 · 计算机科学 2025-03-05 Tianyuan Jin , Yu Yang , Jing Tang , Xiaokui Xiao , Pan Xu

We consider a variant of the best arm identification task in stochastic multi-armed bandits. Motivated by risk-averse decision-making problems, our goal is to identify a set of $m$ arms with the highest $\tau$-quantile values within a fixed…

机器学习 · 计算机科学 2023-02-22 Mengyan Zhang , Cheng Soon Ong

A Top Two sampling rule for bandit identification is a method which selects the next arm to sample from among two candidate arms, a leader and a challenger. Due to their simplicity and good empirical performance, they have received…

机器学习 · 统计学 2023-11-08 Marc Jourdan , Rémy Degenne

Consider the problem of finding a population or a probability distribution amongst many with the largest mean when these means are unknown but population samples can be simulated or otherwise generated. Typically, by selecting largest…

概率论 · 数学 2018-09-11 Peter Glynn , Sandeep Juneja

Top-$2$ methods have become popular in solving the best arm identification (BAI) problem. The best arm, or the arm with the largest mean amongst finitely many, is identified through an algorithm that at any sequential step independently…

机器学习 · 计算机科学 2024-12-17 Agniv Bandyopadhyay , Sandeep Juneja , Shubhada Agrawal

We address the problem of finding the maximizer of a nonlinear smooth function, that can only be evaluated point-wise, subject to constraints on the number of permitted function evaluations. This problem is also known as fixed-budget best…

机器学习 · 统计学 2013-11-12 Matthew W. Hoffman , Bobak Shahriari , Nando de Freitas

We study best arm identification (BAI) in linear bandits in the fixed-budget regime under differential privacy constraints, when the arm rewards are supported on the unit interval. Given a finite budget $T$ and a privacy parameter…

机器学习 · 计算机科学 2024-01-18 Zhirui Chen , P. N. Karthik , Yeow Meng Chee , Vincent Y. F. Tan