中文
相关论文

相关论文: SPRT-based Efficient Best Arm Identification in St…

200 篇论文

We study the problem of identifying the best arm in a stochastic multi-armed bandit game. Given a set of $n$ arms indexed from $1$ to $n$, each arm $i$ is associated with an unknown reward distribution supported on $[0,1]$ with mean…

机器学习 · 计算机科学 2023-05-30 Pinyan Lu , Chao Tao , Xiaojin Zhang

We study the problem of collaborative best-arm identification in stochastic linear bandits under a fixed-budget scenario. In our learning model, we first consider multiple agents connected through a star network, interacting with a linear…

机器学习 · 计算机科学 2025-05-27 Sanjana Agrawal , Saúl A. Blanco

Motivated by drug design, we consider the best-arm identification problem in generalized linear bandits. More specifically, we assume each arm has a vector of covariates, there is an unknown vector of parameters that is common across the…

机器学习 · 计算机科学 2019-05-21 Abbas Kazerouni , Lawrence M. Wein

In this work, we present a novel framework for Best Arm Identification (BAI) under fairness constraints, a setting that we refer to as \textit{F-BAI} (fair BAI). Unlike traditional BAI, which solely focuses on identifying the optimal arm…

机器学习 · 计算机科学 2024-09-02 Alessio Russo , Filippo Vannella

We focus on the problem of best-arm identification in a stochastic multi-arm bandit with temporally decreasing variances for the arms' rewards. We model arm rewards as Gaussian random variables with fixed means and variances that decrease…

机器学习 · 计算机科学 2025-02-12 Tamojeet Roychowdhury , Kota Srinivas Reddy , Krishna P Jagannathan , Sharayu Moharir

We propose a new strategy for best-arm identification with fixed confidence of Gaussian variables with bounded means and unit variance. This strategy, called Exploration-Biased Sampling, is not only asymptotically optimal: it is to the best…

统计理论 · 数学 2022-03-08 Antoine Barrier , Aurélien Garivier , Tomáš Kocák

We propose a generalization of the best arm identification problem in stochastic multi-armed bandits (MAB) to the setting where every pull of an arm is associated with delayed feedback. The delay in feedback increases the effective sample…

In this paper, we address the problem of identifying the Pareto Set under feasibility constraints in a multivariate bandit setting. Specifically, given a $K$-armed bandit with unknown means $\mu_1, \dots, \mu_K \in \mathbb{R}^d$, the goal…

机器学习 · 统计学 2025-06-11 Cyrille Kone , Emilie Kaufmann , Laura Richert

The combinatorial stochastic semi-bandit problem is an extension of the classical multi-armed bandit problem in which an algorithm pulls more than one arm at each stage and the rewards of all pulled arms are revealed. One difference with…

机器学习 · 计算机科学 2016-12-07 Rémy Degenne , Vianney Perchet

Approximate Bayesian computation is an established and popular method for likelihood-free inference with applications in many disciplines. The effectiveness of the method depends critically on the availability of well performing summary…

机器学习 · 统计学 2018-05-23 Prashant Singh , Andreas Hellander

The best arm identification problem in the multi-armed bandit setting is an excellent model of many real-world decision-making problems, yet it fails to capture the fact that in the real-world, safety constraints often must be met while…

机器学习 · 计算机科学 2021-11-25 Zhenlin Wang , Andrew Wagenmaker , Kevin Jamieson

In this paper, we introduce the constrained best mixed arm identification (CBMAI) problem with a fixed budget. This is a pure exploration problem in a stochastic finite armed bandit model. Each arm is associated with a reward and multiple…

机器学习 · 计算机科学 2024-05-27 Dengwang Tang , Rahul Jain , Ashutosh Nayyar , Pierluigi Nuzzo

We study best-arm identification in stochastic multi-armed bandits under the fixed-confidence setting, focusing on instances with multiple optimal arms. Unlike prior work that addresses the unknown-number-of-optimal-arms case, we consider…

机器学习 · 计算机科学 2026-03-05 Lan V. Truong

We consider the combinatorial bandits problem with semi-bandit feedback under finite sampling budget constraints, in which the learner can carry out its action only for a limited number of times specified by an overall budget. The action is…

机器学习 · 计算机科学 2022-10-17 Jasmin Brandt , Viktor Bengs , Björn Haddenhorst , Eyke Hüllermeier

In the Best-$k$-Arm problem, we are given $n$ stochastic bandit arms, each associated with an unknown reward distribution. We are required to identify the $k$ arms with the largest means by taking as few samples as possible. In this paper,…

机器学习 · 计算机科学 2017-02-15 Lijie Chen , Jian Li , Mingda Qiao

We study the Stochastic Multi-armed Bandit problem under bounded arm-memory. In this setting, the arms arrive in a stream, and the number of arms that can be stored in the memory at any time, is bounded. The decision-maker can only pull…

机器学习 · 计算机科学 2020-12-10 Arnab Maiti , Vishakha Patil , Arindam Khan

We study the best arm identification (BEST-1-ARM) problem, which is defined as follows. We are given $n$ stochastic bandit arms. The $i$th arm has a reward distribution $D_i$ with an unknown mean $\mu_{i}$. Upon each play of the $i$th arm,…

机器学习 · 计算机科学 2016-08-24 Lijie Chen , Jian Li

We investigate the sample complexity of learning the optimal arm for multi-task bandit problems. Arms consist of two components: one that is shared across tasks (that we call representation) and one that is task-specific (that we call…

机器学习 · 统计学 2022-11-29 Alessio Russo , Alexandre Proutiere

We study fixed budget constrained best-arm identification in grouped bandits, where each arm consists of multiple independent attributes with stochastic rewards. An arm is considered feasible only if all its attributes' means are above a…

机器学习 · 计算机科学 2026-03-05 Raunak Mukherjee , Sharayu Moharir

We consider the problem of near-optimal arm identification in the fixed confidence setting of the infinitely armed bandit problem when nothing is known about the arm reservoir distribution. We (1) introduce a PAC-like framework within which…

机器学习 · 统计学 2018-05-22 Maryam Aziz , Jesse Anderton , Emilie Kaufmann , Javed Aslam