中文
相关论文

相关论文: Multi-Agent Best Arm Identification in Stochastic …

200 篇论文

In this paper we consider the problem of best-arm identification in multi-armed bandits in the fixed confidence setting, where the goal is to identify, with probability $1-\delta$ for some $\delta>0$, the arm with the highest mean reward in…

机器学习 · 统计学 2021-09-13 Samarth Gupta , Gauri Joshi , Osman Yağan

Motivated by drug design, we consider the best-arm identification problem in generalized linear bandits. More specifically, we assume each arm has a vector of covariates, there is an unknown vector of parameters that is common across the…

机器学习 · 计算机科学 2019-05-21 Abbas Kazerouni , Lawrence M. Wein

Multi-armed Bandit (MAB) algorithms identify the best arm among multiple arms via exploration-exploitation trade-off without prior knowledge of arm statistics. Their usefulness in wireless radio, IoT, and robotics demand deployment on edge…

系统与控制 · 电气工程与系统科学 2021-06-08 S. V. Sai Santosh , Sumit J. Darak

Real-time status updating applications increasingly rely on networks of devices and edge nodes to maintain data freshness, as quantified by the age of information (AoI) metric. Given that edge computing nodes exhibit uncertain and…

信息论 · 计算机科学 2026-03-17 Mengqiu Zhou , Vincent Y. F. Tan , Meng Zhang

This paper studies a multi-armed bandit (MAB) version of the range-searching problem. In its basic form, range searching considers as input a set of points (on the real line) and a collection of (real) intervals. Here, with each specified…

机器学习 · 计算机科学 2021-05-05 Siddharth Barman , Ramakrishnan Krishnamurthy , Saladi Rahul

We address the problem of identifying the optimal policy with a fixed confidence level in a multi-armed bandit setup, when \emph{the arms are subject to linear constraints}. Unlike the standard best-arm identification problem which is well…

机器学习 · 计算机科学 2024-01-26 Emil Carlsson , Debabrota Basu , Fredrik D. Johansson , Devdatt Dubhashi

Motivated by real-world applications that necessitate responsible experimentation, we introduce the problem of best arm identification (BAI) with minimal regret. This innovative variant of the multi-armed bandit problem elegantly…

机器学习 · 计算机科学 2024-09-30 Junwen Yang , Vincent Y. F. Tan , Tianyuan Jin

We consider a decentralized stochastic multi-armed bandit problem with multiple players. Each player aims to maximize his/her own reward by pulling an arm. The arms give rewards based on i.i.d. stochastic Bernoulli distributions. Players…

机器学习 · 计算机科学 2017-12-05 Noyan Evirgen , Alper Kose , Hakan Gokcesu

We consider the problem of identifying any $k$ out of the best $m$ arms in an $n$-armed stochastic multi-armed bandit. Framed in the PAC setting, this particular problem generalises both the problem of `best subset selection' and that of…

机器学习 · 计算机科学 2019-01-25 Arghya Roy Chaudhuri , Shivaram Kalyanakrishnan

We investigate the problem of batched best arm identification in multi-armed bandits, where we aim to identify the best arm from a set of $n$ arms while minimizing both the number of samples and batches. We introduce an algorithm that…

机器学习 · 计算机科学 2025-01-30 Tianyuan Jin , Qin Zhang , Dongruo Zhou

We introduce a bandit framework for stochastic matching under the multinomial logit (MNL) choice model. In our setting, $N$ agents on one side are assigned to $K$ arms on the other side, where each arm stochastically selects an agent from…

机器学习 · 统计学 2026-01-30 Jung-hun Kim , Min-hwan Oh

In pure-exploration problems, information is gathered sequentially to answer a question on the stochastic environment. While best-arm identification for linear bandits has been extensively studied in recent years, few works have been…

机器学习 · 统计学 2022-06-10 Marc Jourdan , Rémy Degenne

We study optimal experimental design for multinomial logit (MNL) bandits, where an agent repeatedly selects a subset of $K$ items from a ground set of size $N$ and observes single-choice feedback. Unlike linear or generalized linear…

机器学习 · 统计学 2026-05-26 Joongkyu Lee , Min-hwan Oh

We study a collaborative multi-agent stochastic linear bandit setting, where $N$ agents that form a network communicate locally to minimize their overall regret. In this setting, each agent has its own linear bandit problem (its own reward…

机器学习 · 计算机科学 2022-05-16 Ahmadreza Moradipari , Mohammad Ghavamzadeh , Mahnoosh Alizadeh

The multi-armed bandit(MAB) problem is a simple yet powerful framework that has been extensively studied in the context of decision-making under uncertainty. In many real-world applications, such as robotic applications, selecting an arm…

机器学习 · 计算机科学 2023-03-21 Tianpeng Zhang , Kasper Johansson , Na Li

In many real-world applications such as recommendation systems, multiple learning agents must balance exploration and exploitation while maintaining safety guarantees to avoid catastrophic failures. We study the stochastic linear bandit…

机器学习 · 计算机科学 2026-02-16 Amirhossein Afsharrad , Ahmadreza Moradipari , Sanjay Lall

We study the robust best-arm identification problem (RBAI) in the case of linear rewards. The primary objective is to identify a near-optimal robust arm, which involves selecting arms at every round and assessing their robustness by…

机器学习 · 计算机科学 2023-11-09 Wei Wang , Sattar Vakili , Ilija Bogunovic

This paper studies a decentralized homogeneous multi-armed bandit problem in a multi-agent network. The problem is simultaneously solved by $N$ agents assuming they face a common set of $M$ arms and share the same arms' reward…

机器学习 · 计算机科学 2024-12-31 Jingxuan Zhu , Ethan Mulle , Christopher S. Smith , Alec Koppel , Ji Liu

We consider the decentralized exploration problem: a set of players collaborate to identify the best arm by asynchronously interacting with the same stochastic environment. The objective is to insure privacy in the best arm identification…

机器学习 · 计算机科学 2023-01-18 Raphaël Féraud , Réda Alami , Romain Laroche

We present a provably optimal differentially private algorithm for the stochastic multi-arm bandit problem, as opposed to the private analogue of the UCB-algorithm [Mishra and Thakurta, 2015; Tossou and Dimitrakakis, 2016] which doesn't…

机器学习 · 统计学 2019-05-24 Touqir Sajed , Or Sheffet