中文
相关论文

相关论文: An Optimal Algorithm for Multiplayer Multi-Armed B…

200 篇论文

We consider the best-arm identification problem in multi-armed bandits, which focuses purely on exploration. A player is given a fixed budget to explore a finite set of arms, and the rewards of each arm are drawn independently from a fixed,…

机器学习 · 统计学 2017-08-02 Shahin Shahrampour , Mohammad Noshad , Vahid Tarokh

In this paper, we investigate a largely extended version of classical MAB problem, called networked combinatorial bandit problems. In particular, we consider the setting of a decision maker over a networked bandits as follows: each time a…

机器学习 · 计算机科学 2015-03-23 Shaojie Tang , Yaqin Zhou

The restless bandit problem is one of the most well-studied generalizations of the celebrated stochastic multi-armed bandit problem in decision theory. In its ultimate generality, the restless bandit problem is known to be PSPACE-Hard to…

数据结构与算法 · 计算机科学 2009-02-03 Sudipto Guha , Kamesh Munagala , Peng Shi

We study a distributed multi-armed bandit (MAB) problem over arm erasure channels, motivated by the increasing adoption of MAB algorithms over communication-constrained networks. In this setup, the learner communicates the chosen arm to…

机器学习 · 计算机科学 2026-01-21 Merve Karakas , Osama Hanna , Lin F. Yang , Christina Fragouli

We study the explore-exploit tradeoff in distributed cooperative decision-making using the context of the multiarmed bandit (MAB) problem. For the distributed cooperative MAB problem, we design the cooperative UCB algorithm that comprises…

系统与控制 · 计算机科学 2019-09-17 Peter Landgren , Vaibhav Srivastava , Naomi Ehrich Leonard

We study the stochastic multi-player multi-armed bandit problem. In this problem, $m$ players cooperate to maximize their total reward from $K > m$ arms. However the players cannot communicate and are penalized (e.g. receive no reward) if…

机器学习 · 计算机科学 2022-06-08 Allen Liu , Mark Sellke

The multi-armed bandit is a concise model for the problem of iterated decision-making under uncertainty. In each round, a gambler must pull one of $K$ arms of a slot machine, without any foreknowledge of their payouts, except that they are…

数据结构与算法 · 计算机科学 2007-05-23 Varsha Dani , Thomas P. Hayes

We study the real-valued combinatorial pure exploration problem in the stochastic multi-armed bandit (R-CPE-MAB). We study the case where the size of the action set is polynomial with respect to the number of arms. In such a case, the…

机器学习 · 计算机科学 2025-01-10 Shintaro Nakamura , Masashi Sugiyama

In this paper we investigate the problem of stochastic multi-armed bandits (MAB) in the (local) differential privacy (DP/LDP) model. Unlike previous results that assume bounded/sub-Gaussian reward distributions, we focus on the setting…

机器学习 · 计算机科学 2022-03-25 Youming Tao , Yulian Wu , Peng Zhao , Di Wang

We study a strategic version of the multi-armed bandit problem, where each arm is an individual strategic agent and we, the principal, pull one arm each round. When pulled, the arm receives some private reward $v_a$ and can choose an amount…

计算机科学与博弈论 · 计算机科学 2017-07-03 Mark Braverman , Jieming Mao , Jon Schneider , S. Matthew Weinberg

This paper investigates the problem of regret minimization for multi-armed bandit (MAB) problems with local differential privacy (LDP) guarantee. In stochastic bandit systems, the rewards may refer to the users' activities, which may…

机器学习 · 计算机科学 2020-07-08 Wenbo Ren , Xingyu Zhou , Jia Liu , Ness B. Shroff

We develop a novel and generic algorithm for the adversarial multi-armed bandit problem (or more generally the combinatorial semi-bandit problem). When instantiated differently, our algorithm achieves various new data-dependent regret…

机器学习 · 计算机科学 2018-06-08 Chen-Yu Wei , Haipeng Luo

This paper tackles a multi-agent bandit setting where $M$ agents cooperate together to solve the same instance of a $K$-armed stochastic bandit problem. The agents are \textit{heterogeneous}: each agent has limited access to a local subset…

机器学习 · 计算机科学 2022-02-18 Lin Yang , Yu-zhen Janice Chen , Mohammad Hajiesmaili , John CS Lui , Don Towsley

Multi-armed bandit (MAB) problems are widely applied to online optimization tasks that require balancing exploration and exploitation. In practical scenarios, these tasks often involve multiple conflicting objectives, giving rise to…

机器学习 · 计算机科学 2025-06-17 Mansoor Davoodi , Setareh Maghsudi

Recently, there has been extensive study of cooperative multi-agent multi-armed bandits where a set of distributed agents cooperatively play the same multi-armed bandit game. The goal is to develop bandit algorithms with the optimal group…

机器学习 · 计算机科学 2023-08-09 Lin Yang , Xuchuang Wang , Mohammad Hajiesmaili , Lijun Zhang , John C. S. Lui , Don Towsley

The classical multi-armed bandit (MAB) problem involves a learner and a collection of K independent arms, each with its own ex ante unknown independent reward distribution. At each one of a finite number of rounds, the learner selects one…

最优化与控制 · 数学 2024-05-07 Hongda Hu , Arthur Charpentier , Mario Ghossoub , Alexander Schied

We propose a generalization of the best arm identification problem in stochastic multi-armed bandits (MAB) to the setting where every pull of an arm is associated with delayed feedback. The delay in feedback increases the effective sample…

We consider a stochastic multi-armed bandit (MAB) problem motivated by ``large'' action spaces, and endowed with a population of arms containing exactly $K$ arm-types, each characterized by a distinct mean reward. The decision maker is…

机器学习 · 计算机科学 2023-01-19 Anand Kalvit , Assaf Zeevi

In this paper, we propose a new multi-objective contextual multi-armed bandit (MAB) problem with two objectives, where one of the objectives dominates the other objective. Unlike single-objective MAB problems in which the learner obtains a…

机器学习 · 计算机科学 2018-06-04 Cem Tekin , Eralp Turgay

The stochastic multi-armed bandit (MAB) problem is a common model for sequential decision problems. In the standard setup, a decision maker has to choose at every instant between several competing arms, each of them provides a scalar random…

机器学习 · 统计学 2021-10-27 Asaf Cassel , Shie Mannor , Assaf Zeevi