中文
相关论文

相关论文: Communication-Constrained Bandits under Additive G…

200 篇论文

Motivated by applications of bandit algorithms in education, we consider a stochastic multi-armed bandit problem with $\varepsilon$-contaminated rewards. We allow an adversary to give arbitrary unbounded contaminated rewards with full…

机器学习 · 统计学 2020-06-19 Laura Niss , Ambuj Tewari

In this paper, we study the stochastic combinatorial multi-armed bandit (CMAB) framework that allows a general nonlinear reward function, whose expected value may not depend only on the means of the input random variables but possibly on…

机器学习 · 计算机科学 2018-07-23 Wei Chen , Wei Hu , Fu Li , Jian Li , Yu Liu , Pinyan Lu

In many real-world applications such as recommendation systems, multiple learning agents must balance exploration and exploitation while maintaining safety guarantees to avoid catastrophic failures. We study the stochastic linear bandit…

机器学习 · 计算机科学 2026-02-16 Amirhossein Afsharrad , Ahmadreza Moradipari , Sanjay Lall

This paper is in the field of stochastic Multi-Armed Bandits (MABs), i.e. those sequential selection techniques able to learn online using only the feedback given by the chosen option (a.k.a. $arm$). We study a particular case of the rested…

机器学习 · 统计学 2024-11-28 Marco Fiandri , Alberto Maria Metelli , Francesco Trov`o

We examine a multi-armed bandit problem with contextual information, where the objective is to ensure that each arm receives a minimum aggregated reward across contexts while simultaneously maximizing the total cumulative reward. This…

机器学习 · 计算机科学 2025-10-15 Ahmed Ben Yahmed , Hafedh El Ferchichi , Marc Abeille , Vianney Perchet

We introduce and study a new class of stochastic bandit problems, referred to as predictive bandits. In each round, the decision maker first decides whether to gather information about the rewards of particular arms (so that their rewards…

机器学习 · 计算机科学 2020-04-03 Simon Lindståhl , Alexandre Proutiere , Andreas Johnsson

We consider a resource-aware variant of the classical multi-armed bandit problem: In each round, the learner selects an arm and determines a resource limit. It then observes a corresponding (random) reward, provided the (random) amount of…

机器学习 · 计算机科学 2022-10-18 Viktor Bengs , Eyke Hüllermeier

We study a decentralized cooperative multi-agent multi-armed bandit problem with $K$ arms and $N$ agents connected over a network. In our model, each arm's reward distribution is same for all agents, and rewards are drawn independently…

机器学习 · 统计学 2020-10-29 Anusha Lalitha , Andrea Goldsmith

We study the decentralized multi-agent multi-armed bandit problem for agents that communicate with probability over a network defined by a $d$-regular graph. Every edge in the graph has probabilistic weight $p$ to account for the…

机器学习 · 统计学 2021-10-12 Udari Madhushani , Naomi Ehrich Leonard

The cooperative bandit problem is increasingly becoming relevant due to its applications in large-scale decision-making. However, most research for this problem focuses exclusively on the setting with perfect communication, whereas in most…

机器学习 · 统计学 2021-11-25 Udari Madhushani , Abhimanyu Dubey , Naomi Ehrich Leonard , Alex Pentland

In this paper, we study the stochastic multi-armed bandit problem with graph feedback. Motivated by the clinical trials and recommendation problem, we assume that two arms are connected if and only if they are similar (i.e., their means are…

机器学习 · 计算机科学 2024-05-21 Han Qi , Guo Fei , Li Zhu

We consider a combinatorial multi-armed bandit problem for maximum value reward function under maximum value and index feedback. This is a new feedback structure that lies in between commonly studied semi-bandit and full-bandit feedback…

机器学习 · 计算机科学 2023-05-26 Yiliu Wang , Wei Chen , Milan Vojnović

In this paper, we formulate the multi-agent graph bandit problem as a multi-agent extension of the graph bandit problem introduced by Zhang, Johansson, and Li [CISS 57, 1-6 (2023)]. In our formulation, $N$ cooperative agents travel on a…

机器学习 · 计算机科学 2024-11-05 Phevos Paschalidis , Runyu Zhang , Na Li

In this paper, we study the stochastic multi-armed bandit problem with graph feedback. Motivated by applications in clinical trials and recommendation systems, we assume that two arms are connected if and only if they are similar (i.e.,…

机器学习 · 计算机科学 2025-09-18 Han Qi , Fei Guo , Li Zhu , Qiaosheng Zhang

Motivated by problems in search and detection we present a solution to a Combinatorial Multi-Armed Bandit (CMAB) problem with both heavy-tailed reward distributions and a new class of feedback, filtered semibandit feedback. In a CMAB…

机器学习 · 计算机科学 2017-05-29 James A. Grant , David S. Leslie , Kevin Glazebrook , Roberto Szechtman

Classic no-regret multi-armed bandit algorithms, including the Upper Confidence Bound (UCB), Hedge, and EXP3, are inherently unfair by design. Their unfairness stems from their objective of playing the most rewarding arm as frequently as…

机器学习 · 计算机科学 2024-05-14 Abhishek Sinha

Strategic behavior against sequential learning methods, such as "click framing" in real recommendation systems, have been widely observed. Motivated by such behavior we study the problem of combinatorial multi-armed bandits (CMAB) under…

机器学习 · 计算机科学 2021-11-22 Jing Dong , Ke Li , Shuai Li , Baoxiang Wang

In this study, we explore a collaborative multi-agent stochastic linear bandit setting involving a network of $N$ agents that communicate locally to minimize their collective regret while keeping their expected cost under a specified…

机器学习 · 计算机科学 2024-10-24 Amirhossein Afsharrad , Parisa Oftadeh , Ahmadreza Moradipari , Sanjay Lall

This paper introduces a general multi-agent bandit model in which each agent is facing a finite set of arms and may communicate with other agents through a central controller in order to identify, in pure exploration, or play, in regret…

机器学习 · 计算机科学 2022-10-31 Clémence Réda , Sattar Vakili , Emilie Kaufmann

We present conservative distributed multi-task learning in stochastic linear contextual bandits with heterogeneous agents. This extends conservative linear bandits to a distributed setting where M agents tackle different but related tasks…

机器学习 · 计算机科学 2025-04-29 Jiabin Lin , Shana Moothedath