中文
相关论文

相关论文: Stealthy Adversarial Attacks on Stochastic Multi-A…

200 篇论文

This paper introduces the informational multi-armed bandit (IMAB) model in which at each round, a player chooses an arm, observes a symbol, and receives an unobserved reward in the form of the symbol's self-information. Thus, the expected…

信息论 · 计算机科学 2022-09-07 Nir Weinberger , Michal Yemini

Motivated by applications such as online labor markets we consider a variant of the stochastic multi-armed bandit problem where we have a collection of arms representing strategic agents with different performance characteristics. The…

计算机科学与博弈论 · 计算机科学 2025-03-11 Seyed A. Esmaeili , Suho Shin , Aleksandrs Slivkins

In a multi-armed bandit (MAB) problem, an online algorithm makes a sequence of choices. In each round it chooses from a time-invariant set of alternatives and receives the payoff associated with this alternative. While the case of small…

数据结构与算法 · 计算机科学 2014-05-21 Aleksandrs Slivkins

We study collaborative learning in multi-agent Bayesian bandit problems, where strategic agents collectively solve the same bandit instance. While multiple agents can accelerate learning by sharing information, strategic agents might prefer…

机器学习 · 计算机科学 2026-05-14 Idan Barnea , Ofir Schlisselberg , Yishay Mansour

We study a multi-armed bandit problem in a dynamic environment where arm rewards evolve in a correlated fashion according to a Markov chain. Different than much of the work on related problems, in our formulation a learning algorithm does…

机器学习 · 计算机科学 2019-03-05 Tanner Fiez , Shreyas Sekar , Lillian J. Ratliff

In this paper, we investigate a largely extended version of classical MAB problem, called networked combinatorial bandit problems. In particular, we consider the setting of a decision maker over a networked bandits as follows: each time a…

机器学习 · 计算机科学 2015-03-23 Shaojie Tang , Yaqin Zhou

In this paper, we introduce a distributed version of the classical stochastic Multi-Arm Bandit (MAB) problem. Our setting consists of a large number of agents $n$ that collaboratively and simultaneously solve the same instance of $K$ armed…

机器学习 · 计算机科学 2019-11-06 Abishek Sankararaman , Ayalvadi Ganesh , Sanjay Shakkottai

Multi-player multi-armed bandits (MMAB) study how decentralized players cooperatively play the same multi-armed bandit so as to maximize their total cumulative rewards. Existing MMAB models mostly assume when more than one player pulls the…

机器学习 · 计算机科学 2022-04-29 Xuchuang Wang , Hong Xie , John C. S. Lui

In this paper, we study the stochastic combinatorial multi-armed bandit (CMAB) framework that allows a general nonlinear reward function, whose expected value may not depend only on the means of the input random variables but possibly on…

机器学习 · 计算机科学 2018-07-23 Wei Chen , Wei Hu , Fu Li , Jian Li , Yu Liu , Pinyan Lu

In recent years, multi-armed bandit (MAB) framework has attracted a lot of attention in various applications, from recommender systems and information retrieval to healthcare and finance, due to its stellar performance combined with certain…

机器学习 · 计算机科学 2019-04-24 Djallel Bouneffouf , Irina Rish

Reinforcement Learning (RL) is a widely researched area in artificial intelligence that focuses on teaching agents decision-making through interactions with their environment. A key subset includes stochastic multi-armed bandit (MAB) and…

机器学习 · 统计学 2025-02-20 Pengjie Zhou , Haoyu Wei , Huiming Zhang

Stochastic multi-armed bandits solve the Exploration-Exploitation dilemma and ultimately maximize the expected reward. Nonetheless, in many practical problems, maximizing the expected reward is not the most desirable objective. In this…

机器学习 · 计算机科学 2013-01-10 Amir Sani , Alessandro Lazaric , Rémi Munos

We study bandit best-arm identification with arbitrary and potentially adversarial rewards. A simple random uniform learner obtains the optimal rate of error in the adversarial scenario. However, this type of strategy is suboptimal when the…

机器学习 · 统计学 2026-04-17 Yasin Abbasi-Yadkori , Peter L. Bartlett , Victor Gabillon , Alan Malek , Michal Valko

This paper tackles a multi-agent bandit setting where $M$ agents cooperate together to solve the same instance of a $K$-armed stochastic bandit problem. The agents are \textit{heterogeneous}: each agent has limited access to a local subset…

机器学习 · 计算机科学 2022-02-18 Lin Yang , Yu-zhen Janice Chen , Mohammad Hajiesmaili , John CS Lui , Don Towsley

It is well known that in stochastic multi-armed bandits (MAB), the sample mean of an arm is typically not an unbiased estimator of its true mean. In this paper, we decouple three different sources of this selection bias: adaptive…

统计理论 · 数学 2019-10-29 Jaehyeok Shin , Aaditya Ramdas , Alessandro Rinaldo

This paper studies a decentralized homogeneous multi-armed bandit problem in a multi-agent network. The problem is simultaneously solved by $N$ agents assuming they face a common set of $M$ arms and share the same arms' reward…

机器学习 · 计算机科学 2024-12-31 Jingxuan Zhu , Ethan Mulle , Christopher S. Smith , Alec Koppel , Ji Liu

Consider a requester who wishes to crowdsource a series of identical binary labeling tasks to a pool of workers so as to achieve an assured accuracy for each task, in a cost optimal way. The workers are heterogeneous with unknown but fixed…

计算机科学与博弈论 · 计算机科学 2015-06-18 Shweta Jain , Sujit Gujar , Satyanath Bhat , Onno Zoeter , Y. Narahari

We consider the classic online learning and stochastic multi-armed bandit (MAB) problems, when at each step, the online policy can probe and find out which of a small number ($k$) of choices has better reward (or loss) before making its…

数据结构与算法 · 计算机科学 2022-11-08 Aditya Bhaskara , Sreenivas Gollapudi , Sungjin Im , Kostas Kollias , Kamesh Munagala

We provide a simple method to combine stochastic bandit algorithms. Our approach is based on a "meta-UCB" procedure that treats each of $N$ individual bandit algorithms as arms in a higher-level $N$-armed bandit problem that we solve with a…

机器学习 · 计算机科学 2020-12-25 Ashok Cutkosky , Abhimanyu Das , Manish Purohit

The multi-armed bandit (MAB) problem is a classical learning task that exemplifies the exploration-exploitation tradeoff. However, standard formulations do not take into account {\em risk}. In online decision making systems, risk is a…

机器学习 · 计算机科学 2020-08-04 Qiuyu Zhu , Vincent Y. F. Tan