English
Related papers

Related papers: Collaborative Learning with Limited Interaction: T…

200 papers

Cooperative multi-agent multi-armed bandits (CMA2B) consider the collaborative efforts of multiple agents in a shared multi-armed bandit game. We study latent vulnerabilities exposed by this collaboration and consider adversarial attacks on…

Machine Learning · Computer Science 2023-11-06 Jinhang Zuo , Zhiyao Zhang , Xuchuang Wang , Cheng Chen , Shuai Li , John C. S. Lui , Mohammad Hajiesmaili , Adam Wierman

In this paper, we consider a best action identification problem in the stochastic linear bandit setup with a fixed confident constraint. In the considered best action identification problem, instead of minimizing the accumulative regret as…

Machine Learning · Computer Science 2018-12-04 Jun Geng , Lifeng Lai

Recent works have shown that agents facing independent instances of a stochastic $K$-armed bandit can collaborate to decrease regret. However, these works assume that each agent always recommends their individual best-arm estimates to other…

Machine Learning · Computer Science 2022-03-02 Daniel Vial , Sanjay Shakkottai , R. Srikant

We study a sequential resource allocation problem between a fixed number of arms. On each iteration the algorithm distributes a resource among the arms in order to maximize the expected success rate. Allocating more of the resource to a…

Machine Learning · Computer Science 2018-03-29 Yuval Dagan , Koby Crammer

We study the problem of multi-agent multi-armed bandits with adversarial corruption in a heterogeneous setting, where each agent accesses a subset of arms. The adversary can corrupt the reward observations for all agents. Agents share these…

Machine Learning · Computer Science 2024-11-14 Fatemeh Ghaffari , Xuchuang Wang , Jinhang Zuo , Mohammad Hajiesmaili

A stochastic multi-armed bandit problem with side information on the similarity and dissimilarity across different arms is considered. The action space of the problem can be represented by a unit interval graph (UIG) where each node…

Machine Learning · Computer Science 2019-09-04 Xiao Xu , Sattar Vakili , Qing Zhao , Ananthram Swami

Bandit optimization usually refers to the class of online optimization problems with limited feedback, namely, a decision maker uses only the objective value at the current point to make a new decision and does not have access to the…

Machine Learning · Computer Science 2026-02-18 Yuriy Dorn , Aleksandr Katrutsa , Ilgam Latypov , Anastasiia Soboleva

Motivated by drug design, we consider the best-arm identification problem in generalized linear bandits. More specifically, we assume each arm has a vector of covariates, there is an unknown vector of parameters that is common across the…

Machine Learning · Computer Science 2019-05-21 Abbas Kazerouni , Lawrence M. Wein

We consider a novel stochastic multi-armed bandit problem called {\em good arm identification} (GAI), where a good arm is defined as an arm with expected reward greater than or equal to a given threshold. GAI is a pure-exploration problem…

Multi-agent reinforcement learning (MARL) problems are challenging due to information asymmetry. To overcome this challenge, existing methods often require high level of coordination or communication between the agents. We consider…

Machine Learning · Computer Science 2021-11-02 Hsu Kao , Chen-Yu Wei , Vijay Subramanian

Multi-armed bandit (MAB) is a class of online learning problems where a learning agent aims to maximize its expected cumulative reward while repeatedly selecting to pull arms with unknown reward distributions. We consider a scenario where…

Machine Learning · Statistics 2019-01-25 Yang Cao , Zheng Wen , Branislav Kveton , Yao Xie

In this paper, we explore the use of multi-armed bandit online learning techniques to solve distributed resource selection problems. As an example, we focus on the problem of network selection. Mobile devices often have several wireless…

Computer Science and Game Theory · Computer Science 2018-05-15 Anuja Meetoo Appavoo , Seth Gilbert , Kian-Lee Tan

We study a distributed multi-armed bandit (MAB) problem over arm erasure channels, motivated by the increasing adoption of MAB algorithms over communication-constrained networks. In this setup, the learner communicates the chosen arm to…

Machine Learning · Computer Science 2026-01-21 Merve Karakas , Osama Hanna , Lin F. Yang , Christina Fragouli

We study the robust best-arm identification problem (RBAI) in the case of linear rewards. The primary objective is to identify a near-optimal robust arm, which involves selecting arms at every round and assessing their robustness by…

Machine Learning · Computer Science 2023-11-09 Wei Wang , Sattar Vakili , Ilija Bogunovic

Combinatorial Multi-Armed Bandit with fairness constraints is a framework where multiple arms form a super arm and can be pulled in each round under uncertainty to maximize cumulative rewards while ensuring the minimum average reward…

Machine Learning · Computer Science 2025-01-14 Xiaoyi Wu , Bo Ji , Bin Li

The exploration/exploitation (E/E) dilemma arises naturally in many subfields of Science. Multi-armed bandit problems formalize this dilemma in its canonical form. Most current research in this field focuses on generic solutions that can be…

Artificial Intelligence · Computer Science 2012-07-24 Francis Maes , Damien Ernst , Louis Wehenkel

While classical formulations of multi-armed bandit problems assume that each arm's reward is independent and stationary, real-world applications often involve non-stationary environments and interdependencies between arms. In particular,…

Machine Learning · Computer Science 2025-06-19 Ryoma Sato , Shinji Ito

This paper puts forward the concept that learning to take safe actions in unknown environments, even with probability one guarantees, can be achieved without the need for an unbounded number of exploratory trials. This is indeed possible,…

Systems and Control · Electrical Eng. & Systems 2023-02-14 Agustin Castellano , Hancheng Min , Juan Bazerque , Enrique Mallada

In this paper, we study multi-armed bandit problems in explore-then-commit setting. In our proposed explore-then-commit setting, the goal is to identify the best arm after a pure experimentation (exploration) phase and exploit it once or…

Machine Learning · Computer Science 2020-12-16 Ali Yekkehkhany , Ebrahim Arian , Mohammad Hajiesmaili , Rakesh Nagi

Classical multi-armed bandit problems use the expected value of an arm as a metric to evaluate its goodness. However, the expected value is a risk-neutral metric. In many applications like finance, one is interested in balancing the…

Machine Learning · Computer Science 2019-06-04 Anmol Kagrecha , Jayakrishnan Nair , Krishna Jagannathan
‹ Prev 1 8 9 10 Next ›