English
Related papers

Related papers: Multiplayer Multi-armed Bandits for Optimal Assign…

200 papers

The beam alignment (BA) problem consists in accurately aligning the transmitter and receiver beams to establish a reliable communication link in wireless communication systems. Existing BA methods search the entire beam space to identify…

Information Theory · Computer Science 2022-10-25 Yi Wei , Zixin Zhong , Vincent Y. F. Tan

This paper focuses on the problem of automatic link selection in multi-channel multiple access control using bandit feedback. In particular, a controller assigns multiple users to multiple channels in a time-slotted system, where in each…

Systems and Control · Electrical Eng. & Systems 2026-03-09 Mevan Wijewardena , Michael J. Neely , Haipeng Luo

We consider a multi-armed bandit problem where the decision maker can explore and exploit different arms at every round. The exploited arm adds to the decision maker's cumulative reward (without necessarily observing the reward) while the…

Machine Learning · Computer Science 2012-07-03 Orly Avner , Shie Mannor , Ohad Shamir

We introduce a framework for decentralized online learning for multi-armed bandits (MAB) with multiple cooperative players. The reward obtained by the players in each round depends on the actions taken by all the players. It's a team…

Machine Learning · Computer Science 2021-09-10 William Chang , Mehdi Jafarnia-Jahromi , Rahul Jain

Making judicious channel access and transmission scheduling decisions is essential for improving performance as well as energy and spectral efficiency in multichannel wireless systems. This problem has been a subject of extensive study in…

Machine Learning · Computer Science 2015-04-07 Yang Liu , Mingyan Liu

We study the federated pure exploration problem of multi-armed bandits and linear bandits, where $M$ agents cooperatively identify the best arm via communicating with the central server. To enhance the robustness against latency and…

Machine Learning · Computer Science 2024-10-01 Zichen Wang , Chuanhao Li , Chenyu Song , Lianghui Wang , Quanquan Gu , Huazheng Wang

We study a decentralized cooperative multi-agent multi-armed bandit problem with $K$ arms and $N$ agents connected over a network. In our model, each arm's reward distribution is same for all agents, and rewards are drawn independently…

Machine Learning · Statistics 2020-10-29 Anusha Lalitha , Andrea Goldsmith

In this paper, we study censored Semi-Bandits, a novel variant of the semi-bandits problem. The learner is assumed to have a fixed amount of resources, which it allocates to the arms at each time step. The loss observed from an arm is…

Machine Learning · Computer Science 2020-03-26 Arun Verma , Manjesh K. Hanawal , Arun Rajkumar , Raman Sankaran

We consider the channel access problem in a multi-channel opportunistic communication system with imperfect channel sensing, where the state of each channel evolves as a non independent and identically distributed Markov process. This…

Systems and Control · Computer Science 2015-06-05 Kehao Wang , Lin Chen , Quan Liu , Khaldoun Al Agha

We study the decentralized multi-agent multi-armed bandit problem for agents that communicate with probability over a network defined by a $d$-regular graph. Every edge in the graph has probabilistic weight $p$ to account for the…

Machine Learning · Statistics 2021-10-12 Udari Madhushani , Naomi Ehrich Leonard

We consider opportunistic communications over multiple channels where the state ("good" or "bad") of each channel evolves as independent and identically distributed Markov processes. A user, with limited sensing and access capability,…

Networking and Internet Architecture · Computer Science 2009-03-11 Sahand H. A. Ahmad , Mingyan Liu , Tara Javidi , Qing Zhao , Bhaskar Krishnamachari

Multi-objective multi-armed bandit (MO-MAB) problems traditionally aim to achieve Pareto optimality. However, real-world scenarios often involve users with varying preferences across objectives, resulting in a Pareto-optimal arm that may…

Machine Learning · Computer Science 2025-11-18 Linfeng Cao , Ming Shi , Ness B. Shroff

We study a robust, i.e. in presence of malicious participants, multi-agent multi-armed bandit problem where multiple participants are distributed on a fully decentralized blockchain, with the possibility of some being malicious. The rewards…

Machine Learning · Computer Science 2024-07-29 Mengfan Xu , Diego Klabjan

We study a security threat to adversarial multi-armed bandits, in which an attacker perturbs the loss or reward signal to control the behavior of the victim bandit player. We show that the attacker is able to mislead any no-regret…

Machine Learning · Computer Science 2023-01-31 Yuzhe Ma , Zhijin Zhou

In this paper, we consider distributed optimization problems over a multi-agent network, where each agent can only partially evaluate the objective function, and it is allowed to exchange messages with its immediate neighbors. Differently…

Optimization and Control · Mathematics 2019-02-22 Davood Hajinezhad , Mingyi Hong , Alfredo Garcia

Setting up the future Internet of Things (IoT) networks will require to support more and more communicating devices. We prove that intelligent devices in unlicensed bands can use Multi-Armed Bandit (MAB) learning algorithms to improve…

Networking and Internet Architecture · Computer Science 2018-07-03 Rémi Bonnefoi , Lilian Besson , Christophe Moy , Emilie Kaufmann , Jacques Palicot

In distributed wireless networks, nodes often do not know the topology (network size, connectivity and the channel gains) of the network. Thus, they have to compute their transmission and reception parameters in a distributed fashion. In…

Information Theory · Computer Science 2009-10-21 Vaneet Aggarwal , Salman Avestimehr , Ashutosh Sabharwal

This paper deals with solving distributed optimization problems with equality constraints by a class of uncertain nonlinear heterogeneous dynamic multi-agent systems. It is assumed that each agent with an uncertain dynamic model has limited…

Systems and Control · Electrical Eng. & Systems 2022-06-28 Mohammad Saeed Sarafraz , Mohammad Saleh Tavazoei

Developing an efficient spectrum access policy enables cognitive radios to dramatically increase spectrum utilization while ensuring predetermined quality of service levels for primary users. In this paper, modeling, performance analysis,…

Information Theory · Computer Science 2014-09-04 Hossein Shokri-Ghadikolaei , Carlo Fischione

In this paper, we consider a multi-armed bandit (MAB) instance and study how to identify the best arm when arm commands are conveyed from a central learner to a distributed agent over a discrete memoryless channel (DMC). Depending on the…

Information Theory · Computer Science 2026-04-03 Merve Karakas , Osama Hanna , Lin F. Yang , Christina Fragouli