English
Related papers

Related papers: Coordinated Multi-Armed Bandits for Improved Spati…

200 papers

We study the stochastic Multiplayer Multi-Armed Bandit (MMAB) problem, where multiple players select arms to maximize their cumulative rewards. Collisions occur when two or more players select the same arm, resulting in no reward, and are…

Machine Learning · Computer Science 2025-10-09 Daoyuan Zhou , Xuchuang Wang , Lin Yang , Yang Gao

In this paper, we propose a new multi-objective contextual multi-armed bandit (MAB) problem with two objectives, where one of the objectives dominates the other objective. Unlike single-objective MAB problems in which the learner obtains a…

Machine Learning · Computer Science 2018-06-04 Cem Tekin , Eralp Turgay

We introduce an approach to improve team performance in a Multi-Agent Multi-Armed Bandit (MAMAB) framework using Fastest Mixing Markov Chain (FMMC) and Fastest Distributed Linear Averaging (FDLA) optimization algorithms. The multi-agent…

Multiagent Systems · Computer Science 2024-11-01 Monish Reddy Kotturu , Saniya Vahedian Movahed , Paul Robinette , Kshitij Jerath , Amanda Redlich , Reza Azadeh

Sequential decision-making under uncertainty often involves multiple agents learning which actions (arms) yield the highest rewards through repeated interaction with a stochastic environment. This setting is commonly modeled by cooperative…

Systems and Control · Electrical Eng. & Systems 2026-03-25 Evagoras Makridis , Themistoklis Charalambous

We study distributed cooperative decision-making under the explore-exploit tradeoff in the multiarmed bandit (MAB) problem. We extend the state-of-the-art frequentist and Bayesian algorithms for single-agent MAB problems to cooperative…

Systems and Control · Computer Science 2019-09-18 Peter Landgren , Vaibhav Srivastava , Naomi Ehrich Leonard

Thanks to its simplicity and cost efficiency, wireless local area network (WLAN) enjoys unique advantages in providing high-speed and low-cost wireless services in hot spots and indoor environments. Traditional WLAN medium-access-control…

Performance · Computer Science 2007-10-04 Ying Jun Zhang , Peng Xuan Zheng , Soung Chang Liew

We study the non-stationary stochastic multiarmed bandit (MAB) problem and propose two generic algorithms, namely, the limited memory deterministic sequencing of exploration and exploitation (LM-DSEE) and the Sliding-Window Upper Confidence…

Machine Learning · Statistics 2018-04-25 Lai Wei , Vaibhav Srivastava

Multi-armed bandits (MAB) provide a principled online learning approach to attain the balance between exploration and exploitation. Due to the superior performance and low feedback learning without the learning to act in multiple…

Information Retrieval · Computer Science 2022-10-25 Shenghao Xu

This paper studies a multi-armed bandit (MAB) version of the range-searching problem. In its basic form, range searching considers as input a set of points (on the real line) and a collection of (real) intervals. Here, with each specified…

Machine Learning · Computer Science 2021-05-05 Siddharth Barman , Ramakrishnan Krishnamurthy , Saladi Rahul

The existing medium access control (MAC) protocol of Wi-Fi networks (i.e., carrier-sense multiple access with collision avoidance (CSMA/CA)) suffers from poor performance in dense deployments due to the increasing number of collisions and…

Information Theory · Computer Science 2021-11-18 Jiantao Xin , Wensen Xu , Yucheng Cai , Taotao Wang , Shengli Zhang , Peng Liu , Ziyang Guo , Jiajun Luo

In this letter, we investigate a coordinated multiple point (CoMP)-aided integrated sensing and communication (ISAC) system that supports multiple users and targets. Multiple base stations (BSs) employ a coordinated power allocation…

Information Theory · Computer Science 2025-03-11 Jianpeng Zou , Zhanfeng Zhong , Jintao Wang , Zheng Shi , Guanghua Yang , Shaodan Ma

Utilizing Deep Reinforcement Learning (DRL) for Reconfigurable Intelligent Surface (RIS) assisted wireless communication has been extensively researched. However, existing DRL methods either act as a simple optimizer or only solve problems…

Systems and Control · Electrical Eng. & Systems 2026-01-19 Meng-Qian Alexander Wu , Tzu-Hsien Sang , Luisa Schuhmacher , Ming-Jie Guo , Khodr Hammoud , Sofie Pollin

Multi-armed bandits (MAB) is a sequential decision-making model in which the learner controls the trade-off between exploration and exploitation to maximize its cumulative reward. Federated multi-armed bandits (FMAB) is an emerging…

Machine Learning · Computer Science 2025-02-18 Artun Saday , İlker Demirel , Yiğit Yıldırım , Cem Tekin

Online optimization of resource management for large-scale data centers and infrastructures to meet dynamic capacity reservation demands and various practical constraints (e.g., feasibility and robustness) is a very challenging problem.…

Networking and Internet Architecture · Computer Science 2024-10-18 Chang-Lin Chen , Hanhan Zhou , Jiayu Chen , Mohammad Pedramfar , Tian Lan , Zheqing Zhu , Chi Zhou , Pol Mauri Ruiz , Neeraj Kumar , Hongbo Dong , Vaneet Aggarwal

With the increase in demand for Internet of Things (IoT) applications, the number of IoT devices has drastically grown, making spectrum resources seriously insufficient. Transmission collisions and retransmissions increase power…

Networking and Internet Architecture · Computer Science 2025-01-23 Ryotai Airiyoshi , Mikio Hasegawa , Tomoaki Ohtsuki , Aohan Li

As users in small cell networks increasingly rely on computation-intensive services, cloud-based access often results in high latency. Multi-access edge computing (MEC) mitigates this by bringing computational resources closer to end users,…

Networking and Internet Architecture · Computer Science 2026-04-08 Mariam Yahya , Aydin Sezgin , Setareh Maghsudi

The Rising Multi-Armed Bandit (RMAB) framework models environments where expected rewards of arms increase with plays, which models practical scenarios where performance of each option improves with the repeated usage, such as in robotics…

Machine Learning · Computer Science 2026-02-16 Seockbean Song , Chenyu Gan , Youngsik Yoon , Siwei Wang , Wei Chen , Jungseul Ok

Federated learning enables distributed model training across clients without raw data exchange, but in wireless implementations, frequent parameter updates cause high communication overhead. Existing research often assumes known channel…

Machine Learning · Computer Science 2025-03-25 Zhiyin Li , Yubo Yang , Tao Yang , Ziyu Guo , Xiaofeng Wu , Bo Hu

Multi-agent reinforcement learning (MARL) problems are challenging due to information asymmetry. To overcome this challenge, existing methods often require high level of coordination or communication between the agents. We consider…

Machine Learning · Computer Science 2021-11-02 Hsu Kao , Chen-Yu Wei , Vijay Subramanian

We present an approach to Intelligent Tutoring Systems which adaptively personalizes sequences of learning activities to maximize skills acquired by students, taking into account the limited time and motivational resources. At a given point…

Artificial Intelligence · Computer Science 2019-07-17 Benjamin Clement , Didier Roy , Pierre-Yves Oudeyer , Manuel Lopes