English
Related papers

Related papers: Collaborative Multi-Agent Multi-Armed Bandit Learn…

200 papers

Existing risk-aware multi-armed bandit models typically focus on risk measures of individual options such as variance. As a result, they cannot be directly applied to important real-world online decision making problems with correlated…

Machine Learning · Computer Science 2023-05-12 Yihan Du , Siwei Wang , Zhixuan Fang , Longbo Huang

Competitions for shareable and limited resources have long been studied with strategic agents. In reality, agents often have to learn and maximize the rewards of the resources at the same time. To design an individualized competing policy,…

Machine Learning · Computer Science 2023-08-07 Renzhe Xu , Haotian Wang , Xingxuan Zhang , Bo Li , Peng Cui

Recent works on Multi-Armed Bandits (MAB) and Combinatorial Multi-Armed Bandits (COM-MAB) show good results on a global accuracy metric. This can be achieved, in the case of recommender systems, with personalization. However, with a…

Machine Learning · Computer Science 2020-09-17 Alexandre Letard , Tassadit Amghar , Olivier Camp , Nicolas Gutowski

We study a collaborative multi-agent stochastic linear bandit setting, where $N$ agents that form a network communicate locally to minimize their overall regret. In this setting, each agent has its own linear bandit problem (its own reward…

Machine Learning · Computer Science 2022-05-16 Ahmadreza Moradipari , Mohammad Ghavamzadeh , Mahnoosh Alizadeh

Multi-objective multi-armed bandit (MO-MAB) problems traditionally aim to achieve Pareto optimality. However, real-world scenarios often involve users with varying preferences across objectives, resulting in a Pareto-optimal arm that may…

Machine Learning · Computer Science 2025-11-18 Linfeng Cao , Ming Shi , Ness B. Shroff

Federated learning (FL) is an emerging machine learning (ML) paradigm used to train models across multiple nodes (i.e., clients) holding local data sets, without explicitly exchanging the data. It has attracted a growing interest in recent…

Machine Learning · Computer Science 2023-03-21 Dan Ben Ami , Kobi Cohen , Qing Zhao

In this short paper, we present early insights from a Decision Support System for Customer Support Agents (CSAs) serving customers of a leading accounting software. The system is under development and is designed to provide suggestions to…

Machine Learning · Computer Science 2019-03-11 Hrishikesh Ganu , Mithun Ghosh , Shashi Roshan

The recruitment of trustworthy and high-quality workers is an important research issue for MCS. Previous studies either assume that the qualities of workers are known in advance, or assume that the platform knows the qualities of workers…

Human-Computer Interaction · Computer Science 2023-06-28 Jianheng Tang , Kejia Fan , Wenxuan Xie , Luomin Zeng , Feijiang Han , Guosheng Huang , Tian Wang , Anfeng Liu , Shaobo Zhang

We study the stochastic multi-armed bandit (MAB) problem in the presence of side-observations across actions that occur as a result of an underlying network structure. In our model, a bipartite graph captures the relationship between…

Machine Learning · Computer Science 2017-07-14 Swapna Buccapatnam , Fang Liu , Atilla Eryilmaz , Ness B. Shroff

Base station (BS) placement in mobile networks is critical to the efficient use of resources in any communication system and one of the main factors that determines the quality of communication. Although there is ample literature on the…

Signal Processing · Electrical Eng. & Systems 2020-03-10 Fatih Erden , Chethan K. Anjinappa , Ender Ozturk , Ismail Guvenc

Multi-armed bandit algorithms have become a reference solution for handling the explore/exploit dilemma in recommender systems, and many other important real-world problems, such as display advertisement. However, such algorithms usually…

Machine Learning · Computer Science 2018-05-25 Qingyun Wu , Naveen Iyer , Hongning Wang

The contextual multi-armed bandit (MAB) problem is crucial in sequential decision-making. A line of research, known as online clustering of bandits, extends contextual MAB by grouping similar users into clusters, utilizing shared features…

Machine Learning · Computer Science 2025-01-03 Zhuohua Li , Maoli Liu , Xiangxiang Dai , John C. S. Lui

Sequential experiments are often characterized by an exploration-exploitation tradeoff that is captured by the multi-armed bandit (MAB) framework. This framework has been studied and applied, typically when at each time period feedback is…

Machine Learning · Computer Science 2020-12-22 Yonatan Gur , Ahmadreza Momeni

We formulate and study a decentralized multi-armed bandit (MAB) problem. There are M distributed players competing for N independent arms. Each arm, when played, offers i.i.d. reward according to a distribution with an unknown parameter. At…

Optimization and Control · Mathematics 2015-05-14 Keqin Liu , Qing Zhao

We consider an online channel scheduling problem for a single transmitter-receiver pair equipped with $N$ arbitrarily varying wireless channels. The transmission rates of the channels might be non-stationary and could be controlled by an…

Information Theory · Computer Science 2025-01-24 G Krishnakumar , Abhishek Sinha

We study the problem of collaborative best-arm identification in stochastic linear bandits under a fixed-budget scenario. In our learning model, we first consider multiple agents connected through a star network, interacting with a linear…

Machine Learning · Computer Science 2025-05-27 Sanjana Agrawal , Saúl A. Blanco

This paper is in the field of stochastic Multi-Armed Bandits (MABs), i.e. those sequential selection techniques able to learn online using only the feedback given by the chosen option (a.k.a. $arm$). We study a particular case of the rested…

Machine Learning · Statistics 2024-11-28 Marco Fiandri , Alberto Maria Metelli , Francesco Trov`o

Recognizing implicit visual and textual patterns is essential in many real-world applications of modern AI. However, tackling long-tail pattern recognition tasks remains challenging for current pre-trained foundation models such as LLMs and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Minxue Tang , Yangyang Yu , Aolin Ding , Maziyar Baran Pouyan , Taha Belkhouja , Yujia Bao

We study the problem of federated stochastic multi-arm contextual bandits with unknown contexts, in which M agents are faced with different bandits and collaborate to learn. The communication model consists of a central server and the…

Machine Learning · Computer Science 2024-01-31 Jiabin Lin , Shana Moothedath

We track moving targets with a distributed multiple-input multiple-output (MIMO) radar, for which the transmitters and receivers are appropriately paired and selected with a limited number of radar stations. We aim to maximize the sum of…

Systems and Control · Electrical Eng. & Systems 2023-06-19 Yuhang Hao , Zengfu Wang , Jing Fu , Xianglong Bai , Can Li , Quan Pan