中文
相关论文

相关论文: Distributed Consensus Algorithm for Decision-Makin…

200 篇论文

Cooperative multi-agent systems often face tasks that require coordinated actions under uncertainty. While multi-armed bandit (MAB) problems provide a powerful framework for decentralized learning, most prior work assumes individually…

多智能体系统 · 计算机科学 2025-06-23 Michael Ledford , William Regli

We propose a multi-agent multi-armed bandit (MA-MAB) framework aimed at ensuring fair outcomes across agents while maximizing overall system performance. A key challenge in this setting is decision-making under limited information about arm…

机器学习 · 计算机科学 2026-01-28 Tianyi Xu , Jiaxin Liu , Nicholas Mattei , Zizhan Zheng

Multi-armed bandit (MAB) algorithms have achieved significant success in sequential decision-making applications, under the premise that humans perfectly implement the recommended policy. However, existing methods often overlook the crucial…

机器学习 · 统计学 2024-10-07 Changxiao Cai , Jiacheng Zhang

The study of collaborative multi-agent bandits has attracted significant attention recently. In light of this, we initiate the study of a new collaborative setting, consisting of $N$ agents such that each agent is learning one of $M$…

机器学习 · 计算机科学 2024-07-04 Ronshee Chawla , Daniel Vial , Sanjay Shakkottai , R. Srikant

We study the stochastic multi-armed bandit problem with the graph-based feedback structure introduced by Mannor and Shamir. We analyze the performance of the two most prominent stochastic bandit algorithms, Thompson Sampling and Upper…

机器学习 · 计算机科学 2020-02-17 Thodoris Lykouris , Eva Tardos , Drishti Wali

This paper introduces the informational multi-armed bandit (IMAB) model in which at each round, a player chooses an arm, observes a symbol, and receives an unobserved reward in the form of the symbol's self-information. Thus, the expected…

信息论 · 计算机科学 2022-09-07 Nir Weinberger , Michal Yemini

We study a novel heterogeneous multi-agent multi-armed bandit problem with a cluster structure induced by stochastic block models, influencing not only graph topology, but also reward heterogeneity. Specifically, agents are distributed on…

机器学习 · 计算机科学 2025-02-13 Mengfan Xu , Liren Shan , Fatemeh Ghaffari , Xuchuang Wang , Xutong Liu , Mohammad Hajiesmaili

The multi-armed bandit (MAB) problem is a classical learning task that exemplifies the exploration-exploitation tradeoff. However, standard formulations do not take into account {\em risk}. In online decision making systems, risk is a…

机器学习 · 计算机科学 2020-08-04 Qiuyu Zhu , Vincent Y. F. Tan

A matching platform is a system that matches different types of participants, such as companies and job-seekers. In such a platform, merely maximizing the number of matches can result in matches being concentrated on highly popular…

机器学习 · 计算机科学 2026-03-10 Yuki Shibukawa , Koichi Tanaka , Yuta Saito , Shinji Ito

The multi-armed bandit (MAB) problems are widely studied in fields of operations research, stochastic optimization, and reinforcement learning. In this paper, we consider the classical MAB model with heavy-tailed reward distributions and…

机器学习 · 计算机科学 2025-09-16 Keqin Liu , Tianshuo Zheng , Zhi-Hua Zhou

Conventional Multi-Armed Bandit (MAB) algorithms are designed for stationary environments, where the reward distributions associated with the arms do not change with time. In many applications, however, the environment is more accurately…

人工智能 · 计算机科学 2025-11-05 Yu-Han Huang , Argyrios Gerogiannis , Subhonmesh Bose , Venugopal V. Veeravalli

The problem of bandit with graph feedback generalizes both the multi-armed bandit (MAB) problem and the learning with expert advice problem by encoding in a directed graph how the loss vector can be observed in each round of the game. The…

机器学习 · 计算机科学 2023-08-07 Yuchen He , Chihao Zhang

We study the multi-armed bandit problem where the rewards are realizations of general non-stationary stochastic processes, a setting that generalizes many existing lines of work and analyses. In particular, we present a theoretical analysis…

机器学习 · 计算机科学 2020-09-04 Corinna Cortes , Giulia DeSalvo , Vitaly Kuznetsov , Mehryar Mohri , Scott Yang

A multi-user multi-armed bandit (MAB) framework is used to develop algorithms for uncoordinated spectrum access. The number of users is assumed to be unknown to each user. A stochastic setting is first considered, where the rewards on a…

机器学习 · 计算机科学 2019-01-31 Meghana Bande , Venugopal V. Veeravalli

The multi-armed bandit(MAB) is a classical sequential decision problem. Most work requires assumptions about the reward distribution (e.g., bounded), while practitioners may have difficulty obtaining information about these distributions to…

机器学习 · 计算机科学 2023-12-14 Han Qi , Fei Guo , Li Zhu

We consider a decentralized multi-agent Multi Armed Bandit (MAB) setup consisting of $N$ agents, solving the same MAB instance to minimize individual cumulative regret. In our model, agents collaborate by exchanging messages through…

机器学习 · 计算机科学 2024-07-04 Ronshee Chawla , Abishek Sankararaman , Ayalvadi Ganesh , Sanjay Shakkottai

The Rising Multi-Armed Bandit (RMAB) framework models environments where expected rewards of arms increase with plays, which models practical scenarios where performance of each option improves with the repeated usage, such as in robotics…

机器学习 · 计算机科学 2026-02-16 Seockbean Song , Chenyu Gan , Youngsik Yoon , Siwei Wang , Wei Chen , Jungseul Ok

Experimentation with interference poses a significant challenge in contemporary online platforms. Prior research on experimentation with interference has concentrated on the final output of a policy. The cumulative performance, while…

机器学习 · 计算机科学 2024-07-17 Su Jia , Peter Frazier , Nathan Kallus

We consider stochastic multi-armed bandits where the expected reward is a unimodal function over partially ordered arms. This important class of problems has been recently investigated in (Cope 2009, Yu 2011). The set of arms is either…

机器学习 · 计算机科学 2014-05-21 Richard Combes , Alexandre Proutiere

We study the heavy-tailed stochastic bandit problem in the cooperative multi-agent setting, where a group of agents interact with a common bandit problem, while communicating on a network with delays. Existing algorithms for the stochastic…

机器学习 · 计算机科学 2020-08-17 Abhimanyu Dubey , Alex Pentland