中文
相关论文

相关论文: Communication-Efficient Collaborative Best Arm Ide…

200 篇论文

We study the problem of regret minimization for distributed bandits learning, in which $M$ agents work collaboratively to minimize their total regret under the coordination of a central server. Our goal is to design communication protocols…

机器学习 · 计算机科学 2019-05-30 Yuanhao Wang , Jiachen Hu , Xiaoyu Chen , Liwei Wang

Best-arm identification (BAI) in a fixed-budget setting is a bandit problem where the learning agent maximizes the probability of identifying the optimal (best) arm after a fixed number of observations. Most works on this topic study…

机器学习 · 计算机科学 2023-07-06 Mohammad Javad Azizi , Branislav Kveton , Mohammad Ghavamzadeh

The multi-armed bandit(MAB) problem is a simple yet powerful framework that has been extensively studied in the context of decision-making under uncertainty. In many real-world applications, such as robotic applications, selecting an arm…

机器学习 · 计算机科学 2023-03-21 Tianpeng Zhang , Kasper Johansson , Na Li

In many real-world applications, multiple agents seek to learn how to perform highly related yet slightly different tasks in an online bandit learning protocol. We formulate this problem as the $\epsilon$-multi-player multi-armed bandit…

机器学习 · 计算机科学 2021-07-21 Zhi Wang , Chicheng Zhang , Manish Kumar Singh , Laurel D. Riek , Kamalika Chaudhuri

The beam alignment (BA) problem consists in accurately aligning the transmitter and receiver beams to establish a reliable communication link in wireless communication systems. Existing BA methods search the entire beam space to identify…

信息论 · 计算机科学 2022-10-25 Yi Wei , Zixin Zhong , Vincent Y. F. Tan

We define and analyze a multi-agent multi-armed bandit problem in which decision-making agents can observe the choices and rewards of their neighbors. Neighbors are defined by a network graph with heterogeneous and stochastic…

最优化与控制 · 数学 2019-05-22 Udari Madhushani , Naomi Ehrich Leonard

With artificial intelligence systems becoming ubiquitous in our society, its designers will soon have to start to consider its social dimension, as many of these systems will have to interact among them to work efficiently. With this in…

人工智能 · 计算机科学 2020-06-23 Santiago Cuervo , Marco Alzate

The cooperative bandit problem is a multi-agent decision problem involving a group of agents that interact simultaneously with a multi-armed bandit, while communicating over a network with delays. The central idea in this problem is to…

机器学习 · 统计学 2022-05-31 Abhimanyu Dubey , Alex Pentland

We consider a stochastic bandit problem with a possibly infinite number of arms. We write $p^*$ for the proportion of optimal arms and $\Delta$ for the minimal mean-gap between optimal and sub-optimal arms. We characterize the optimal…

机器学习 · 计算机科学 2021-11-08 Rianne de Heide , James Cheshire , Pierre Ménard , Alexandra Carpentier

In cooperative bandits, a framework that captures essential features of collective sequential decision making, agents can minimize group regret, and thereby improve performance, by leveraging shared information. However, sharing information…

机器学习 · 统计学 2021-10-12 Udari Madhushani , Naomi Leonard

Many real-world functions are defined over both categorical and category-specific continuous variables and thus cannot be optimized by traditional Bayesian optimization (BO) methods. To optimize such functions, we propose a new method that…

机器学习 · 计算机科学 2019-12-02 Dang Nguyen , Sunil Gupta , Santu Rana , Alistair Shilton , Svetha Venkatesh

Combinatorial bandits with semi-bandit feedback generalize multi-armed bandits, where the agent chooses sets of arms and observes a noisy reward for each arm contained in the chosen set. The action set satisfies a given structure such as…

机器学习 · 统计学 2021-01-22 Marc Jourdan , Mojmír Mutný , Johannes Kirschner , Andreas Krause

The cooperative bandit problem is increasingly becoming relevant due to its applications in large-scale decision-making. However, most research for this problem focuses exclusively on the setting with perfect communication, whereas in most…

机器学习 · 统计学 2021-11-25 Udari Madhushani , Abhimanyu Dubey , Naomi Ehrich Leonard , Alex Pentland

We introduce a new graphical bilinear bandit problem where a learner (or a \emph{central entity}) allocates arms to the nodes of a graph and observes for each edge a noisy bilinear reward representing the interaction between the two end…

机器学习 · 计算机科学 2021-06-14 Geovani Rizk , Albert Thomas , Igor Colin , Rida Laraki , Yann Chevaleyre

Reinforcement learning in cooperative multi-agent settings has recently advanced significantly in its scope, with applications in cooperative estimation for advertising, dynamic treatment regimes, distributed control, and federated…

机器学习 · 计算机科学 2021-03-30 Abhimanyu Dubey , Alex Pentland

A Multi-Agent Cooperative Learning (MACL) system is an artificial intelligence (AI) system where multiple learning agents work together to complete a common task. Recent empirical success of MACL systems in various domains (e.g. traffic…

机器学习 · 计算机科学 2023-10-31 Jialin Yi

We study the stochastic Multiplayer Multi-Armed Bandit (MMAB) problem, where multiple players select arms to maximize their cumulative rewards. Collisions occur when two or more players select the same arm, resulting in no reward, and are…

机器学习 · 计算机科学 2025-10-09 Daoyuan Zhou , Xuchuang Wang , Lin Yang , Yang Gao

We consider a variant of the best arm identification task in stochastic multi-armed bandits. Motivated by risk-averse decision-making problems, our goal is to identify a set of $m$ arms with the highest $\tau$-quantile values within a fixed…

机器学习 · 计算机科学 2023-02-22 Mengyan Zhang , Cheng Soon Ong

We study a decentralized cooperative stochastic multi-armed bandit problem with $K$ arms on a network of $N$ agents. In our model, the reward distribution of each arm is the same for each agent and rewards are drawn independently across…

机器学习 · 计算机科学 2019-10-25 David Martínez-Rubio , Varun Kanade , Patrick Rebeschini

We study joint learning of network topology and a mixed opinion dynamics, in which agents may have different update rules. Such a model captures the diversity of real individual interactions. We propose a learning algorithm based on…

社会与信息网络 · 计算机科学 2023-06-29 Yu Xing , Xudong Sun , Karl H. Johansson