中文
相关论文

相关论文: Communication-Efficient Collaborative Best Arm Ide…

200 篇论文

The notion that cooperation can aid a group of agents to solve problems more efficiently than if those agents worked in isolation is prevalent, despite the little quantitative groundwork to support it. Here we consider a primordial form of…

适应与自组织系统 · 物理学 2014-10-22 José F. Fontanari

We consider a novel multi-arm bandit (MAB) setup, where a learner needs to communicate the actions to distributed agents over erasure channels, while the rewards for the actions are directly available to the learner through external…

机器学习 · 统计学 2024-06-27 Osama Hanna , Merve Karakas , Lin F. Yang , Christina Fragouli

We study the heavy-tailed stochastic bandit problem in the cooperative multi-agent setting, where a group of agents interact with a common bandit problem, while communicating on a network with delays. Existing algorithms for the stochastic…

机器学习 · 计算机科学 2020-08-17 Abhimanyu Dubey , Alex Pentland

We study best arm identification in a variant of the multi-armed bandit problem where the learner has limited precision in arm selection. The learner can only sample arms via certain exploration bundles, which we refer to as boxes. In…

机器学习 · 计算机科学 2023-05-11 Kota Srinivas Reddy , P. N. Karthik , Nikhil Karamchandani , Jayakrishnan Nair

We study the best-arm identification problem in multi-armed bandits with stochastic, potentially private rewards, when the goal is to identify the arm with the highest quantile at a fixed, prescribed level. First, we propose a (non-private)…

Multi-arm bandit (MAB) algorithms have been used to learn optimal beams for millimeter wave communication systems. Here, the complexity of learning the optimal beam linearly scales with the number of beams, leading to high latency when…

信号处理 · 电气工程与系统科学 2023-06-30 Akanksha Sneh , Sumit Darak , Shobha Sundar Ram , Manjesh Hanawal

Learning paradigms based purely on offline data as well as those based solely on sequential online learning have been well-studied in the literature. In this paper, we consider combining offline data with online learning, an area less…

机器学习 · 计算机科学 2023-06-16 Shubhada Agrawal , Sandeep Juneja , Karthikeyan Shanmugam , Arun Sai Suggala

We study a cooperative multi-agent multi-armed bandits with M agents and K arms. The goal of the agents is to minimized the cumulative regret. We adapt a traditional Thompson Sampling algoirthm under the distributed setting. However, with…

人工智能 · 计算机科学 2021-09-10 Jing Dong , Tan Li , Shaolei Ren , Linqi Song

Applying Reinforcement Learning (RL) to Restless Multi-Arm Bandits (RMABs) offers a promising avenue for addressing allocation problems with resource constraints and temporal dynamics. However, classic RMAB models largely overlook the…

机器学习 · 计算机科学 2025-03-20 Yunfan Zhao , Tonghan Wang , Dheeraj Nagaraj , Aparna Taneja , Milind Tambe

We consider the classical multi-armed bandit problem, but with strategic arms. In this context, each arm is characterized by a bounded support reward distribution and strategically aims to maximize its own utility by potentially retaining a…

机器学习 · 计算机科学 2025-01-28 Ahmed Ben Yahmed , Clément Calauzènes , Vianney Perchet

We study the problem of identifying the top $m$ arms in a multi-armed bandit game. Our proposed solution relies on a new algorithm based on successive rejects of the seemingly bad arms, and successive accepts of the good ones. This…

机器学习 · 计算机科学 2012-05-16 Sébastien Bubeck , Tengyao Wang , Nitin Viswanathan

We investigate the sample complexity of learning the optimal arm for multi-task bandit problems. Arms consist of two components: one that is shared across tasks (that we call representation) and one that is task-specific (that we call…

机器学习 · 统计学 2022-11-29 Alessio Russo , Alexandre Proutiere

We study agents communicating over an underlying network by exchanging messages, in order to optimize their individual regret in a common nonstochastic multi-armed bandit problem. We derive regret minimization algorithms that guarantee for…

机器学习 · 计算机科学 2019-11-19 Yogev Bar-On , Yishay Mansour

We study a multi-objective multi-armed bandit problem in a dynamic environment. The problem portrays a decision-maker that sequentially selects an arm from a given set. If selected, each action produces a reward vector, where every element…

机器学习 · 计算机科学 2023-02-14 Amir Rezaei Balef , Setareh Maghsudi

When humans collaborate with each other, they often make decisions by observing others and considering the consequences that their actions may have on the entire team, instead of greedily doing what is best for just themselves. We would…

机器学习 · 计算机科学 2021-12-17 Erdem Bıyık , Anusha Lalitha , Rajarshi Saha , Andrea Goldsmith , Dorsa Sadigh

We study best arm identification in a federated multi-armed bandit setting with a central server and multiple clients, when each client has access to a {\em subset} of arms and each arm yields independent Gaussian observations. The goal is…

机器学习 · 计算机科学 2023-12-20 Zhirui Chen , P. N. Karthik , Vincent Y. F. Tan , Yeow Meng Chee

We consider the best arm identification problem in the stochastic multi-armed bandit framework where each arm has a tiny probability of realizing large rewards while with overwhelming probability the reward is zero. A key application of…

机器学习 · 计算机科学 2023-03-15 Anirban Bhattacharjee , Sushant Vijayan , Sandeep K Juneja

We consider the best arm identification (BAI) problem in the $K-$armed bandit framework with a modification - the agent is allowed to play a subset of arms at each time slot instead of one arm. Consequently, the agent observes the sample…

机器学习 · 计算机科学 2026-01-30 Siddhartha Parupudi , Gourab Ghatak

We consider a variant of the best arm identification (BAI) problem in multi-armed bandits (MAB) in which there are two sets of arms (source and target), and the objective is to determine the best target arm while only pulling source arms.…

机器学习 · 计算机科学 2021-12-09 Ojash Neopane , Aaditya Ramdas , Aarti Singh

We study the decentralized multi-agent multi-armed bandit problem for agents that communicate with probability over a network defined by a $d$-regular graph. Every edge in the graph has probabilistic weight $p$ to account for the…

机器学习 · 统计学 2021-10-12 Udari Madhushani , Naomi Ehrich Leonard