English
Related papers

Related papers: Multi-Agent Thompson Sampling for Bandit Applicati…

200 papers

Contextual bandits are a core technology for personalized mobile health interventions, where decision-making requires adapting to complex, non-linear user behaviors. While Thompson Sampling (TS) is a preferred strategy for these problems,…

Machine Learning · Statistics 2026-02-10 Ruizhe Deng , Bibhas Chakraborty , Ran Chen , Yan Shuo Tan

Learning-based techniques are increasingly effective at controlling complex systems using data-driven models. However, most work done so far has focused on learning individual tasks or control laws. Hence, it is still a largely unaddressed…

Systems and Control · Electrical Eng. & Systems 2020-05-08 Alexandre Capone , Armin Lederer , Jonas Umlauft , Sandra Hirche

Influence maximization, adaptive routing, and dynamic spectrum allocation all require choosing the right action from a large set of alternatives. Thanks to the advances in combinatorial optimization, these and many similar problems can be…

Machine Learning · Computer Science 2020-12-29 Alihan Hüyük , Cem Tekin

Many real-world functions are defined over both categorical and category-specific continuous variables and thus cannot be optimized by traditional Bayesian optimization (BO) methods. To optimize such functions, we propose a new method that…

Machine Learning · Computer Science 2019-12-02 Dang Nguyen , Sunil Gupta , Santu Rana , Alistair Shilton , Svetha Venkatesh

Wireless communication systems operate in complex time-varying environments. Therefore, selecting the optimal configuration parameters in these systems is a challenging problem. For wireless links, \emph{rate selection} is used to select…

Machine Learning · Computer Science 2020-04-21 Vidit Saxena , Joseph E. Gonzalez , Ion Stoica , Hugo Tullberg , Joakim Jaldén

We study the asymptotic performance of the Thompson sampling algorithm in the batched multi-armed bandit setting where the time horizon $T$ is divided into batches, and the agent is not able to observe the rewards of her actions until the…

Machine Learning · Computer Science 2021-10-04 Cem Kalkanli , Ayfer Ozgur

This work proposes a secure and dynamic VM allocation strategy for multi-tenant distributed systems using the Thompson sampling approach. The method proves more effective and secure compared to epsilon-greedy and upper confidence bound…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-08 Pravin Patil , Geetanjali Kale , Tanmay Karmarkar , Ruturaj Ghatage

Communication networks shared by many users are a widespread challenge nowadays. In this paper we address several aspects of this challenge simultaneously: learning unknown stochastic network characteristics, sharing resources with other…

Machine Learning · Computer Science 2018-08-16 Orly Avner , Shie Mannor

In next generation of Wi-Fi networks Multiple Access Point Coordination (MAPC) is poised to significantly enhance the network performance by enabling a set of Access Points (APs) to coordinate with each other through advanced coordinating…

Networking and Internet Architecture · Computer Science 2026-03-24 Ziru Chen , Salvatore Talarico , Qing Xia , Xihan Peng , Xing Hao , Lin X. Cai

Multi-robot systems are integral to modern logistics, but their capabilities are often limited to tasks executable by individual agents. This paper addresses a critical gap in existing frameworks like Multi-Agent Path Finding (MAPF) and…

Multiagent Systems · Computer Science 2026-05-18 Ning Zhou , Nikolai W. F. Bode , Edmund R. Hunt

We consider incentivized exploration: a version of multi-armed bandits where the choice of arms is controlled by self-interested agents, and the algorithm can only issue recommendations. The algorithm controls the flow of information, and…

Computer Science and Game Theory · Computer Science 2022-06-14 Mark Sellke , Aleksandrs Slivkins

A multi-agent AI system (MAS) is composed of multiple autonomous agents that interact, exchange information, and make decisions based on internal generative models. Recent advances in large language models and tool-using agents have made…

We propose a novel complete algorithm for multi-agent pathfinding (MAPF) called lazy constraints addition search for MAPF (LaCAM). MAPF is a problem of finding collision-free paths for multiple agents on graphs and is the foundation of…

Artificial Intelligence · Computer Science 2022-11-28 Keisuke Okumura

Thompson Sampling is one of the most widely used and studied bandit algorithms, known for its simple structure, low regret performance, and solid theoretical guarantees. Yet, in stark contrast to most other families of bandit algorithms,…

Machine Learning · Computer Science 2026-05-28 Yanlin Qu , Hongseok Namkoong , Assaf Zeevi

We study the real-valued combinatorial pure exploration of the multi-armed bandit (R-CPE-MAB) problem. In R-CPE-MAB, a player is given $d$ stochastic arms, and the reward of each arm $s\in\{1, \ldots, d\}$ follows an unknown distribution…

Machine Learning · Computer Science 2023-11-16 Shintaro Nakamura , Masashi Sugiyama

Multi-agent reinforcement learning (MARl) has achieved strong results in cooperative tasks but typically assumes fixed, fully controlled teams. Ad hoc teamwork (AHT) relaxes this by allowing collaboration with unknown partners, yet existing…

Multiagent Systems · Computer Science 2025-10-30 Beiwen Zhang , Yongheng Liang , Hejun Wu

This letter proposes a linear bandit-based beam training framework for near-field communication under multi-path channels. By leveraging Thompson Sampling (TS), the framework adaptively balances exploration and exploitation to maximize…

Signal Processing · Electrical Eng. & Systems 2026-03-11 Junchi Liu , Zijun Wang , Rui Zhang

Much of the recent literature on bandit learning focuses on algorithms that aim to converge on an optimal action. One shortcoming is that this orientation does not account for time sensitivity, which can play a crucial role when learning an…

Machine Learning · Computer Science 2020-01-09 Daniel Russo , Benjamin Van Roy

We consider a novel formulation of the multi-armed bandit model, which we call the contextual bandit with restricted context, where only a limited number of features can be accessed by the learner at every iteration. This novel formulation…

Artificial Intelligence · Computer Science 2017-06-09 Djallel Bouneffouf , Irina Rish , Guillermo A. Cecchi , Raphael Feraud

In multi-agent reinforcement learning, a commonly considered paradigm is centralized training with decentralized execution. However, in this framework, decentralized execution restricts the development of coordinated policies due to the…

Multiagent Systems · Computer Science 2024-12-30 Wenzhe Fan , Zishun Yu , Chengdong Ma , Changye Li , Yaodong Yang , Xinhua Zhang
‹ Prev 1 3 4 5 6 7 10 Next ›