中文
相关论文

相关论文: Adversarial Attacks on Combinatorial Multi-Armed B…

200 篇论文

This paper studies an instance of the multi-armed bandit (MAB) problem, specifically where several causal MABs operate chronologically in the same dynamical system. Practically the reward distribution of each bandit is governed by the same…

机器学习 · 统计学 2021-12-06 Neil Dhir

We consider a remote contextual multi-armed bandit (CMAB) problem, in which the decision-maker observes the context and the reward, but must communicate the actions to be taken by the agents over a rate-limited communication channel. This…

信息论 · 计算机科学 2022-02-11 Francesco Pase , Deniz Gunduz , Michele Zorzi

In this paper, we provide the first investigation into adaptive combinatorial experimental design, focusing on the trade-off between regret minimization and statistical power in combinatorial multi-armed bandits (CMAB). While minimizing…

机器学习 · 计算机科学 2026-03-02 Hongrui Xie , Junyu Cao , Kan Xu

The Rising Multi-Armed Bandit (RMAB) framework models environments where expected rewards of arms increase with plays, which models practical scenarios where performance of each option improves with the repeated usage, such as in robotics…

机器学习 · 计算机科学 2026-02-16 Seockbean Song , Chenyu Gan , Youngsik Yoon , Siwei Wang , Wei Chen , Jungseul Ok

We extend Bayesian multi-armed bandit (MAB) algorithms beyond their original setting by making use of sequential Monte Carlo (SMC) methods. A MAB is a sequential decision making problem where the goal is to learn a policy that maximizes…

机器学习 · 统计学 2024-04-08 Iñigo Urteaga , Chris H. Wiggins

Multi-arm bandits are gaining popularity as they enable real-world sequential decision-making across application areas, including clinical trials, recommender systems, and online decision-making. Consequently, there is an increased desire…

统计方法学 · 统计学 2023-03-01 Dae Woong Ham , Iavor Bojinov , Michael Lindon , Martin Tingley

We consider the Adversarial Multi-Armed Bandits (MAB) problem with unbounded losses, where the algorithms have no prior knowledge on the sizes of the losses. We present UMAB-NN and UMAB-G, two algorithms for non-negative and general…

机器学习 · 统计学 2023-10-04 Mingyu Chen , Xuezhou Zhang

We study the constrained variant of the \emph{multi-armed bandit} (MAB) problem, in which the learner aims not only at minimizing the total loss incurred during the learning dynamic, but also at controlling the violation of multiple…

Sequential decision-making under uncertainty often involves multiple agents learning which actions (arms) yield the highest rewards through repeated interaction with a stochastic environment. This setting is commonly modeled by cooperative…

系统与控制 · 电气工程与系统科学 2026-03-25 Evagoras Makridis , Themistoklis Charalambous

Multi-player Multi-Armed Bandits (MAB) have been extensively studied in the literature, motivated by applications to Cognitive Radio systems. Driven by such applications as well, we motivate the introduction of several levels of feedback…

机器学习 · 统计学 2019-04-30 Lilian Besson , Emilie Kaufmann

We consider a novel multi-arm bandit (MAB) setup, where a learner needs to communicate the actions to distributed agents over erasure channels, while the rewards for the actions are directly available to the learner through external…

机器学习 · 统计学 2024-06-27 Osama Hanna , Merve Karakas , Lin F. Yang , Christina Fragouli

We study a multi-armed bandit problem with covariates in a setting where there is a possible delay in observing the rewards. Under some mild assumptions on the probability distributions for the delays and using an appropriate randomization…

机器学习 · 统计学 2019-09-06 Sakshi Arya , Yuhong Yang

In modern resource-sharing systems, multiple agents access limited resources with unknown stochastic conditions to perform tasks. When multiple agents access the same resource (arm) simultaneously, they compete for successful usage, leading…

计算机科学与博弈论 · 计算机科学 2025-03-28 Hongbo Li , Lingjie Duan

We introduce in this paper a new algorithm for Multi-Armed Bandit (MAB) problems. A machine learning paradigm popular within Cognitive Network related topics (e.g., Spectrum Sensing and Allocation). We focus on the case where the rewards…

机器学习 · 统计学 2012-04-10 Wassim Jouini , Christophe Moy

Due to the broad range of applications of stochastic multi-armed bandit model, understanding the effects of adversarial attacks and designing bandit algorithms robust to attacks are essential for the safe applications of this model. In this…

机器学习 · 计算机科学 2020-10-28 Guanlin Liu , Lifeng lai

In this study, we consider the infinitely many-armed bandit problems in a rested rotting setting, where the mean reward of an arm may decrease with each pull, while otherwise, it remains unchanged. We explore two scenarios regarding the…

机器学习 · 计算机科学 2025-06-03 Jung-hun Kim , Milan Vojnovic , Se-Young Yun

Federated multi-armed bandits (FMAB) is a new bandit paradigm that parallels the federated learning (FL) framework in supervised learning. It is inspired by practical applications in cognitive radio and recommender systems, and enjoys…

机器学习 · 计算机科学 2021-03-04 Chengshuai Shi , Cong Shen

Recent works on Multi-Armed Bandits (MAB) and Combinatorial Multi-Armed Bandits (COM-MAB) show good results on a global accuracy metric. This can be achieved, in the case of recommender systems, with personalization. However, with a…

机器学习 · 计算机科学 2020-09-17 Alexandre Letard , Tassadit Amghar , Olivier Camp , Nicolas Gutowski

Contextual bandits are a form of multi-armed bandit in which the agent has access to predictive side information (known as the context) for each arm at each time step, and have been used to model personalized news recommendation, ad…

机器学习 · 统计学 2017-05-25 Aniket Anand Deshmukh , Urun Dogan , Clayton Scott

In a multi-armed bandit problem, an online algorithm chooses from a set of strategies in a sequence of trials so as to maximize the total payoff of the chosen strategies. While the performance of bandit algorithms with a small finite…

数据结构与算法 · 计算机科学 2008-09-30 Robert Kleinberg , Aleksandrs Slivkins , Eli Upfal