中文
相关论文

相关论文: Differentially Private Multi-Armed Bandits in the …

200 篇论文

We consider the standard $K$-armed bandit problem under a distributed trust model of differential privacy (DP), which enables to guarantee privacy without a trustworthy server. Under this trust model, previous work largely focus on…

机器学习 · 计算机科学 2022-06-14 Sayak Ray Chowdhury , Xingyu Zhou

We design differentially private algorithms for the problem of online linear optimization in the full information and bandit settings with optimal $\tilde{O}(\sqrt{T})$ regret bounds. In the full-information setting, our results demonstrate…

机器学习 · 计算机科学 2017-06-15 Naman Agarwal , Karan Singh

We consider the Multi-Armed Bandit (MAB) problem, where an agent sequentially chooses actions and observes rewards for the actions it took. While the majority of algorithms try to minimize the regret, i.e., the cumulative difference between…

机器学习 · 计算机科学 2021-09-14 Nadav Merlis , Shie Mannor

Multi-arm bandit (MAB) and stochastic linear bandit (SLB) are important models in reinforcement learning, and it is well-known that classical algorithms for bandits with time horizon $T$ suffer $\Omega(\sqrt{T})$ regret. In this paper, we…

机器学习 · 计算机科学 2022-05-31 Zongqi Wan , Zhijie Zhang , Tongyang Li , Jialin Zhang , Xiaoming Sun

We study the stochastic multi-armed bandit problem with non-equivalent multiple plays where, at each step, an agent chooses not only a set of arms, but also their order, which influences reward distribution. In several problem formulations…

机器学习 · 计算机科学 2015-07-20 Aleksandr Vorobev , Gleb Gusev

We study the constrained variant of the \emph{multi-armed bandit} (MAB) problem, in which the learner aims not only at minimizing the total loss incurred during the learning dynamic, but also at controlling the violation of multiple…

We study the regret in stochastic Multi-Armed Bandits (MAB) with multiple agents that communicate over an arbitrary connected communication graph. We analyzed a variant of Cooperative Successive Elimination algorithm, COOP-SE, and show an…

机器学习 · 计算机科学 2026-02-04 Idan Barnea , Tal Lancewicki , Yishay Mansour

The multi-armed bandit is a concise model for the problem of iterated decision-making under uncertainty. In each round, a gambler must pull one of $K$ arms of a slot machine, without any foreknowledge of their payouts, except that they are…

数据结构与算法 · 计算机科学 2007-05-23 Varsha Dani , Thomas P. Hayes

We generalize the multiple-play multi-armed bandits (MP-MAB) problem with a shareable arm setting, in which several plays can share the same arm. Furthermore, each shareable arm has a finite reward capacity and a ''per-load'' reward…

机器学习 · 计算机科学 2022-06-20 Xuchuang Wang , Hong Xie , John C. S. Lui

We study the best-arm identification problem in multi-armed bandits with stochastic, potentially private rewards, when the goal is to identify the arm with the highest quantile at a fixed, prescribed level. First, we propose a (non-private)…

Strategic behavior against sequential learning methods, such as "click framing" in real recommendation systems, have been widely observed. Motivated by such behavior we study the problem of combinatorial multi-armed bandits (CMAB) under…

机器学习 · 计算机科学 2021-11-22 Jing Dong , Ke Li , Shuai Li , Baoxiang Wang

We study the distribution of regret in stochastic multi-armed bandits and episodic reinforcement learning through a unified framework. We formalize a distributional regret bound as a probabilistic guarantee that holds uniformly over all…

机器学习 · 计算机科学 2026-05-08 Harin Lee , Min-hwan Oh

We study the multi-armed bandit (MAB) problem with composite and anonymous feedback. In this model, the reward of pulling an arm spreads over a period of time (we call this period as reward interval) and the player receives partial rewards…

机器学习 · 计算机科学 2020-12-16 Siwei Wang , Haoyun Wang , Longbo Huang

The problem of bandit with graph feedback generalizes both the multi-armed bandit (MAB) problem and the learning with expert advice problem by encoding in a directed graph how the loss vector can be observed in each round of the game. The…

机器学习 · 计算机科学 2023-08-07 Yuchen He , Chihao Zhang

We study agents communicating over an underlying network by exchanging messages, in order to optimize their individual regret in a common nonstochastic multi-armed bandit problem. We derive regret minimization algorithms that guarantee for…

机器学习 · 计算机科学 2019-11-19 Yogev Bar-On , Yishay Mansour

In this paper we propose a general methodology to derive regret bounds for randomized multi-armed bandit algorithms. It consists in checking a set of sufficient conditions on the sampling probability of each arm and on the family of…

机器学习 · 计算机科学 2024-11-14 Dorian Baudry , Kazuya Suzuki , Junya Honda

The multi-armed bandit problem is a popular model for studying exploration/exploitation trade-off in sequential decision problems. Many algorithms are now available for this well-studied problem. One of the earliest algorithms, given by W.…

机器学习 · 计算机科学 2012-04-10 Shipra Agrawal , Navin Goyal

We consider the stochastic bandit problem in the sublinear space setting, where one cannot record the win-loss record for all $K$ arms. We give an algorithm using $O(1)$ words of space with regret \[ \sum_{i=1}^{K}\frac{1}{\Delta_i}\log…

数据结构与算法 · 计算机科学 2018-05-17 David Liau , Eric Price , Zhao Song , Ger Yang

We study the non-stationary stochastic multiarmed bandit (MAB) problem and propose two generic algorithms, namely, the limited memory deterministic sequencing of exploration and exploitation (LM-DSEE) and the Sliding-Window Upper Confidence…

机器学习 · 统计学 2018-04-25 Lai Wei , Vaibhav Srivastava

We solve the COLT 2013 open problem of \citet{SCB} on minimizing regret in the setting of advice-efficient multiarmed bandits with expert advice. We give an algorithm for the setting of K arms and N experts out of which we are allowed to…

机器学习 · 计算机科学 2013-07-09 Satyen Kale