中文
相关论文

相关论文: Differentially Private Stochastic Linear Bandits: …

200 篇论文

This paper investigates the problem of generalized linear bandits with heavy-tailed rewards, whose $(1+\epsilon)$-th moment is bounded for some $\epsilon\in (0,1]$. Although there exist methods for generalized linear bandits, most of them…

机器学习 · 计算机科学 2023-10-31 Bo Xue , Yimu Wang , Yuanyu Wan , Jinfeng Yi , Lijun Zhang

This paper presents new \emph{variance-aware} confidence sets for linear bandits and linear mixture Markov Decision Processes (MDPs). With the new confidence sets, we obtain the follow regret bounds: For linear bandits, we obtain an…

机器学习 · 计算机科学 2021-11-01 Zihan Zhang , Jiaqi Yang , Xiangyang Ji , Simon S. Du

This paper investigates the problem of regret minimization for multi-armed bandit (MAB) problems with local differential privacy (LDP) guarantee. In stochastic bandit systems, the rewards may refer to the users' activities, which may…

机器学习 · 计算机科学 2020-07-08 Wenbo Ren , Xingyu Zhou , Jia Liu , Ness B. Shroff

In this paper, we revisit the problem of sparse linear regression in the local differential privacy (LDP) model. Existing research in the non-interactive and sequentially local models has focused on obtaining the lower bounds for the case…

机器学习 · 计算机科学 2023-10-12 Liyang Zhu , Meng Ding , Vaneet Aggarwal , Jinhui Xu , Di Wang

We study small-loss bounds for adversarial multi-armed bandits with graph feedback, that is, adaptive regret bounds that depend on the loss of the best arm or related quantities, instead of the total number of rounds. We derive the first…

机器学习 · 计算机科学 2020-06-24 Chung-Wei Lee , Haipeng Luo , Mengxiao Zhang

We study high-dimensional multi-armed contextual bandits with batched feedback where the $T$ steps of online interactions are divided into $L$ batches. In specific, each batch collects data according to a policy that depends on previous…

机器学习 · 统计学 2023-11-27 Jianqing Fan , Zhaoran Wang , Zhuoran Yang , Chenlu Ye

We consider the online sparse linear regression problem, which is the problem of sequentially making predictions observing only a limited number of features in each round, to minimize regret with respect to the best sparse linear regressor,…

机器学习 · 计算机科学 2016-03-08 Dean Foster , Satyen Kale , Howard Karloff

This paper studies the Bayesian regret of a variant of the Thompson-Sampling algorithm for bandit problems. It builds upon the information-theoretic framework of [Russo and Van Roy, 2015] and, more specifically, on the rate-distortion…

We study distributed adversarial bandits, where $N$ agents cooperate to minimize the global average loss while observing only their own local losses. We show that the minimax regret for this problem is…

机器学习 · 计算机科学 2026-02-09 Hao Qiu , Mengxiao Zhang , Nicolò Cesa-Bianchi

We study a collaborative multi-agent stochastic linear bandit setting, where $N$ agents that form a network communicate locally to minimize their overall regret. In this setting, each agent has its own linear bandit problem (its own reward…

机器学习 · 计算机科学 2022-05-16 Ahmadreza Moradipari , Mohammad Ghavamzadeh , Mahnoosh Alizadeh

Contextual bandit algorithms are widely used in domains where it is desirable to provide a personalized service by leveraging contextual information, that may contain sensitive information that needs to be protected. Inspired by this…

机器学习 · 计算机科学 2021-12-14 Evrard Garcelon , Kamalika Chaudhuri , Vianney Perchet , Matteo Pirotta

We consider a linear stochastic bandit problem where the dimension $K$ of the unknown parameter $\theta$ is larger than the sampling budget $n$. In such cases, it is in general impossible to derive sub-linear regret bounds since usual…

统计理论 · 数学 2012-05-23 Alexandra Carpentier , Rémi Munos

Contextual bandit algorithms are useful in personalized online decision-making. However, many applications such as personalized medicine and online advertising require the utilization of individual-specific information for effective…

机器学习 · 统计学 2021-06-08 Yuxuan Han , Zhipeng Liang , Yang Wang , Jiheng Zhang

In this paper, we study Combinatorial Semi-Bandits (CSB) that is an extension of classic Multi-Armed Bandits (MAB) under Differential Privacy (DP) and stronger Local Differential Privacy (LDP) setting. Since the server receives more…

机器学习 · 计算机科学 2020-07-06 Xiaoyu Chen , Kai Zheng , Zixin Zhou , Yunchang Yang , Wei Chen , Liwei Wang

We consider combinatorial semi-bandits over a set of arms ${\cal X} \subset \{0,1\}^d$ where rewards are uncorrelated across items. For this problem, the algorithm ESCB yields the smallest known regret bound $R(T) = {\cal O}\Big( {d (\ln…

机器学习 · 统计学 2021-01-14 Thibaut Cuvelier , Richard Combes , Eric Gourdin

We consider a multi-armed bandit problem where payoffs are a linear function of an observed stochastic contextual variable. In the scenario where there exists a gap between optimal and suboptimal rewards, several algorithms have been…

数据结构与算法 · 计算机科学 2014-07-08 José Bento , Stratis Ioannidis , S. Muthukrishnan , Jinyun Yan

We study the stochastic bandit problem with ReLU neural network structure. We show that a $\tilde{O}(\sqrt{T})$ regret guarantee is achievable by considering bandits with one-layer ReLU neural networks; to the best of our knowledge, our…

机器学习 · 计算机科学 2024-05-14 Kan Xu , Hamsa Bastani , Surbhi Goel , Osbert Bastani

We study a noise model for linear stochastic bandits for which the subgaussian noise parameter vanishes linearly as we select actions on the unit sphere closer and closer to the unknown vector. We introduce an algorithm for this problem…

机器学习 · 计算机科学 2025-10-28 Josep Lumbreras , Marco Tomamichel

We study agents communicating over an underlying network by exchanging messages, in order to optimize their individual regret in a common nonstochastic multi-armed bandit problem. We derive regret minimization algorithms that guarantee for…

机器学习 · 计算机科学 2019-11-19 Yogev Bar-On , Yishay Mansour

In this work we first show that the classical Thompson sampling algorithm for multi-arm bandits is differentially private as-is, without any modification. We provide per-round privacy guarantees as a function of problem parameters and show…

机器学习 · 计算机科学 2024-07-23 Tingting Ou , Marco Avella Medina , Rachel Cummings