中文
相关论文

相关论文: Robust and differentially private stochastic linea…

200 篇论文

We consider the standard $K$-armed bandit problem under a distributed trust model of differential privacy (DP), which enables to guarantee privacy without a trustworthy server. Under this trust model, previous work largely focus on…

机器学习 · 计算机科学 2022-06-14 Sayak Ray Chowdhury , Xingyu Zhou

We study the multi-player stochastic multiarmed bandit (MAB) problem in an abruptly changing environment. We consider a collision model in which a player receives reward at an arm if it is the only player to select the arm. We design two…

机器学习 · 统计学 2018-12-14 Lai Wei , Vaibhav Srivastava

Adversarial attacks against stochastic multi-armed bandit (MAB) algorithms have been extensively studied in the literature. In this work, we focus on reward poisoning attacks and find most existing attacks can be easily detected by our…

机器学习 · 计算机科学 2024-02-22 Zhiwei Wang , Huazheng Wang , Hongning Wang

Decision-making under uncertainty is a fundamental problem encountered frequently and can be formulated as a stochastic multi-armed bandit problem. In the problem, the learner interacts with an environment by choosing an action at each…

机器学习 · 统计学 2024-05-24 Jonathan Gornet , Bruno Sinopoli

Bandit algorithms are guaranteed to solve diverse sequential decision-making problems, provided that a sufficient exploration budget is available. However, learning from scratch is often too costly for personalization tasks where a single…

机器学习 · 计算机科学 2025-08-08 Newton Mwai , Emil Carlsson , Fredrik D. Johansson

We study the multi-armed bandit problem where the rewards are realizations of general non-stationary stochastic processes, a setting that generalizes many existing lines of work and analyses. In particular, we present a theoretical analysis…

机器学习 · 计算机科学 2020-09-04 Corinna Cortes , Giulia DeSalvo , Vitaly Kuznetsov , Mehryar Mohri , Scott Yang

We study the problem of multi-agent reinforcement learning (multi-agent RL) with differential privacy (DP) constraints. This is well-motivated by various real-world applications involving sensitive data, where it is critical to protect…

机器学习 · 计算机科学 2024-04-12 Dan Qiao , Yu-Xiang Wang

We study a decentralized cooperative stochastic multi-armed bandit problem with $K$ arms on a network of $N$ agents. In our model, the reward distribution of each arm is the same for each agent and rewards are drawn independently across…

机器学习 · 计算机科学 2019-10-25 David Martínez-Rubio , Varun Kanade , Patrick Rebeschini

Differential Privacy (DP) provides a rigorous framework for privacy, ensuring the outputs of data-driven algorithms remain statistically indistinguishable across datasets that differ in a single entry. While guaranteeing DP generally…

机器学习 · 计算机科学 2025-10-17 Yizhou Zhang , Kishan Panaganti , Laixi Shi , Juba Ziani , Adam Wierman

We consider the well-studied dueling bandit problem, where a learner aims to identify near-optimal actions using pairwise comparisons, under the constraint of differential privacy. We consider a general class of utility-based preference…

机器学习 · 计算机科学 2024-03-25 Aadirupa Saha , Hilal Asi

We present the first algorithms for generalized linear contextual bandits under shuffle differential privacy and joint differential privacy. While prior work on private contextual bandits has been restricted to linear reward models -- which…

机器学习 · 统计学 2026-04-28 Sahasrajit Sarmasarkar

In the classical multi-armed bandit problem, d arms are available to the decision maker who pulls them sequentially in order to maximize his cumulative reward. Guarantees can be obtained on a relative quantity called regret, which scales…

机器学习 · 计算机科学 2017-06-06 Joon Kwon , Vianney Perchet , Claire Vernade

Data that is gathered adaptively --- via bandit algorithms, for example --- exhibits bias. This is true both when gathering simple numeric valued data --- the empirical means kept track of by stochastic bandit algorithms are biased…

机器学习 · 计算机科学 2018-06-07 Seth Neel , Aaron Roth

We study private and robust multi-armed bandits (MABs), where the agent receives Huber's contaminated heavy-tailed rewards and meanwhile needs to ensure differential privacy. We first present its minimax lower bound, characterizing the…

机器学习 · 计算机科学 2023-03-07 Yulian Wu , Xingyu Zhou , Youming Tao , Di Wang

We study finite-armed stochastic bandits where the rewards of each arm might be correlated to those of other arms. We introduce a novel phased algorithm that exploits the given structure to build confidence sets over the parameters of the…

机器学习 · 计算机科学 2020-05-26 Andrea Tirinzoni , Alessandro Lazaric , Marcello Restelli

Malicious adversaries can attack machine learning models to infer sensitive information or damage the system by launching a series of evasion attacks. Although various work addresses privacy and security concerns, they focus on individual…

机器学习 · 计算机科学 2024-01-22 Janvi Thakkar , Giulio Zizzo , Sergio Maffeis

We explore a novel setting of the Multi-Armed Bandit (MAB) problem inspired from real world applications which we call bandits with "stochastic delayed composite anonymous feedback (SDCAF)". In SDCAF, the rewards on pulling arms are…

机器学习 · 计算机科学 2019-10-14 Siddhant Garg , Aditya Kumar Akash

This paper investigates the problem of best arm identification in $\textit{contaminated}$ stochastic multi-arm bandits. In this setting, the rewards obtained from any arm are replaced by samples from an adversarial model with probability…

机器学习 · 计算机科学 2021-11-16 Arpan Mukherjee , Ali Tajer , Pin-Yu Chen , Payel Das

In the multiarmed bandit problem a gambler chooses an arm of a slot machine to pull considering a tradeoff between exploration and exploitation. We study the stochastic bandit problem where each arm has a reward distribution supported in a…

统计理论 · 数学 2013-03-29 Junya Honda , Akimichi Takemura

In this paper, we investigate a largely extended version of classical MAB problem, called networked combinatorial bandit problems. In particular, we consider the setting of a decision maker over a networked bandits as follows: each time a…

机器学习 · 计算机科学 2015-03-23 Shaojie Tang , Yaqin Zhou