中文
相关论文

相关论文: Federated Linear Bandits with Finite Adversarial A…

200 篇论文

Modern systems, such as digital platforms and service systems, increasingly rely on contextual bandits for online decision-making; however, their deployment can inadvertently create unfair exposure among arms, undermining long-term platform…

机器学习 · 统计学 2026-02-05 Qingwen Zhang , Wenjia Wang

We study a collaborative multi-agent stochastic linear bandit setting, where $N$ agents that form a network communicate locally to minimize their overall regret. In this setting, each agent has its own linear bandit problem (its own reward…

机器学习 · 计算机科学 2022-05-16 Ahmadreza Moradipari , Mohammad Ghavamzadeh , Mahnoosh Alizadeh

We consider the problem of online learning in misspecified linear stochastic multi-armed bandit problems. Regret guarantees for state-of-the-art linear bandit algorithms such as Optimism in the Face of Uncertainty Linear bandit (OFUL) hold…

机器学习 · 计算机科学 2017-04-25 Avishek Ghosh , Sayak Ray Chowdhury , Aditya Gopalan

Linear bandits have long been a central topic in online learning, with applications ranging from recommendation systems to adaptive clinical trials. Their general learnability has been established when the objective is to minimise the inner…

机器学习 · 统计学 2026-02-18 Lorenzo Croissant

We study the problem of federated stochastic multi-arm contextual bandits with unknown contexts, in which M agents are faced with different bandits and collaborate to learn. The communication model consists of a central server and the…

机器学习 · 计算机科学 2024-01-31 Jiabin Lin , Shana Moothedath

We consider distributed linear bandits where $M$ agents learn collaboratively to minimize the overall cumulative regret incurred by all agents. Information exchange is facilitated by a central server, and both the uplink and downlink…

机器学习 · 计算机科学 2025-11-17 Sudeep Salgia , Qing Zhao

In this paper, we propose differentially private algorithms for the problem of stochastic linear bandits in the central, local and shuffled models. In the central model, we achieve almost the same regret as the optimal non-private…

机器学习 · 计算机科学 2022-07-08 Osama A. Hanna , Antonious M. Girgis , Christina Fragouli , Suhas Diggavi

We consider an adversarial variant of the classic $K$-armed linear contextual bandit problem where the sequence of loss functions associated with each arm are allowed to change without restriction over time. Under the assumption that the…

机器学习 · 计算机科学 2022-05-25 Gergely Neu , Julia Olkhovskaya

Conversational recommender systems have emerged as a potent solution for efficiently eliciting user preferences. These systems interactively present queries associated with "key terms" to users and leverage user feedback to estimate user…

机器学习 · 计算机科学 2024-08-13 Zhuohua Li , Maoli Liu , John C. S. Lui

This paper presents a novel federated linear contextual bandits model, where individual clients face different $K$-armed stochastic bandits coupled through common global parameters. By leveraging the geometric structure of the linear…

机器学习 · 统计学 2021-10-28 Ruiquan Huang , Weiqiang Wu , Jing Yang , Cong Shen

We study the problem of regret minimization for distributed bandits learning, in which $M$ agents work collaboratively to minimize their total regret under the coordination of a central server. Our goal is to design communication protocols…

机器学习 · 计算机科学 2019-05-30 Yuanhao Wang , Jiachen Hu , Xiaoyu Chen , Liwei Wang

We study the linear contextual bandit problem in the presence of adversarial corruption, where the interaction between the player and a possibly infinite decision set is contaminated by an adversary that can corrupt the reward up to a…

机器学习 · 计算机科学 2021-10-26 Heyang Zhao , Dongruo Zhou , Quanquan Gu

Contextual bandit algorithms have been recently studied under the federated learning setting to satisfy the demand of keeping data decentralized and pushing the learning of bandit models to the client side. But limited by the required…

机器学习 · 计算机科学 2022-10-14 Chuanhao Li , Hongning Wang

We study dynamic regret minimization in unconstrained adversarial linear bandit problems. In this setting, a learner must minimize the cumulative loss relative to an arbitrary sequence of comparators…

机器学习 · 计算机科学 2026-03-30 Alberto Rumi , Andrew Jacobsen , Nicolò Cesa-Bianchi , Fabio Vitale

We study linear bandits when the underlying reward function is not linear. Existing work relies on a uniform misspecification parameter $\epsilon$ that measures the sup-norm error of the best linear approximation. This results in an…

机器学习 · 计算机科学 2023-07-21 Chong Liu , Ming Yin , Yu-Xiang Wang

We study the problems of distributed online and bandit convex optimization against an adaptive adversary. We aim to minimize the average regret on $M$ machines working in parallel over $T$ rounds with $R$ intermittent communications.…

机器学习 · 计算机科学 2023-11-30 Kumar Kshitij Patel , Lingxiao Wang , Aadirupa Saha , Nati Sebro

The contextual combinatorial semi-bandit problem with linear payoff functions is a decision-making problem in which a learner chooses a set of arms with the feature vectors in each round under given constraints so as to maximize the sum of…

Contextual bandit with linear reward functions is among one of the most extensively studied models in bandit and online learning research. Recently, there has been increasing interest in designing \emph{locally private} linear contextual…

机器学习 · 统计学 2024-04-16 Jiachun Li , David Simchi-Levi , Yining Wang

Dueling bandits is a prominent framework for decision-making involving preferential feedback, a valuable feature that fits various applications involving human interaction, such as ranking, information retrieval, and recommendation systems.…

机器学习 · 计算机科学 2024-10-16 Qiwei Di , Tao Jin , Yue Wu , Heyang Zhao , Farzad Farnoud , Quanquan Gu

In this paper, we propose and study opportunistic contextual bandits - a special case of contextual bandits where the exploration cost varies under different environmental conditions, such as network load or return variation in…

机器学习 · 计算机科学 2019-05-29 Xueying Guo , Xiaoxiao Wang , Xin Liu