中文
相关论文

相关论文: Federated Multi-armed Bandits with Personalization

200 篇论文

We consider cross-silo federated linear contextual bandit (LCB) problem under differential privacy, where multiple silos (agents) interact with the local users and communicate via a central server to realize collaboration while without…

机器学习 · 计算机科学 2023-06-01 Xingyu Zhou , Sayak Ray Chowdhury

Internet of Things (IoT) systems increasingly operate in environments where devices must respond in real time while managing fluctuating resource constraints, including energy and bandwidth. Yet, current approaches often fall short in…

机器学习 · 计算机科学 2026-03-26 Shubham Vaishnav , Praveen Kumar Donta , Sindri Magnússon

Motivated by privacy concerns in sequential decision-making on sensitive data, we address the challenge of nonparametric contextual multi-armed bandits (MAB) under local differential privacy (LDP). We develop a uniform-confidence-bound-type…

机器学习 · 统计学 2025-03-26 Yuheng Ma , Feiyu Jiang , Zifeng Zhao , Hanfang Yang , Yi Yu

Multi-armed bandit(MAB) problem is a reinforcement learning framework where an agent tries to maximise her profit by proper selection of actions through absolute feedback for each action. The dueling bandits problem is a variation of MAB…

机器学习 · 计算机科学 2019-02-08 Nischal Agrawal , Prasanna Chaporkar

In recent years, multi-armed bandit (MAB) framework has attracted a lot of attention in various applications, from recommender systems and information retrieval to healthcare and finance, due to its stellar performance combined with certain…

机器学习 · 计算机科学 2019-04-24 Djallel Bouneffouf , Irina Rish

We study replicable algorithms for stochastic multi-armed bandits (MAB) and linear bandits with UCB (Upper Confidence Bound) based exploration. A bandit algorithm is $\rho$-replicable if two executions using shared internal randomness but…

机器学习 · 计算机科学 2026-04-23 Rohan Deb , Udaya Ghai , Karan Singh , Arindam Banerjee

In this paper, we propose and evaluate different learning strategies based on Multi-Arm Bandit (MAB) algorithms. They allow Internet of Things (IoT) devices to improve their access to the network and their autonomy, while taking into…

网络与互联网体系结构 · 计算机科学 2019-02-28 Remi Bonnefoi , Lilian Besson , Julio Manco-Vasquez , Christophe Moy

Motivated by applications in cognitive radio networks, we consider the decentralized multi-player multi-armed bandit problem, without collision nor sensing information. We propose Randomized Selfish KL-UCB, an algorithm with very low…

机器学习 · 计算机科学 2021-02-23 Cindy Trinh , Richard Combes

In this paper, we investigate a new multi-armed bandit (MAB) online learning model that considers real-world phenomena in many recommender systems: (i) the learning agent cannot pull the arms by itself and thus has to offer rewards to users…

机器学习 · 计算机科学 2021-06-01 Tianchen Zhou , Jia Liu , Chaosheng Dong , Jingyuan Deng

The multi-armed bandits' framework is the most common platform to study strategies for sequential decision-making problems. Recently, the notion of fairness has attracted a lot of attention in the machine learning community. One can impose…

机器学习 · 计算机科学 2020-12-25 Shaarad A. R , Ambedkar Dukkipati

We introduce in this paper a new algorithm for Multi-Armed Bandit (MAB) problems. A machine learning paradigm popular within Cognitive Network related topics (e.g., Spectrum Sensing and Allocation). We focus on the case where the rewards…

机器学习 · 统计学 2012-04-10 Wassim Jouini , Christophe Moy

Many real-world bandit problems involve non-stationary reward distributions, where the optimal decision may shift due to evolving environments. However, the performance of some typical Multi-Armed Bandit (MAB) models such as Upper…

机器学习 · 计算机科学 2025-11-25 Minxin Chen

Federated learning is a decentralized and privacy-preserving technique that enables multiple clients to collaborate with a server to learn a global model without exposing their private data. However, the presence of statistical…

机器学习 · 计算机科学 2023-07-06 Shiyu Liu , Shaogao Lv , Dun Zeng , Zenglin Xu , Hui Wang , Yue Yu

The availability of multiple training algorithms and architectures for generative models requires a selection mechanism to form a single model over a group of well-trained generation models. The selection task is commonly addressed by…

机器学习 · 计算机科学 2025-03-25 Parham Rezaei , Farzan Farnia , Cheuk Ting Li

We study the constrained variant of the \emph{multi-armed bandit} (MAB) problem, in which the learner aims not only at minimizing the total loss incurred during the learning dynamic, but also at controlling the violation of multiple…

Federated Learning (FL) is a technique that allows multiple parties to train a shared model collaboratively without disclosing their private data. It has become increasingly popular due to its distinct privacy advantages. However, FL models…

机器学习 · 计算机科学 2024-10-04 Syed Irfan Ali Meerza , Jian Liu

The problem of multi-armed bandits (MAB) asks to make sequential decisions while balancing between exploitation and exploration, and have been successfully applied to a wide range of practical scenarios. Various algorithms have been…

机器学习 · 计算机科学 2022-02-24 Xiaojin Zhang , Shuai Li , Weiwen Liu , Shengyu Zhang

Upper Confidence Bound (UCB) algorithms are a widely-used class of sequential algorithms for the $K$-armed bandit problem. Despite extensive research over the past decades aimed at understanding their asymptotic and (near) minimax…

统计理论 · 数学 2024-12-10 Qiyang Han , Koulik Khamaru , Cun-Hui Zhang

In this paper, we study the multi-objective bandits (MOB) problem, where a learner repeatedly selects one arm to play and then receives a reward vector consisting of multiple objectives. MOB has found many real-world applications as varied…

机器学习 · 计算机科学 2019-05-31 Shiyin Lu , Guanghui Wang , Yao Hu , Lijun Zhang

Bandit algorithms have various application in safety-critical systems, where it is important to respect the system constraints that rely on the bandit's unknown parameters at every round. In this paper, we formulate a linear stochastic…

机器学习 · 计算机科学 2019-08-19 Sanae Amani , Mahnoosh Alizadeh , Christos Thrampoulidis