English
Related papers

Related papers: Federated Linear Contextual Bandits with User-leve…

200 papers

In many real-world sequential decision-making problems, an action does not immediately reflect on the feedback and spreads its effects over a long time frame. For instance, in online advertising, investing in a platform produces an…

Machine Learning · Computer Science 2023-05-31 Marco Mussi , Alberto Maria Metelli , Marcello Restelli

Contextual bandit algorithms are commonly used in digital health to recommend personalized treatments. However, to ensure the effectiveness of the treatments, patients are often requested to take actions that have no immediate benefit to…

Machine Learning · Computer Science 2024-03-14 Kyra Gan , Esmaeil Keyvanshokooh , Xueqing Liu , Susan Murphy

Federated learning (FL), a novel branch of distributed machine learning (ML), develops global models through a private procedure without direct access to local datasets. However, it is still possible to access the model updates (gradient…

Machine Learning · Computer Science 2024-06-27 Mahtab Talaei , Iman Izadi

We introduce a locally differentially private (LDP) algorithm for online federated learning that employs temporally correlated noise to improve utility while preserving privacy. To address challenges posed by the correlated noise and local…

Machine Learning · Computer Science 2025-03-13 Jiaojiao Zhang , Linglingzhi Zhu , Dominik Fay , Mikael Johansson

In many modern applications, a system must dynamically choose between several adaptive learning algorithms that are trained online. Examples include model selection in streaming environments, switching between trading strategies in finance,…

Machine Learning · Computer Science 2026-01-19 Ilgam Latypov , Alexandra Suvorikova , Alexey Kroshnin , Alexander Gasnikov , Yuriy Dorn

In this paper we propose a novel framework for decentralized, online learning by many learners. At each moment of time, an instance characterized by a certain context may arrive to each learner; based on the context, the learner can select…

Machine Learning · Computer Science 2015-03-24 Cem Tekin , Mihaela van der Schaar

We design differentially private algorithms for the problem of online linear optimization in the full information and bandit settings with optimal $\tilde{O}(\sqrt{T})$ regret bounds. In the full-information setting, our results demonstrate…

Machine Learning · Computer Science 2017-06-15 Naman Agarwal , Karan Singh

Federated learning is a recent advance in privacy protection. In this context, a trusted curator aggregates parameters optimized in decentralized fashion by multiple clients. The resulting model is then distributed back to all clients,…

Cryptography and Security · Computer Science 2018-03-02 Robin C. Geyer , Tassilo Klein , Moin Nabi

Contextual bandits are a form of multi-armed bandit in which the agent has access to predictive side information (known as the context) for each arm at each time step, and have been used to model personalized news recommendation, ad…

Machine Learning · Statistics 2017-05-25 Aniket Anand Deshmukh , Urun Dogan , Clayton Scott

To prevent inference attacks in Federated Learning (FL) and reduce the leakage of sensitive information, Client-level Differentially Private Federated Learning (CL-DPFL) is widely used. However, current CL-DPFL methods usually result in…

Machine Learning · Computer Science 2025-11-03 Junkang Liu , Yuxuan Tian , Fanhua Shang , Yuanyuan Liu , Hongying Liu , Junchao Zhou , Daorui Ding

In cross-silo federated learning (FL), sensitive text datasets remain confined to local organizations due to privacy regulations, making repeated training for each downstream task both communication-intensive and privacy-demanding. A…

Machine Learning · Computer Science 2026-03-10 Jiayi Wang , John Gounley , Heidi Hanson

In spite that Federated Learning (FL) is well known for its privacy protection when training machine learning models among distributed clients collaboratively, recent studies have pointed out that the naive FL is susceptible to gradient…

Cryptography and Security · Computer Science 2021-01-13 Yao Fu , Yipeng Zhou , Di Wu , Shui Yu , Yonggang Wen , Chao Li

Stochastic linear bandits are a fundamental model for sequential decision making, where an agent selects a vector-valued action and receives a noisy reward with expected value given by an unknown linear function. Although well studied in…

Machine Learning · Computer Science 2025-06-23 Bruce Huang , Ruida Zhou , Lin F. Yang , Suhas Diggavi

Differential privacy (DP) is crucial for safeguarding sensitive client information in federated learning (FL), yet traditional DP-FL methods rely predominantly on fixed gradient clipping thresholds. Such static clipping neglects significant…

Cryptography and Security · Computer Science 2026-03-26 Hao Zhou , Siqi Cai , Hua Dai , Geng Yang , Jing Luo , Hui Cai

In this paper we propose the multi-objective contextual bandit problem with similarity information. This problem extends the classical contextual bandit problem with similarity information by introducing multiple and possibly conflicting…

Machine Learning · Statistics 2018-03-13 Eralp Turğay , Doruk Öner , Cem Tekin

Nowadays, the ubiquitous usage of mobile devices and networks have raised concerns about the loss of control over personal data and research advance towards the trade-off between privacy and utility in scenarios that combine exchange…

Motivated by personalized healthcare and other applications involving sensitive data, we study online exploration in reinforcement learning with differential privacy (DP) constraints. Existing work on this problem established that no-regret…

Machine Learning · Computer Science 2023-02-23 Dan Qiao , Yu-Xiang Wang

In the recent decades, the advance of information technology and abundant personal data facilitate the application of algorithmic personalized pricing. However, this leads to the growing concern of potential violation of privacy due to…

Machine Learning · Statistics 2021-09-13 Xi Chen , Sentao Miao , Yining Wang

Many existing privacy-enhanced speech emotion recognition (SER) frameworks focus on perturbing the original speech data through adversarial training within a centralized machine learning setup. However, this privacy protection scheme can…

Cryptography and Security · Computer Science 2023-04-18 Tiantian Feng , Raghuveer Peri , Shrikanth Narayanan

We consider a sequential assortment selection problem where the user choice is given by a multinomial logit (MNL) choice model whose parameters are unknown. In each period, the learning agent observes a $d$-dimensional contextual…

Machine Learning · Statistics 2021-03-26 Min-hwan Oh , Garud Iyengar