English
Related papers

Related papers: Differentially Private High Dimensional Bandits

200 papers

The eligibility of various advanced quantum algorithms will be questioned if they can not guarantee privacy. To fill this knowledge gap, here we devise an efficient quantum differentially private (QDP) Lasso estimator to solve sparse…

Quantum Physics · Physics 2022-05-31 Yuxuan Du , Min-Hsiu Hsieh , Tongliang Liu , Shan You , Dacheng Tao

Contextual bandit algorithms are widely used in domains where it is desirable to provide a personalized service by leveraging contextual information, that may contain sensitive information that needs to be protected. Inspired by this…

Machine Learning · Computer Science 2021-12-14 Evrard Garcelon , Kamalika Chaudhuri , Vianney Perchet , Matteo Pirotta

Contextual multi-armed bandit algorithms are widely used in sequential decision tasks such as news article recommendation systems, web page ad placement algorithms, and mobile health. Most of the existing algorithms have regret proportional…

Machine Learning · Statistics 2020-02-14 Gi-Soo Kim , Myunghee Cho Paik

We present the first algorithms for generalized linear contextual bandits under shuffle differential privacy and joint differential privacy. While prior work on private contextual bandits has been restricted to linear reward models -- which…

Machine Learning · Statistics 2026-04-28 Sahasrajit Sarmasarkar

Motivated by applications of large embedding models, we study differentially private (DP) optimization problems under sparsity of individual gradients. We start with new near-optimal bounds for the classic mean estimation problem but with…

Machine Learning · Computer Science 2024-11-01 Badih Ghazi , Cristóbal Guzmán , Pritish Kamath , Ravi Kumar , Pasin Manurangsi

Differentially Private algorithms often need to select the best amongst many candidate options. Classical works on this selection problem require that the candidates' goodness, measured as a real-valued score function, does not change by…

Data Structures and Algorithms · Computer Science 2018-11-21 Jingcheng Liu , Kunal Talwar

There has been increasing demand for establishing privacy-preserving methodologies for modern statistics and machine learning. Differential privacy, a mathematical notion from computer science, is a rising tool offering robust privacy…

Methodology · Statistics 2024-05-09 Shurong Lin , Elliot Paquette , Eric D. Kolaczyk

We consider cross-silo federated linear contextual bandit (LCB) problem under differential privacy, where multiple silos (agents) interact with the local users and communicate via a central server to realize collaboration while without…

Machine Learning · Computer Science 2023-06-01 Xingyu Zhou , Sayak Ray Chowdhury

In this paper, we revisit the problem of sparse linear regression in the local differential privacy (LDP) model. Existing research in the non-interactive and sequentially local models has focused on obtaining the lower bounds for the case…

Machine Learning · Computer Science 2023-10-12 Liyang Zhu , Meng Ding , Vaneet Aggarwal , Jinhui Xu , Di Wang

We develop a privatised stochastic variational inference method for Latent Dirichlet Allocation (LDA). The iterative nature of stochastic variational inference presents challenges: multiple iterations are required to obtain accurate…

Machine Learning · Statistics 2018-12-05 Mijung Park , James Foulds , Kamalika Chaudhuri , Max Welling

With the development of big data and machine learning, privacy concerns have become increasingly critical, especially when handling heterogeneous datasets containing sensitive personal information. Differential privacy provides a rigorous…

Machine Learning · Statistics 2025-08-08 Ziliang Shen , Caixing Wang , Shaoli Wang , Yibo Yan

We present differentially private algorithms for the stochastic Multi-Armed Bandit (MAB) problem. This is a problem for applications such as adaptive clinical trials, experiment design, and user-targeted advertising where private…

Machine Learning · Statistics 2015-11-30 Aristide Tossou , Christos Dimitrakakis

Differentially private (DP) stochastic convex optimization (SCO) is ubiquitous in trustworthy machine learning algorithm design. This paper studies the DP-SCO problem with streaming data sampled from a distribution and arrives sequentially.…

Machine Learning · Computer Science 2022-06-17 Yuxuan Han , Zhicong Liang , Zhipeng Liang , Yang Wang , Yuan Yao , Jiheng Zhang

We design differentially private algorithms for the bandit convex optimization problem in the projection-free setting. This setting is important whenever the decision set has a complex geometry, and access to it is done efficiently only…

Machine Learning · Computer Science 2020-12-23 Alina Ene , Huy L. Nguyen , Adrian Vladu

We consider a collection of linear stochastic bandit problems, each modeling the random response of different agents to proposed interventions, coupled together by a global safety constraint. We assume a central coordinator must choose…

Optimization and Control · Mathematics 2025-04-24 Arghavan Zibaie , Spencer Hutchinson , Ramtin Pedarsani , Mahnoosh Alizadeh

We study the problem of dynamic batch learning in high-dimensional sparse linear contextual bandits, where a decision maker, under a given maximum-number-of-batch constraint and only able to observe rewards at the end of each batch, can…

Machine Learning · Statistics 2022-07-19 Zhimei Ren , Zhengyuan Zhou

In this paper, we revisit the regret minimization problem in sparse stochastic contextual linear bandits, where feature vectors may be of large dimension $d$, but where the reward function depends on a few, say $s_0\ll d$, of these features…

Machine Learning · Statistics 2022-06-22 Kaito Ariu , Kenshi Abe , Alexandre Proutière

We propose differentially private algorithms for parameter estimation in both low-dimensional and high-dimensional sparse generalized linear models (GLMs) by constructing private versions of projected gradient descent. We show that the…

Machine Learning · Statistics 2020-12-08 T. Tony Cai , Yichen Wang , Linjun Zhang

In this work, we study trade-offs between accuracy and privacy in the context of linear queries over histograms. This is a rich class of queries that includes contingency tables and range queries, and has been a focus of a long line of…

Data Structures and Algorithms · Computer Science 2013-08-05 Aleksandar Nikolov , Kunal Talwar , Li Zhang

The sparse vector technique is a powerful differentially private primitive that allows an analyst to check whether queries in a stream are greater or lesser than a threshold. This technique has a unique property -- the algorithm works by…

Databases · Computer Science 2015-08-31 Yan Chen , Ashwin Machanavajjhala