English
Related papers

Related papers: Solving Linear Programs with Differential Privacy

200 papers

This paper studies the problem of differentially private empirical risk minimization (DP-ERM) for binary linear classification. We obtain an efficient $(\varepsilon,\delta)$-DP algorithm with an empirical zero-one risk bound of…

Machine Learning · Computer Science 2025-06-02 Erchi Wang , Yuqing Zhu , Yu-Xiang Wang

Finding efficient, easily implementable differentially private (DP) algorithms that offer strong excess risk bounds is an important problem in modern machine learning. To date, most work has focused on private empirical risk minimization…

Machine Learning · Computer Science 2024-09-23 Andrew Lowy , Meisam Razaviyayn

Differential privacy and sublinear algorithms are both rapidly emerging algorithmic themes in times of big data analysis. Although recent works have shown the existence of differentially private sublinear algorithms for many problems…

Data Structures and Algorithms · Computer Science 2025-01-15 Jeremiah Blocki , Hendrik Fichtenberger , Elena Grigorescu , Tamalika Mukherjee

We study the canonical statistical estimation problem of linear regression from $n$ i.i.d.~examples under $(\varepsilon,\delta)$-differential privacy when some response variables are adversarially corrupted. We propose a variant of the…

Machine Learning · Computer Science 2023-02-01 Xiyang Liu , Prateek Jain , Weihao Kong , Sewoong Oh , Arun Sai Suggala

The eligibility of various advanced quantum algorithms will be questioned if they can not guarantee privacy. To fill this knowledge gap, here we devise an efficient quantum differentially private (QDP) Lasso estimator to solve sparse…

Quantum Physics · Physics 2022-05-31 Yuxuan Du , Min-Hsiu Hsieh , Tongliang Liu , Shan You , Dacheng Tao

This paper studies \emph{differential privacy (DP)} and \emph{local differential privacy (LDP)} in cascading bandits. Under DP, we propose an algorithm which guarantees $\epsilon$-indistinguishability and a regret of…

Machine Learning · Computer Science 2021-06-07 Kun Wang , Jing Dong , Baoxiang Wang , Shuai Li , Shuo Shao

A new line of work, started with Dwork et al., studies the task of answering statistical queries using a sample and relates the problem to the concept of differential privacy. By the Hoeffding bound, a sample of size $O(\log k/\alpha^2)$…

Machine Learning · Computer Science 2015-11-11 Kobbi Nissim , Uri Stemmer

We study differentially private (DP) algorithms for stochastic convex optimization: the problem of minimizing the population loss given i.i.d. samples from a distribution over convex loss functions. A recent work of Bassily et al. (2019)…

Machine Learning · Computer Science 2020-05-12 Vitaly Feldman , Tomer Koren , Kunal Talwar

Differential privacy mechanisms such as the Gaussian or Laplace mechanism have been widely used in data analytics for preserving individual privacy. However, they are mostly designed for continuous outputs and are unsuitable for scenarios…

Cryptography and Security · Computer Science 2024-06-06 Zhongteng Cai , Xueru Zhang , Mohammad Mahdi Khalili

We consider a high-dimensional stochastic contextual linear bandit problem when the parameter vector is $s_{0}$-sparse and the decision maker is subject to privacy constraints under both central and local models of differential privacy. We…

Machine Learning · Computer Science 2024-02-07 Apurv Shukla

An open problem in differentially private deep learning is hyperparameter optimization (HPO). DP-SGD introduces new hyperparameters and complicates existing ones, forcing researchers to painstakingly tune hyperparameters with hundreds of…

Machine Learning · Computer Science 2024-05-07 Ashwinee Panda , Xinyu Tang , Saeed Mahloujifar , Vikash Sehwag , Prateek Mittal

Differential privacy is becoming a gold standard for privacy research; it offers a guaranteed bound on loss of privacy due to release of query results, even under worst-case assumptions. The theory of differential privacy is an active…

We study $\left(\epsilon,\delta\right)$-differentially private algorithms for the problem of approximately computing the top singular vector of a matrix $A\in\mathbb{R}^{n\times d}$ where each row of $A$ is a data point in $\mathbb{R}^{d}$.…

Data Structures and Algorithms · Computer Science 2026-05-20 Ta Duy Nguyen , Alina Ene , Huy Le Nguyen

Differential privacy schemes have been widely adopted in recent years to address issues of data privacy protection. We propose a new Gaussian scheme combining with another data protection technique, called random orthogonal matrix masking,…

Cryptography and Security · Computer Science 2023-04-13 A. Adam Ding , Samuel S. Wu , Guanhong Miao , Shigang Chen

We give a fast algorithm to optimally compose privacy guarantees of differentially private (DP) algorithms to arbitrary accuracy. Our method is based on the notion of privacy loss random variables to quantify the privacy loss of DP…

Data Structures and Algorithms · Computer Science 2021-10-27 Sivakanth Gopi , Yin Tat Lee , Lukas Wutschitz

We study the problem of Stochastic Convex Optimization (SCO) under the constraint of local Label Differential Privacy (L-LDP). In this setting, the features are considered public, but the corresponding labels are sensitive and must be…

Data Structures and Algorithms · Computer Science 2026-05-12 Lynn Chua , Badih Ghazi , Ravi Kumar , Pasin Manurangsi , Ziteng Sun , Chiyuan Zhang

Given a dataset of $n$ user-contributed strings, each of length at most $\ell$, a key problem is how to identify all frequent substrings while preserving each user's privacy. Recent work by Bernardini et al. (PODS'25) introduced a…

Data Structures and Algorithms · Computer Science 2026-03-11 Peaker Guo , Rayne Holland , Hao Wu

We study the sample complexity of differentially private optimization of quasi-concave functions. For a fixed input domain $\mathcal{X}$, Cohen et al. (STOC 2023) proved that any generic private optimizer for low sensitive quasi-concave…

Cryptography and Security · Computer Science 2025-04-29 Kobbi Nissim , Eliad Tsfadia , Chao Yan

In numerical linear algebra, considerable effort has been devoted to obtaining faster algorithms for linear systems whose underlying matrices exhibit structural properties. A prominent success story is the method of generalized nested…

Data Structures and Algorithms · Computer Science 2023-10-26 Sally Dong , Gramoz Goranci , Lawrence Li , Sushant Sachdeva , Guanghao Ye

The problem of learning threshold functions is a fundamental one in machine learning. Classical learning theory implies sample complexity of $O(\xi^{-1} \log(1/\beta))$ (for generalization error $\xi$ with confidence $1-\beta$). The private…

Machine Learning · Computer Science 2022-11-14 Edith Cohen , Xin Lyu , Jelani Nelson , Tamás Sarlós , Uri Stemmer