English
Related papers

Related papers: New Lower Bounds for Private Estimation and a Gene…

200 papers

We present differentially private algorithms for high-dimensional mean estimation. Previous private estimators on distributions over $\mathbb{R}^d$ suffer from a curse of dimensionality, as they require $\Omega(d^{1/2})$ samples to achieve…

Machine Learning · Computer Science 2024-11-04 Yuval Dagan , Michael I. Jordan , Xuelin Yang , Lydia Zakynthinou , Nikita Zhivotovskiy

We describe Bayesian inference for the parameters of Gaussian models of bounded data protected by differential privacy. Using this setting, we demonstrate that analysts can and should take constraints imposed by the bounds into account when…

Methodology · Statistics 2024-10-18 Zeki Kazan , Jerome P. Reiter

We provide computationally efficient, differentially private algorithms for the classical regression settings of Least Squares Fitting, Binary Regression and Linear Regression with unbounded covariates. Prior to our work, privacy…

Cryptography and Security · Computer Science 2022-02-24 Jason Milionis , Alkis Kalavasis , Dimitris Fotakis , Stratis Ioannidis

The most effective differentially private machine learning algorithms in practice rely on an additional source of purportedly public data. This paradigm is most interesting when the two sources combine to be more than the sum of their…

Machine Learning · Computer Science 2025-07-25 Amrith Setlur , Pratiksha Thaker , Jonathan Ullman

We consider distributed parameter estimation using interactive protocols subject to local information constraints such as bandwidth limitations, local differential privacy, and restricted measurements. We provide a unified framework…

Data Structures and Algorithms · Computer Science 2022-11-17 Jayadev Acharya , Clément L. Canonne , Ziteng Sun , Himanshu Tyagi

We consider the task of constructing confidence intervals with differential privacy. We propose two private variants of the non-parametric bootstrap, which privately compute the median of the results of multiple "little" bootstraps run on…

Machine Learning · Statistics 2024-06-05 Karan Chadha , John Duchi , Rohith Kuditipudi

We present simple differentially private estimators for the mean and covariance of multivariate sub-Gaussian data that are accurate at small sample sizes. We demonstrate the effectiveness of our algorithms both theoretically and empirically…

Machine Learning · Statistics 2026-02-10 Sourav Biswas , Yihe Dong , Gautam Kamath , Jonathan Ullman

Working under a model of privacy in which data remains private even from the statistician, we study the tradeoff between privacy guarantees and the utility of the resulting statistical estimators. We prove bounds on information-theoretic…

Statistics Theory · Mathematics 2014-08-28 John C. Duchi , Michael I. Jordan , Martin J. Wainwright

The laws of quantum mechanics place fundamental limits on the accuracy of measurements and therefore on the estimation of unknown parameters of a quantum system. In this work, we prove lower bounds on the size of confidence regions reported…

Quantum Physics · Physics 2014-12-23 Michael Walter , Joseph M. Renes

We investigate unbiased high-dimensional mean estimators in differential privacy. We consider differentially private mechanisms whose expected output equals the mean of the input dataset, for every dataset drawn from a fixed bounded…

Statistics Theory · Mathematics 2023-12-22 Aleksandar Nikolov , Haohua Tang

We prove a general lower bound for differentially private federated learning protocols with arbitrary public-transcript interactions. The protocol may use any number of adaptive rounds, and each client's local samples may be reused across…

Machine Learning · Computer Science 2026-05-20 Yicheng Li

In this paper we study the problem of estimating the unknown mean $\theta$ of a unit variance Gaussian distribution in a locally differentially private (LDP) way. In the high-privacy regime ($\epsilon\le 1$), we identify an optimal privacy…

Statistics Theory · Mathematics 2025-03-06 Nikita P. Kalinin , Lukas Steinberger

We design an $(\varepsilon, \delta)$-differentially private algorithm to estimate the mean of a $d$-variate distribution, with unknown covariance $\Sigma$, that is adaptive to $\Sigma$. To within polylogarithmic factors, the estimator…

Machine Learning · Statistics 2023-01-18 John Duchi , Saminul Haque , Rohith Kuditipudi

Differential privacy guarantees allow the results of a statistical analysis involving sensitive data to be released without compromising the privacy of any individual taking part. Achieving such guarantees generally requires the injection…

Machine Learning · Statistics 2023-10-31 Jack Jewson , Sahra Ghalebikesabi , Chris Holmes

We develop a near-optimal testing procedure under the framework of Gaussian differential privacy for simple as well as one- and two-sided tests under monotone likelihood ratio conditions. Our mechanism is based on a private mean estimator…

Machine Learning · Statistics 2026-01-30 Yu-Wei Chen , Raghu Pasupathy , Jordan Awan

We study the problem of estimating finite sample confidence intervals of the mean of a normal population under the constraint of differential privacy. We consider both the known and unknown variance cases and construct differentially…

Cryptography and Security · Computer Science 2017-11-13 Vishesh Karwa , Salil Vadhan

Adding random noise to database query results is an important tool for achieving privacy. A challenge is to minimize this noise while still meeting privacy requirements. Recently, a sufficient and necessary condition for $(\epsilon,…

Cryptography and Security · Computer Science 2026-01-28 Staal A. Vinterbo

We provide improved differentially private algorithms for identity testing of high-dimensional distributions. Specifically, for $d$-dimensional Gaussian distributions with known covariance $\Sigma$, we can test whether the distribution…

Data Structures and Algorithms · Computer Science 2022-07-26 Shyam Narayanan

We provide the first $\widetilde{\mathcal{O}}\left(d\right)$-sample algorithm for sampling from unbounded Gaussian distributions under the constraint of $\left(\varepsilon, \delta\right)$-differential privacy. This is a quadratic…

Data Structures and Algorithms · Computer Science 2025-03-04 Valentio Iverson , Gautam Kamath , Argyris Mouzakis

We study the problem of estimating mixtures of Gaussians under the constraint of differential privacy (DP). Our main result is that $\text{poly}(k,d,1/\alpha,1/\varepsilon,\log(1/\delta))$ samples are sufficient to estimate a mixture of $k$…

Machine Learning · Statistics 2024-04-24 Mohammad Afzali , Hassan Ashtiani , Christopher Liaw