English
Related papers

Related papers: CoinPress: Practical Private Mean and Covariance E…

200 papers

We present two sample-efficient differentially private mean estimators for $d$-dimensional (sub)Gaussian distributions with unknown covariance. Informally, given $n \gtrsim d/\alpha^2$ samples from such a distribution with mean $\mu$ and…

Machine Learning · Computer Science 2024-03-27 Gavin Brown , Marco Gaboardi , Adam Smith , Jonathan Ullman , Lydia Zakynthinou

We present a fast, differentially private algorithm for high-dimensional covariance-aware mean estimation with nearly optimal sample complexity. Only exponential-time estimators were previously known to achieve this guarantee. Given $n$…

Machine Learning · Computer Science 2025-11-26 Gavin Brown , Samuel B. Hopkins , Adam Smith

We give the first polynomial-time, polynomial-sample, differentially private estimator for the mean and covariance of an arbitrary Gaussian distribution $\mathcal{N}(\mu,\Sigma)$ in $\mathbb{R}^d$. All previous estimators are either…

Machine Learning · Statistics 2022-02-15 Gautam Kamath , Argyris Mouzakis , Vikrant Singhal , Thomas Steinke , Jonathan Ullman

We present \textit{universal} estimators for the statistical mean, variance, and scale (in particular, the interquartile range) under pure differential privacy. These estimators are universal in the sense that they work on an arbitrary,…

Cryptography and Security · Computer Science 2023-04-04 Wei Dong , Ke Yi

Mean estimation is a fundamental task in statistics and a focus within differentially private statistical estimation. While univariate methods based on the Gaussian mechanism are widely used in practice, more advanced techniques such as the…

Machine Learning · Computer Science 2025-02-27 Gavin Brown , Lydia Zakynthinou

We study polynomial time algorithms for estimating the mean of a heavy-tailed multivariate random vector. We assume only that the random vector $X$ has finite mean and covariance. In this setting, the radius of confidence intervals achieved…

Statistics Theory · Mathematics 2019-06-05 Samuel B. Hopkins

We provide optimal lower bounds for two well-known parameter estimation (also known as statistical estimation) tasks in high dimensions with approximate differential privacy. First, we prove that for any $\alpha \le O(1)$, estimating the…

Statistics Theory · Mathematics 2024-01-05 Shyam Narayanan

We discuss the possibilities and limitations of estimating the mean of a real-valued random variable from independent and identically distributed observations from a non-asymptotic point of view. In particular, we define estimators with a…

Statistics Theory · Mathematics 2015-09-22 Luc Devroye , Matthieu Lerasle , Gabor Lugosi , Roberto I. Oliveira

We study the problem of estimating the mean of a random vector $X$ given a sample of $N$ independent, identically distributed points. We introduce a new estimator that achieves a purely sub-Gaussian performance under the only condition that…

Statistics Theory · Mathematics 2017-02-03 Gábor Lugosi , Shahar Mendelson

Estimation of the covariance matrix has attracted a lot of attention of the statistical research community over the years, partially due to important applications such as Principal Component Analysis. However, frequently used empirical…

Statistics Theory · Mathematics 2018-06-19 Stanislav Minsker

We present a new quantum algorithm for estimating the mean of a real-valued random variable obtained as the output of a quantum computation. Our estimator achieves a nearly-optimal quadratic speedup over the number of classical i.i.d.…

Quantum Physics · Physics 2021-11-16 Yassine Hamoudi

We study the problem of estimating the mean of a multivariatedistribution based on independent samples. The main result is the proof of existence of an estimator with a non-asymptotic sub-Gaussian performance for all distributions…

Statistics Theory · Mathematics 2016-07-20 Emilien Joly , Gábor Lugosi , Roberto I. Oliveira

We present differentially private algorithms for high-dimensional mean estimation. Previous private estimators on distributions over $\mathbb{R}^d$ suffer from a curse of dimensionality, as they require $\Omega(d^{1/2})$ samples to achieve…

Machine Learning · Computer Science 2024-11-04 Yuval Dagan , Michael I. Jordan , Xuelin Yang , Lydia Zakynthinou , Nikita Zhivotovskiy

We propose the first near-optimal quantum algorithm for estimating in Euclidean norm the mean of a vector-valued random variable with finite mean and covariance. Our result aims at extending the theory of multivariate sub-Gaussian…

Quantum Physics · Physics 2022-07-20 Arjan Cornelissen , Yassine Hamoudi , Sofiene Jerbi

We tackle the problem of estimating a location parameter with differential privacy guarantees and sub-Gaussian deviations. Recent work in statistics has focused on the study of estimators that achieve sub-Gaussian type deviations even for…

Statistics Theory · Mathematics 2019-07-01 Marco Avella-Medina , Victor-Emmanuel Brunel

We develop a univariate, differentially private mean estimator, called the private modified winsorized mean, designed to be used as the aggregator in subsample-and-aggregate. We demonstrate, via real data analysis, that common…

Methodology · Statistics 2025-05-09 Kelly Ramsay , Dylan Spicker

We revisit the problem of estimating the mean of a real-valued distribution, presenting a novel estimator with sub-Gaussian convergence: intuitively, "our estimator, on any distribution, is as accurate as the sample mean is for the Gaussian…

Statistics Theory · Mathematics 2020-11-18 Jasper C. H. Lee , Paul Valiant

The goal of this note is to present a modification of the popular median of means estimator that achieves sub-Gaussian deviation bounds with nearly optimal constants under minimal assumptions on the underlying distribution. We build on a…

Statistics Theory · Mathematics 2023-05-31 Stanislav Minsker

We present a method for producing unbiased parameter estimates and valid confidence intervals under the constraints of differential privacy, a formal framework for limiting individual information leakage from sensitive data. Prior work in…

Methodology · Statistics 2024-02-15 Christian Covington , Xi He , James Honaker , Gautam Kamath

In this work, we give efficient algorithms for privately estimating a Gaussian distribution in both pure and approximate differential privacy (DP) models with optimal dependence on the dimension in the sample complexity. In the pure DP…

Data Structures and Algorithms · Computer Science 2023-06-02 Daniel Alabi , Pravesh K. Kothari , Pranay Tankala , Prayaag Venkat , Fred Zhang
‹ Prev 1 2 3 10 Next ›