English
Related papers

Related papers: Asymptotically optimal private estimation under me…

200 papers

We consider the minimax estimation problem of a discrete distribution with support size $k$ under locally differential privacy constraints. A privatization scheme is applied to each raw sample independently, and we need to estimate the…

Statistics Theory · Mathematics 2018-10-18 Min Ye , Alexander Barg

We consider the minimax estimation problem of a discrete distribution with support size $k$ under privacy constraints. A privatization scheme is applied to each raw sample independently, and we need to estimate the distribution of the raw…

Machine Learning · Computer Science 2017-02-03 Min Ye , Alexander Barg

Differential privacy has become a widely accepted notion of privacy, leading to the introduction and deployment of numerous privatization mechanisms. However, ensuring the privacy guarantee is an error-prone process, both in designing…

Information Theory · Computer Science 2019-05-27 Xiyang Liu , Sewoong Oh

We study the problem of mean estimation of $\ell_2$-bounded vectors under the constraint of local differential privacy. While the literature has a variety of algorithms that achieve the asymptotically optimal rates for this problem, the…

Machine Learning · Computer Science 2022-05-06 Hilal Asi , Vitaly Feldman , Kunal Talwar

We study the fundamental task of estimating the median of an underlying distribution from a finite number of samples, under pure differential privacy constraints. We focus on distributions satisfying the minimal assumption that they have a…

Statistics Theory · Mathematics 2020-11-13 Christos Tzamos , Emmanouil-Vasileios Vlatakis-Gkaragkounis , Ilias Zadik

In this work, we study local minimax convergence estimation rates subject to $\epsilon$-differential privacy. Unlike worst-case rates, which may be conservative, algorithms that are locally minimax optimal must adapt to easy instances of…

Statistics Theory · Mathematics 2022-10-31 Audra McMillan , Adam Smith , Jon Ullman

We study person-level differentially private (DP) mean estimation in the case where each person holds multiple samples. DP here requires the usual notion of distributional stability when $\textit{all}$ of a person's datapoints can be…

Data Structures and Algorithms · Computer Science 2024-07-22 Sushant Agarwal , Gautam Kamath , Mahbod Majid , Argyris Mouzakis , Rose Silver , Jonathan Ullman

We give new upper and lower bounds on the minimax sample complexity of differentially private mean estimation of distributions with bounded $k$-th moments. Roughly speaking, in the univariate case, we show that $n =…

Data Structures and Algorithms · Computer Science 2021-02-17 Gautam Kamath , Vikrant Singhal , Jonathan Ullman

We consider a setup in which confidential i.i.d. samples $X_1,\dotsc,X_n$ from an unknown finite-support distribution $\boldsymbol{p}$ are passed through $n$ copies of a discrete privatization channel (a.k.a. mechanism) producing outputs…

Machine Learning · Computer Science 2018-11-30 Adriano Pastore , Michael Gastpar

We study the fundamental problem of estimating an unknown discrete distribution $p$ over $d$ symbols, given $n$ i.i.d. samples from the distribution. We are interested in minimizing the KL divergence between the true distribution and the…

Machine Learning · Statistics 2025-05-30 Jiayuan Ye , Vitaly Feldman , Kunal Talwar

The simplest and most widely applied method for guaranteeing differential privacy is to add instance-independent noise to a statistic of interest that is scaled to its global sensitivity. However, global sensitivity is a worst-case notion…

Statistics Theory · Mathematics 2019-06-10 Mark Bun , Thomas Steinke

This paper studies the design of an optimal privacyaware estimator of a public random variable based on noisy measurements which contain private information. The public random variable carries non-private information, however, its estimate…

Optimization and Control · Mathematics 2018-08-08 Ehsan Nekouei , Henrik Sandberg , Mikael Skoglund , Karl H. Johansson

Although robust learning and local differential privacy are both widely studied fields of research, combining the two settings is just starting to be explored. We consider the problem of estimating a discrete distribution in total variation…

Statistics Theory · Mathematics 2022-04-21 Julien Chhor , Flore Sentenac

Compressing the output of \epsilon-locally differentially private (LDP) randomizers naively leads to suboptimal utility. In this work, we demonstrate the benefits of using schemes that jointly compress and privatize the data using shared…

Cryptography and Security · Computer Science 2022-03-01 Abhin Shah , Wei-Ning Chen , Johannes Balle , Peter Kairouz , Lucas Theis

We analyze the problem of discrete distribution estimation under $\ell_1$ loss. We provide non-asymptotic upper and lower bounds on the maximum risk of the empirical distribution (the maximum likelihood estimator), and the minimax risk in…

Information Theory · Computer Science 2015-12-31 Yanjun Han , Jiantao Jiao , Tsachy Weissman

We present a sample- and time-efficient differentially private algorithm for ordinary least squares, with error that depends linearly on the dimension and is independent of the condition number of $X^\top X$, where $X$ is the design matrix.…

Machine Learning · Computer Science 2024-04-25 Gavin Brown , Jonathan Hayase , Samuel Hopkins , Weihao Kong , Xiyang Liu , Sewoong Oh , Juan C. Perdomo , Adam Smith

Mean estimation under differential privacy is a fundamental problem, but worst-case optimal mechanisms do not offer meaningful utility guarantees in practice when the global sensitivity is very large. Instead, various heuristics have been…

Cryptography and Security · Computer Science 2021-11-02 Ziyue Huang , Yuting Liang , Ke Yi

Differential privacy is often studied under two different models of neighboring datasets: the add-remove model and the swap model. While the swap model is frequently used in the academic literature to simplify analysis, many practical…

Data Structures and Algorithms · Computer Science 2024-02-21 Alex Kulesza , Ananda Theertha Suresh , Yuyan Wang

Working under a model of privacy in which data remains private even from the statistician, we study the tradeoff between privacy guarantees and the risk of the resulting statistical estimators. We develop private versions of classical…

Statistics Theory · Mathematics 2017-11-16 John Duchi , Martin Wainwright , Michael Jordan

We study the mean estimation problem under communication and local differential privacy constraints. While previous work has proposed \emph{order}-optimal algorithms for the same problem (i.e., asymptotically optimal as we spend more bits),…

Machine Learning · Computer Science 2023-10-31 Berivan Isik , Wei-Ning Chen , Ayfer Ozgur , Tsachy Weissman , Albert No
‹ Prev 1 2 3 10 Next ›