English
Related papers

Related papers: Private Mean Estimation with Person-Level Differen…

200 papers

Data privacy is an important concern in learning, when datasets contain sensitive information about individuals. This paper considers consensus-based distributed optimization under data privacy constraints. Consensus-based optimization…

Machine Learning · Computer Science 2019-03-20 Mehrdad Showkatbakhsh , Can Karakus , Suhas Diggavi

The concept of differential privacy (DP) can quantitatively measure privacy loss by observing the changes in the distribution caused by the inclusion of individuals in the target dataset. The DP, which is generally used as a constraint, has…

Cryptography and Security · Computer Science 2025-07-16 Sehyun Ryu , Jonggyu Jang , Hyun Jong Yang

We initiate an investigation of private sampling from distributions. Given a dataset with $n$ independent observations from an unknown distribution $P$, a sampling algorithm must output a single observation from a distribution that is close…

Machine Learning · Computer Science 2022-11-16 Sofya Raskhodnikova , Satchit Sivakumar , Adam Smith , Marika Swanberg

Differential privacy (DP) is the prevailing technique for protecting user data in machine learning models. However, deficits to this framework include a lack of clarity for selecting the privacy budget $\epsilon$ and a lack of…

Machine Learning · Computer Science 2023-06-29 Tyler LeBlond , Joseph Munoz , Fred Lu , Maya Fuchs , Elliott Zaresky-Williams , Edward Raff , Brian Testa

Local differential privacy (LDP) is increasingly employed in privacy-preserving machine learning to protect user data before sharing it with an untrusted aggregator. Most LDP methods assume that users possess only a single data record,…

Machine Learning · Computer Science 2025-05-05 Behnoosh Zamanlooy , Mario Diaz , Shahab Asoodeh

We study the fundamental problems of identity testing (goodness of fit), and closeness testing (two sample test) of distributions over $k$ elements, under differential privacy. While the problems have a long history in statistics, finite…

Machine Learning · Computer Science 2017-11-01 Jayadev Acharya , Ziteng Sun , Huanyu Zhang

Mean estimation under differential privacy is a fundamental problem, but worst-case optimal mechanisms do not offer meaningful utility guarantees in practice when the global sensitivity is very large. Instead, various heuristics have been…

Cryptography and Security · Computer Science 2021-11-02 Ziyue Huang , Yuting Liang , Ke Yi

In this brief, we present an enhanced privacy-preserving distributed estimation algorithm, referred to as the ``Double-Private Algorithm," which combines the principles of both differential privacy (DP) and cryptography. The proposed…

Signal Processing · Electrical Eng. & Systems 2024-03-19 Mehdi Korki , Fatemehsadat Hosseiniamin , Hadi Zayyani , Mehdi Bekrani

We give the first polynomial time and sample $(\epsilon, \delta)$-differentially private (DP) algorithm to estimate the mean, covariance and higher moments in the presence of a constant fraction of adversarial outliers. Our algorithm…

Machine Learning · Statistics 2021-12-08 Pravesh K. Kothari , Pasin Manurangsi , Ameya Velingker

Differentially private (DP) mechanisms have been deployed in a variety of high-impact social settings (perhaps most notably by the U.S. Census). Since all DP mechanisms involve adding noise to results of statistical queries, they are…

Cryptography and Security · Computer Science 2023-12-20 Lucas Rosenblatt , Julia Stoyanovich , Christopher Musco

Differential privacy (DP) is the de facto notion of privacy both in theory and in practice. However, despite its popularity, DP imposes strict requirements which guard against strong worst-case scenarios. For example, it guards against…

Data Structures and Algorithms · Computer Science 2025-12-01 Guy Blanc , William Pires , Toniann Pitassi

We provide optimal lower bounds for two well-known parameter estimation (also known as statistical estimation) tasks in high dimensions with approximate differential privacy. First, we prove that for any $\alpha \le O(1)$, estimating the…

Statistics Theory · Mathematics 2024-01-05 Shyam Narayanan

Differential privacy is achieved by the introduction of Laplacian noise in the response to a query, establishing a precise trade-off between the level of differential privacy and the accuracy of the database response (via the amount of…

Cryptography and Security · Computer Science 2015-10-06 Maurizio Naldi , Giuseppe D'Acquisto

Differential Privacy (DP) is a rigorous privacy standard widely adopted in data analysis and machine learning. However, its guarantees rely on correctly introducing randomized noise--an assumption that may not hold if the implementation is…

Cryptography and Security · Computer Science 2025-08-07 Hyukjun Kwon , Chenglin Fan

Differential privacy (DP) is a widely-accepted and widely-applied notion of privacy based on worst-case analysis. Often, DP classifies most mechanisms without additive noise as non-private (Dwork et al., 2014). Thus, additive noises are…

Cryptography and Security · Computer Science 2023-12-14 Ao Liu , Yu-Xiang Wang , Lirong Xia

We present differentially private algorithms for high-dimensional mean estimation. Previous private estimators on distributions over $\mathbb{R}^d$ suffer from a curse of dimensionality, as they require $\Omega(d^{1/2})$ samples to achieve…

Machine Learning · Computer Science 2024-11-04 Yuval Dagan , Michael I. Jordan , Xuelin Yang , Lydia Zakynthinou , Nikita Zhivotovskiy

We develop both theory and algorithms to analyze privatized data in unbounded differential privacy (DP), where even the sample size is considered a sensitive quantity that requires privacy protection. We show that the distance between the…

Statistics Theory · Mathematics 2026-04-24 Jordan Awan , Andres Felipe Barrientos , Nianqiao Ju

Differential privacy guarantees allow the results of a statistical analysis involving sensitive data to be released without compromising the privacy of any individual taking part. Achieving such guarantees generally requires the injection…

Machine Learning · Statistics 2023-10-31 Jack Jewson , Sahra Ghalebikesabi , Chris Holmes

This work examines a novel question: how much randomness is needed to achieve local differential privacy (LDP)? A motivating scenario is providing {\em multiple levels of privacy} to multiple analysts, either for distribution or for…

Cryptography and Security · Computer Science 2020-05-26 Antonious M. Girgis , Deepesh Data , Kamalika Chaudhuri , Christina Fragouli , Suhas Diggavi

The process of data mining with differential privacy produces results that are affected by two types of noise: sampling noise due to data collection and privacy noise that is designed to prevent the reconstruction of sensitive information.…

Machine Learning · Computer Science 2018-04-12 Yue Wang , Daniel Kifer , Jaewoo Lee