English
Related papers

Related papers: Finite Sample Differentially Private Confidence In…

200 papers

We provide a differentially private algorithm for hypothesis selection. Given samples from an unknown probability distribution $P$ and a set of $m$ probability distributions $\mathcal{H}$, the goal is to output, in a…

Data Structures and Algorithms · Computer Science 2021-01-05 Mark Bun , Gautam Kamath , Thomas Steinke , Zhiwei Steven Wu

Sampling schemes are fundamental tools in statistics, survey design, and algorithm design. A fundamental result in differential privacy is that a differentially private mechanism run on a simple random sample of a population provides…

Methodology · Statistics 2023-06-23 Mark Bun , Jörg Drechsler , Marco Gaboardi , Audra McMillan , Jayshree Sarathy

In recent years, differential privacy has emerged as the de facto standard for sharing statistics of datasets while limiting the disclosure of private information about the involved individuals. This is achieved by randomly perturbing the…

Cryptography and Security · Computer Science 2024-12-18 Aras Selvi , Huikang Liu , Wolfram Wiesemann

We show a new lower bound on the sample complexity of $(\varepsilon, \delta)$-differentially private algorithms that accurately answer statistical queries on high-dimensional databases. The novelty of our bound is that it depends optimally…

Data Structures and Algorithms · Computer Science 2015-01-27 Thomas Steinke , Jonathan Ullman

We study the problem of learning exponential distributions under differential privacy. Given $n$ i.i.d.\ samples from $\mathrm{Exp}(\lambda)$, the goal is to privately estimate $\lambda$ so that the learned distribution is close in total…

Data Structures and Algorithms · Computer Science 2026-03-31 Bar Mahpud , Or Sheffet

In recent years, differential privacy has been adopted by tech-companies and governmental agencies as the standard for measuring privacy in algorithms. In this article, we study differential privacy in Bayesian posterior sampling settings.…

Statistics Theory · Mathematics 2026-02-13 Shenggang Hu , Louis Aslett , Hongsheng Dai , Murray Pollock , Gareth O. Roberts

We provide a detailed study of the estimation of probability distributions---discrete and continuous---in a stringent setting in which data is kept private even from the statistician. We give sharp minimax rates of convergence for…

Statistics Theory · Mathematics 2013-05-28 John C. Duchi , Michael I. Jordan , Martin J. Wainwright

Ranking populations such as institutions based on certain characteristics is often of interest, and these ranks are typically estimated using samples drawn from the populations. Due to sample randomness, it is important to quantify the…

Methodology · Statistics 2025-12-08 Onrina Chandra , Min-ge Xie

Working under a model of privacy in which data remains private even from the statistician, we study the tradeoff between privacy guarantees and the utility of the resulting statistical estimators. We prove bounds on information-theoretic…

Statistics Theory · Mathematics 2014-08-28 John C. Duchi , Michael I. Jordan , Martin J. Wainwright

Many data producers seek to provide users access to confidential data without unduly compromising data subjects' privacy and confidentiality. One general strategy is to require users to do analyses without seeing the confidential data; for…

Methodology · Statistics 2018-06-12 Andrés F. Barrientos , Jerome P. Reiter , Ashwin Machanavajjhala , Yan Chen

We lay theoretical foundations for new database release mechanisms that allow third-parties to construct consistent estimators of population statistics, while ensuring that the privacy of each individual contributing to the database is…

Machine Learning · Statistics 2018-06-01 Matej Balog , Ilya Tolstikhin , Bernhard Schölkopf

A key challenge in many modern data analysis tasks is that user data are heterogeneous. Different users may possess vastly different numbers of data points. More importantly, it cannot be assumed that all users sample from the same…

Cryptography and Security · Computer Science 2023-08-01 Rachel Cummings , Vitaly Feldman , Audra McMillan , Kunal Talwar

This work investigates the impact of ensuring local differential privacy in the thresholding bandit problem. We consider both the fixed budget and fixed confidence settings. We propose methods that utilize private responses, obtained…

Machine Learning · Computer Science 2025-08-26 Annalisa Barbara , Joseph Lazzaro , Ciara Pike-Burke

Differential privacy formalises privacy-preserving mechanisms that provide access to a database. We pose the question of whether Bayesian inference itself can be used directly to provide private access to data, with no modification. The…

We develop both theory and algorithms to analyze privatized data in unbounded differential privacy (DP), where even the sample size is considered a sensitive quantity that requires privacy protection. We show that the distance between the…

Statistics Theory · Mathematics 2026-04-24 Jordan Awan , Andres Felipe Barrientos , Nianqiao Ju

The widespread acceptance of differential privacy has led to the publication of many sophisticated algorithms for protecting privacy. However, due to the subtle nature of this privacy definition, many such algorithms have bugs that make…

Cryptography and Security · Computer Science 2019-09-09 Zeyu Ding , Yuxin Wang , Guanhong Wang , Danfeng Zhang , Daniel Kifer

Federated analytics seeks to compute accurate statistics from data distributed across users' devices while providing a suitable privacy guarantee and being practically feasible to implement and scale. In this paper, we show how a strong…

Cryptography and Security · Computer Science 2022-03-10 Akash Bharadwaj , Graham Cormode

Although applications of Bayesian analysis for numerical quadrature problems have been considered before, it's only very recently that statisticians have focused on the connections between statistics and numerical analysis of differential…

Computation · Statistics 2017-10-03 Majnu John , Yihren Wu

Differential Privacy can provide provable privacy guarantees for training data in machine learning. However, the presence of proofs does not preclude the presence of errors. Inspired by recent advances in auditing which have been used for…

Machine Learning · Computer Science 2022-03-29 Florian Tramer , Andreas Terzis , Thomas Steinke , Shuang Song , Matthew Jagielski , Nicholas Carlini

For scalable machine learning on large data sets, subsampling a representative subset is a common approach for efficient model training. This is often achieved through importance sampling, whereby informative data points are sampled more…

Cryptography and Security · Computer Science 2025-03-31 Dominik Fay , Sebastian Mair , Jens Sjölund