English
Related papers

Related papers: Private Hypothesis Selection

200 papers

In this paper we demonstrate that, ignoring computational constraints, it is possible to privately release synthetic databases that are useful for large classes of queries -- much larger in size than the database itself. Specifically, we…

Data Structures and Algorithms · Computer Science 2011-09-13 Avrim Blum , Katrina Ligett , Aaron Roth

Motivated by growing concerns over ensuring privacy on social networks, we develop new algorithms and impossibility results for fitting complex statistical models to network data subject to rigorous privacy guarantees. We consider the…

Statistics Theory · Mathematics 2018-10-05 Christian Borgs , Jennifer Chayes , Adam Smith , Ilias Zadik

We provide the first $\widetilde{\mathcal{O}}\left(d\right)$-sample algorithm for sampling from unbounded Gaussian distributions under the constraint of $\left(\varepsilon, \delta\right)$-differential privacy. This is a quadratic…

Data Structures and Algorithms · Computer Science 2025-03-04 Valentio Iverson , Gautam Kamath , Argyris Mouzakis

We develop both theory and algorithms to analyze privatized data in unbounded differential privacy (DP), where even the sample size is considered a sensitive quantity that requires privacy protection. We show that the distance between the…

Statistics Theory · Mathematics 2026-04-24 Jordan Awan , Andres Felipe Barrientos , Nianqiao Ju

Algorithms are now routinely used to make consequential decisions that affect human lives. Examples include college admissions, medical interventions or law enforcement. While algorithms empower us to harness all information hidden in vast…

Machine Learning · Computer Science 2020-12-10 Bahar Taskesen , Jose Blanchet , Daniel Kuhn , Viet Anh Nguyen

We consider the problem of learning a discrete distribution in the presence of an $\epsilon$ fraction of malicious data sources. Specifically, we consider the setting where there is some underlying distribution, $p$, and each data source…

Machine Learning · Computer Science 2017-11-23 Mingda Qiao , Gregory Valiant

We consider a refinement of differential privacy --- per instance differential privacy (pDP), which captures the privacy of a specific individual with respect to a fixed data set. We show that this is a strict generalization of the standard…

Machine Learning · Statistics 2018-11-15 Yu-Xiang Wang

Differential privacy is becoming one gold standard for protecting the privacy of publicly shared data. It has been widely used in social science, data science, public health, information technology, and the U.S. decennial census.…

Cryptography and Security · Computer Science 2022-06-07 Xuan Bi , Xiaotong Shen

We consider PAC learning of probability distributions (a.k.a. density estimation), where we are given an i.i.d. sample generated from an unknown target distribution, and want to output a distribution that is close to the target in total…

Machine Learning · Computer Science 2018-06-05 Hassan Ashtiani , Shai Ben-David , Abbas Mehrabian

Confidence intervals for the population mean of normally distributed data are some of the most standard statistical outputs one might want from a database. In this work we give practical differentially private algorithms for this task. We…

Methodology · Statistics 2020-01-09 Wenxin Du , Canyon Foot , Monica Moniot , Andrew Bray , Adam Groce

We introduce a simple framework for designing private boosting algorithms. We give natural conditions under which these algorithms are differentially private, efficient, and noise-tolerant PAC learners. To demonstrate our framework, we use…

Machine Learning · Computer Science 2020-02-05 Mark Bun , Marco Leandro Carmosino , Jessica Sorrell

Estimating causal effects from randomized experiments is only possible if participants are willing to disclose their potentially sensitive responses. Differential privacy, a widely used framework for ensuring an algorithms privacy…

Machine Learning · Statistics 2025-05-29 Adel Javanmard , Vahab Mirrokni , Jean Pouget-Abadie

Machine learning models are increasingly used in high-stakes decision-making systems. In such applications, a major concern is that these models sometimes discriminate against certain demographic groups such as individuals with certain…

Machine Learning · Computer Science 2023-06-06 Andrew Lowy , Devansh Gupta , Meisam Razaviyayn

We present a new algorithm for locating a small cluster of points with differential privacy [Dwork, McSherry, Nissim, and Smith, 2006]. Our algorithm has implications to private data exploration, clustering, and removal of outliers.…

Data Structures and Algorithms · Computer Science 2017-03-14 Kobbi Nissim , Uri Stemmer , Salil Vadhan

We consider learning problems where the training set consists of two types of examples: private and public. The goal is to design a learning algorithm that satisfies differential privacy only with respect to the private examples. This…

Machine Learning · Computer Science 2019-10-28 Noga Alon , Raef Bassily , Shay Moran

We revisit the problem of accurately answering large classes of statistical queries while preserving differential privacy. Previous approaches to this problem have either been very general but have not had run-time polynomial in the size of…

Data Structures and Algorithms · Computer Science 2011-11-30 Avrim Blum , Aaron Roth

We study a basic private estimation problem: each of $n$ users draws a single i.i.d. sample from an unknown Gaussian distribution, and the goal is to estimate the mean of this Gaussian distribution while satisfying local differential…

Machine Learning · Computer Science 2019-10-29 Matthew Joseph , Janardhan Kulkarni , Jieming Mao , Zhiwei Steven Wu

This paper concerns differentially private Bayesian estimation of the parameters of a population distribution, when a statistic of a sample from that population is shared in noise to provide differential privacy. This work mainly addresses…

Methodology · Statistics 2023-01-09 Baris Alparslan , Sinan Yildirim

Due to statistical lower bounds on the learnability of many function classes under privacy constraints, there has been recent interest in leveraging public data to improve the performance of private learning algorithms. In this model,…

Machine Learning · Statistics 2024-02-16 Adam Block , Mark Bun , Rathin Desai , Abhishek Shetty , Steven Wu

Given a collection of vectors $x^{(1)},\dots,x^{(n)} \in \{0,1\}^d$, the selection problem asks to report the index of an "approximately largest" entry in $x=\sum_{j=1}^n x^{(j)}$. Selection abstracts a host of problems--in machine learning…

Cryptography and Security · Computer Science 2023-06-09 Ivan Damgård , Hannah Keller , Boel Nelson , Claudio Orlandi , Rasmus Pagh