English
Related papers

Related papers: New Lower Bounds for Private Estimation and a Gene…

200 papers

Regression-based optimal fingerprinting techniques for climate change detection and attribution require the estimation of the forced signal as well as the internal variability covariance matrix in order to distinguish between their…

Methodology · Statistics 2022-08-08 Samuel Baugh , Karen McKinnon

We study the classical problem of community recovery in stochastic block models with a fixed number of communities, with a twist: We seek algorithms that are stable with respect to node-wise changes in the graph structure, formally defined…

Statistics Theory · Mathematics 2026-05-18 Laurentiu Marchis , Ethan D'souza , Tomáš Flídr , Po-Ling Loh

Deep learning models are often trained on datasets that contain sensitive information such as individuals' shopping transactions, personal contacts, and medical records. An increasingly important line of work therefore has sought to train…

Machine Learning · Computer Science 2020-07-23 Zhiqi Bu , Jinshuo Dong , Qi Long , Weijie J. Su

We give a new proof of the "transfer theorem" underlying adaptive data analysis: that any mechanism for answering adaptively chosen statistical queries that is differentially private and sample-accurate is also accurate out-of-sample. Our…

Machine Learning · Computer Science 2024-06-05 Christopher Jung , Katrina Ligett , Seth Neel , Aaron Roth , Saeed Sharifi-Malvajerdi , Moshe Shenfeld

Differential privacy is becoming a gold standard for privacy research; it offers a guaranteed bound on loss of privacy due to release of query results, even under worst-case assumptions. The theory of differential privacy is an active…

Differential privacy (DP) has become a rigorous central concept for privacy protection in the past decade. We use Gaussian differential privacy (GDP) in gauging the level of privacy protection for releasing statistical summaries from data.…

Methodology · Statistics 2025-04-01 Minwoo Kim , Jonghyeok Lee , Seung Woo Kwak , Sungkyu Jung

We study the setup where each of $n$ users holds an element from a discrete set, and the goal is to count the number of distinct elements across all users, under the constraint of $(\epsilon, \delta)$-differentially privacy: - In the…

Cryptography and Security · Computer Science 2020-09-22 Lijie Chen , Badih Ghazi , Ravi Kumar , Pasin Manurangsi

The Sampled Gaussian Mechanism (SGM)---a composition of subsampling and the additive Gaussian noise---has been successfully used in a number of machine learning applications. The mechanism's unexpected power is derived from privacy…

Machine Learning · Computer Science 2019-08-29 Ilya Mironov , Kunal Talwar , Li Zhang

We study the problem of learning mixtures of Gaussians with approximate differential privacy. We prove that roughly $kd^2 + k^{1.5} d^{1.75} + k^2 d$ samples suffice to learn a mixture of $k$ arbitrary $d$-dimensional Gaussians up to low…

Machine Learning · Computer Science 2024-11-05 Hassan Ashtiani , Mahbod Majid , Shyam Narayanan

Individual privacy accounting enables bounding differential privacy (DP) loss individually for each participant involved in the analysis. This can be informative as often the individual privacy losses are considerably smaller than those…

Cryptography and Security · Computer Science 2023-08-25 Antti Koskela , Marlon Tobaben , Antti Honkela

We compute quantitative bounds for measuring the discrepancy between the distribution of two min-max statistics involving either pairs of Gaussian random matrices, or one Gaussian and one Gaussian-subordinated random matrix. In the fully…

Probability · Mathematics 2021-09-28 Giovanni Peccati , Nicola Turchi

We show how randomized rounding based on Grothendieck's identity can be used to prove a nearly tight bound on the covariance loss--the amount of covariance that is lost by taking conditional expectation. This result yields a new type of…

Probability · Mathematics 2023-01-10 March Boedihardjo , Thomas Strohmer , Roman Vershynin

We prove new upper and lower bounds on the sample complexity of $(\epsilon, \delta)$ differentially private algorithms for releasing approximate answers to threshold functions. A threshold function $c_x$ over a totally ordered domain $X$…

Cryptography and Security · Computer Science 2024-12-23 Mark Bun , Kobbi Nissim , Uri Stemmer , Salil Vadhan

The ratio of two Gaussians is useful in many contexts of statistical inference. We discuss statistically valid inference of the ratio under Differential Privacy (DP). We use the delta method to derive the asymptotic distribution of the…

Methodology · Statistics 2022-06-30 Jingang Miao , Yiming Paul Li

The correlations and network structure amongst individuals in datasets today---whether explicitly articulated, or deduced from biological or behavioral connections---pose new issues around privacy guarantees, because of inferences that can…

Data Structures and Algorithms · Computer Science 2017-05-25 Arpita Ghosh , Robert Kleinberg

Differential privacy is widely adopted to provide provable privacy guarantees in data analysis. We consider the problem of combining public and private data (and, more generally, data with heterogeneous privacy needs) for estimating…

Machine Learning · Computer Science 2021-11-02 Cecilia Ferrando , Jennifer Gillenwater , Alex Kulesza

We consider the problem of privately estimating a parameter $\mathbb{E}[h(X_1,\dots,X_k)]$, where $X_1$, $X_2$, $\dots$, $X_k$ are i.i.d. data from some distribution and $h$ is a permutation-invariant function. Without privacy constraints,…

Statistics Theory · Mathematics 2024-07-09 Kamalika Chaudhuri , Po-Ling Loh , Shourya Pandey , Purnamrita Sarkar

We propose a novel theoretical and methodological framework for Gaussian process regression subject to privacy constraints. The proposed method can be used when a data owner is unwilling to share a high-fidelity supervised learning model…

Machine Learning · Computer Science 2025-10-14 Rui Tuo , Haoyuan Chen , Raktim Bhattacharya

We study the sample complexity of learning threshold functions under the constraint of differential privacy. It is assumed that each labeled example in the training data is the information of one individual and we would like to come up with…

Data Structures and Algorithms · Computer Science 2019-11-25 Haim Kaplan , Katrina Ligett , Yishay Mansour , Moni Naor , Uri Stemmer

A key tool for building differentially private systems is adding Gaussian noise to the output of a function evaluated on a sensitive dataset. Unfortunately, using a continuous distribution presents several practical challenges. First and…

Data Structures and Algorithms · Computer Science 2024-11-19 Clément L. Canonne , Gautam Kamath , Thomas Steinke