English
Related papers

Related papers: Privately Estimating Black-Box Statistics

200 papers

Report Noisy Max and Above Threshold are two classical differentially private (DP) selection mechanisms. Their output is obtained by adding noise to a sequence of low-sensitivity queries and reporting the identity of the query whose (noisy)…

Machine Learning · Computer Science 2024-03-22 Jonathan Lebensold , Doina Precup , Borja Balle

We consider the estimation of a density at a fixed point under a local differential privacy constraint, where the observations are anonymised before being available for statistical inference. We propose both a privatised version of a…

Statistics Theory · Mathematics 2022-06-16 Sandra Schluttenhofer , Jan Johannes

Differential privacy (DP) is obtained by randomizing a data analysis algorithm, which necessarily introduces a tradeoff between its utility and privacy. Many DP mechanisms are built upon one of two underlying tools: Laplace and Gaussian…

Machine Learning · Computer Science 2026-04-03 Roy Rinberg , Ilia Shumailov , Vikrant Singhal , Rachel Cummings , Nicolas Papernot

Sketching is an important tool for dealing with high-dimensional vectors that are sparse (or well-approximated by a sparse vector), especially useful in distributed, parallel, and streaming settings. It is known that sketches can be made…

Data Structures and Algorithms · Computer Science 2022-10-13 Rasmus Pagh , Mikkel Thorup

Differentially private mechanisms are increasingly used to publish tables of counts, where each entry represents the number of individuals belonging to a particular category. A distribution of counts summarizes the information in the count…

Cryptography and Security · Computer Science 2026-04-03 Nitin Kohli , Paul Laskowski

Motivated by the rapid rise in statistical tools in Functional Data Analysis, we consider the Gaussian mechanism for achieving differential privacy with parameter estimates taking values in a, potentially infinite-dimensional, separable…

Statistics Theory · Mathematics 2019-01-29 Ardalan Mirshani , Matthew Reimherr , Aleksandra Slavkovic

We develop formal privacy mechanisms for releasing statistics from data with many outlying values, such as income data. These mechanisms ensure that a per-record differential privacy guarantee degrades slowly in the protected records'…

Cryptography and Security · Computer Science 2025-05-05 Brian Finley , Anthony M Caruso , Justin C Doty , Ashwin Machanavajjhala , Mikaela R Meyer , David Pujol , William Sexton , Zachary Terner

Le Cam's method, Fano's inequality, and Assouad's lemma are three widely used techniques to prove lower bounds for statistical estimation tasks. We propose their analogues under central differential privacy. Our results are simple, easy to…

Machine Learning · Computer Science 2020-11-03 Jayadev Acharya , Ziteng Sun , Huanyu Zhang

We introduce and compare computational techniques for sharp extreme event probability estimates in stochastic differential equations with small additive Gaussian noise. In particular, we focus on strategies that are scalable, i.e. their…

Computation · Statistics 2023-11-27 Timo Schorlepp , Shanyin Tong , Tobias Grafke , Georg Stadler

The Shapley value has been proposed as a solution to many applications in machine learning, including for equitable valuation of data. Shapley values are computationally expensive and involve the entire dataset. The query for a point's…

Machine Learning · Computer Science 2022-06-02 Lauren Watson , Rayna Andreeva , Hao-Tsung Yang , Rik Sarkar

Differential privacy (DP) can be achieved in a distributed manner, where multiple parties add independent noise such that their sum protects the overall dataset with DP. A common technique here is for each party to sample their noise from…

Cryptography and Security · Computer Science 2025-04-08 Charlie Harrison , Pasin Manurangsi

In many practical applications, heuristic or approximation algorithms are used to efficiently solve the task at hand. However their solutions frequently do not satisfy natural monotonicity properties of optimal solutions. In this work we…

Machine Learning · Computer Science 2020-03-24 Evangelia Gergatsouli , Brendan Lucier , Christos Tzamos

In this paper we revisit the classical problem of nonparametric regression, but impose local differential privacy constraints. Under such constraints, the raw data $(X_1,Y_1),\ldots,(X_n,Y_n)$, taking values in $\mathbb{R}^d \times…

Statistics Theory · Mathematics 2020-11-03 Thomas Berrett , László Györfi , Harro Walk

Estimating percentiles of black-box deterministic functions with random inputs is a challenging task when the number of function evaluations is severely restricted, which is typical for computer experiments. This article proposes two new…

Statistics Theory · Mathematics 2016-05-23 T Labopin-Richard , V Picheny

Developing a differentially private deep learning algorithm is challenging, due to the difficulty in analyzing the sensitivity of objective functions that are typically used to train deep neural networks. Many existing methods resort to the…

Machine Learning · Computer Science 2019-10-16 Frederik Harder , Jonas Köhler , Max Welling , Mijung Park

The Maximal Information Coefficient (MIC) is a powerful statistic to identify dependencies between variables. However, it may be applied to sensitive data, and publishing it could leak private information. As a solution, we present…

Cryptography and Security · Computer Science 2022-06-23 John Lazarsfeld , Aaron Johnson , Emmanuel Adeniran

Bandit algorithms have become a reference solution for interactive recommendation. However, as such algorithms directly interact with users for improved recommendations, serious privacy concerns have been raised regarding its practical use.…

Machine Learning · Computer Science 2022-09-01 Huazheng Wang , David Zhao , Hongning Wang

Koufogiannis et al. (2016) showed a $\textit{gradual release}$ result for Laplace noise-based differentially private mechanisms: given an $\varepsilon$-DP release, a new release with privacy parameter $\varepsilon' > \varepsilon$ can be…

Cryptography and Security · Computer Science 2025-05-29 Joel Daniel Andersson , Lukas Retschmeier , Boel Nelson , Rasmus Pagh

This note studies a method for the efficient estimation of a finite number of unknown parameters from linear equations, which are perturbed by Gaussian noise. In case the unknown parameters have only few nonzero entries, the proposed…

Systems and Control · Computer Science 2014-05-27 Liang Dai , Kristiaan Pelckmans

We consider the privacy problem of statistical estimation from distributed data, where users communicate to a central processor over a Gaussian multiple-access channel(MAC). To avoid the inevitable sacrifice of data utility for privacy in…

Information Theory · Computer Science 2020-11-03 Wenhao Zhan