English
Related papers

Related papers: Average-Case Averages: Private Algorithms for Smoo…

200 papers

Median regression analysis has robustness properties which make it attractive compared with regression based on the mean, while differential privacy can protect individual privacy during statistical analysis of certain datasets. In this…

Computation · Statistics 2020-06-05 E Chen , Ying Miao , Yu Tang

This paper introduces a new version of the smoothly trimmed mean with a more general version of weights, which can be used as an alternative to the classical trimmed mean. We derive its asymptotic variance and to further investigate its…

Statistics Theory · Mathematics 2024-09-10 Elina Kresse , Emils Silins , Janis Valeinis

For scalable machine learning on large data sets, subsampling a representative subset is a common approach for efficient model training. This is often achieved through importance sampling, whereby informative data points are sampled more…

Cryptography and Security · Computer Science 2025-03-31 Dominik Fay , Sebastian Mair , Jens Sjölund

Confidence intervals are a fundamental tool for quantifying the uncertainty of parameters of interest. With the increase of data privacy awareness, developing a private version of confidence intervals has gained growing attention from both…

Methodology · Statistics 2024-04-12 Shurong Lin , Mark Bun , Marco Gaboardi , Eric D. Kolaczyk , Adam Smith

Formal disclosure avoidance techniques are necessary to ensure that published data can not be used to identify information about individuals. The addition of statistical noise to unpublished data can be implemented to achieve differential…

Methodology · Statistics 2024-06-10 Ryan Janicki , Scott H. Holan , Kyle M. Irimata , James Livsey , Andrew Raim

In this paper we revisit the classical problem of nonparametric regression, but impose local differential privacy constraints. Under such constraints, the raw data $(X_1,Y_1),\ldots,(X_n,Y_n)$, taking values in $\mathbb{R}^d \times…

Statistics Theory · Mathematics 2020-11-03 Thomas Berrett , László Györfi , Harro Walk

Bandit algorithms have become a reference solution for interactive recommendation. However, as such algorithms directly interact with users for improved recommendations, serious privacy concerns have been raised regarding its practical use.…

Machine Learning · Computer Science 2022-09-01 Huazheng Wang , David Zhao , Hongning Wang

We develop two notions of instance optimality in differential privacy, inspired by classical statistical theory: one by defining a local minimax risk and the other by considering unbiased mechanisms and analogizing the Cramer-Rao bound, and…

Cryptography and Security · Computer Science 2020-05-22 Hilal Asi , John C. Duchi

We develop formal privacy mechanisms for releasing statistics from data with many outlying values, such as income data. These mechanisms ensure that a per-record differential privacy guarantee degrades slowly in the protected records'…

Cryptography and Security · Computer Science 2025-05-05 Brian Finley , Anthony M Caruso , Justin C Doty , Ashwin Machanavajjhala , Mikaela R Meyer , David Pujol , William Sexton , Zachary Terner

We deal with the problem of gradient estimation for stochastic differentiable relaxations of algorithms, operators, simulators, and other non-differentiable functions. Stochastic smoothing conventionally perturbs the input of a…

Machine Learning · Computer Science 2024-10-11 Felix Petersen , Christian Borgelt , Aashwin Mishra , Stefano Ermon

We consider the estimation of a density at a fixed point under a local differential privacy constraint, where the observations are anonymised before being available for statistical inference. We propose both a privatised version of a…

Statistics Theory · Mathematics 2022-06-16 Sandra Schluttenhofer , Jan Johannes

In general, it is challenging to release differentially private versions of survey-weighted statistics with low error for acceptable privacy loss. This is because weighted statistics from complex sample survey data can be more sensitive to…

Cryptography and Security · Computer Science 2024-11-08 Jeremy Seeman , Yajuan Si , Jerome P Reiter

A recently proposed scheme utilizing local noise addition and matrix masking enables data collection while protecting individual privacy from all parties, including the central data manager. Statistical analysis of such privacy-preserved…

Methodology · Statistics 2026-02-24 Linh H Nghiem , Aidong A. Ding , Samuel Wu

In recent years, Gaussian noise has become a popular tool in differentially private algorithms, often replacing Laplace noise which dominated the early literature. Gaussian noise is the standard approach to $\textit{approximate}$…

Cryptography and Security · Computer Science 2024-11-19 Joel Daniel Andersson , Rasmus Pagh , Teresa Anna Steiner , Sahel Torkamani

Differentially private computation often begins with a bound on some $d$-dimensional statistic's $\ell_p$ sensitivity. For pure differential privacy, the $K$-norm mechanism can improve on this approach using a norm tailored to the…

Cryptography and Security · Computer Science 2024-05-22 Matthew Joseph , Alexander Yu

With the development of big data and machine learning, privacy concerns have become increasingly critical, especially when handling heterogeneous datasets containing sensitive personal information. Differential privacy provides a rigorous…

Machine Learning · Statistics 2025-08-08 Ziliang Shen , Caixing Wang , Shaoli Wang , Yibo Yan

We consider the problem of communication-constrained collaborative personalized mean estimation under a privacy constraint in an environment of several agents continuously receiving data according to arbitrary unknown agent-specific…

Social and Information Networks · Computer Science 2025-11-10 Yauhen Yakimenka , Hsuan-Yin Lin , Eirik Rosnes , Jörg Kliewer

Differential privacy comes equipped with multiple analytical tools for the design of private data analyses. One important tool is the so-called "privacy amplification by subsampling" principle, which ensures that a differentially private…

Machine Learning · Computer Science 2018-11-26 Borja Balle , Gilles Barthe , Marco Gaboardi

Ratio statistics--such as relative risk and odds ratios--play a central role in hypothesis testing, model evaluation, and decision-making across many areas of machine learning, including causal inference and fairness analysis. However,…

Machine Learning · Statistics 2025-05-28 Tomer Shoham , Katrina Ligettt

Decentralized optimization is gaining increased traction due to its widespread applications in large-scale machine learning and multi-agent systems. The same mechanism that enables its success, i.e., information sharing among participating…

Optimization and Control · Mathematics 2024-02-07 Yongqiang Wang , Angelia Nedic