English
Related papers

Related papers: Interpreting the Error of Differentially Private M…

200 papers

Speaker diarization systems segment a conversation recording based on the speakers' identity. Such systems can misclassify the speaker of a portion of audio due to a variety of factors, such as speech pattern variation, background noise,…

Sound · Computer Science 2024-06-26 Anurag Chowdhury , Abhinav Misra , Mark C. Fuhs , Monika Woszczyna

Perhaps the single most important use case for differential privacy is to privately answer numerical queries, which is usually achieved by adding noise to the answer vector. The central question, therefore, is to understand which noise…

Machine Learning · Statistics 2021-03-17 Jinshuo Dong , Weijie J. Su , Linjun Zhang

Optimal state estimation for linear discrete-time systems is considered. Motivated by the literature on differential privacy, the measurements are assumed to be corrupted by Laplace noise. The optimal least mean square error estimate of the…

Optimization and Control · Mathematics 2016-09-02 Farhad Farokhi , Jezdimir Milosevic , Henrik Sandberg

We study continual mean estimation, where data vectors arrive sequentially and the goal is to maintain accurate estimates of the running mean. We address this problem under user-level differential privacy, which protects each user's entire…

Machine Learning · Computer Science 2026-05-12 Nikita P. Kalinin , Ali Najar , Valentin Roth , Christoph H. Lampert

Privacy preservation in machine learning, particularly through Differentially Private Stochastic Gradient Descent (DP-SGD), is critical for sensitive data analysis. However, existing statistical inference methods for SGD predominantly focus…

Machine Learning · Statistics 2025-12-15 Xintao Xia , Linjun Zhang , Zhanrui Cai

We study discrete distribution estimation under user-level local differential privacy (LDP). In user-level $\varepsilon$-LDP, each user has $m\ge1$ samples and the privacy of all $m$ samples must be preserved simultaneously. We resolve the…

Machine Learning · Computer Science 2022-11-08 Jayadev Acharya , Yuhan Liu , Ziteng Sun

We develop a Bayesian highest-density interval (HDI) for use in within-subject designs. This credible interval is based on a standard noninformative prior and a modified posterior distribution that conditions on both the data and point…

Methodology · Statistics 2018-06-14 Farouk S. Nathoo , Robyn E. Kilshaw , Michael E. J. Masson

Differentially private (DP) mechanisms face the challenge of providing accurate results while protecting their inputs: the privacy-utility trade-off. A simple but powerful technique for DP adds noise to sensitivity-bounded query outputs to…

Cryptography and Security · Computer Science 2021-07-28 David M. Sommer , Lukas Abfalterer , Sheila Zingg , Esfandiar Mohammadi

Linear regression is an important tool across many fields that work with sensitive human-sourced data. Significant prior work has focused on producing differentially private point estimates, which provide a privacy guarantee to individuals…

Machine Learning · Computer Science 2019-10-30 Garrett Bernstein , Daniel Sheldon

Differential privacy (DP) is an essential technique for privacy-preserving. It was found that a large model trained for privacy preserving performs worse than a smaller model (e.g. ResNet50 performs worse than ResNet18). To better…

Machine Learning · Computer Science 2021-11-30 Yinchen Shen , Zhiguo Wang , Ruoyu Sun , Xiaojing Shen

We investigate unbiased high-dimensional mean estimators in differential privacy. We consider differentially private mechanisms whose expected output equals the mean of the input dataset, for every dataset drawn from a fixed bounded…

Statistics Theory · Mathematics 2023-12-22 Aleksandar Nikolov , Haohua Tang

Differential privacy (DP) is a formal notion for quantifying the privacy loss of algorithms. Algorithms in the central model of DP achieve high accuracy but make the strongest trust assumptions whereas those in the local DP model make the…

Cryptography and Security · Computer Science 2021-06-09 Badih Ghazi , Ravi Kumar , Pasin Manurangsi , Rasmus Pagh

In this manuscript, a purely data driven statistical regularization method is proposed for extracting the information from big data with randomly distributed noise. Since the variance of the noise maybe large, the method can be regarded as…

Numerical Analysis · Mathematics 2021-02-19 Jin Cheng , Jiantang Zhang , Min Zhong

We consider the problem of constructing differentially private nonparametric confidence intervals (CIs) for an arbitrary quantity using resampling. A growing body of work has adapted resampling ideas to the private setting, including…

Cryptography and Security · Computer Science 2026-05-14 Tomer Shoham , Moshe Shenfeld , Noa Velner-Harris , Katrina Ligett

In systematic reviews and meta-analysis, researchers often pool the results of the sample mean and standard deviation from a set of similar clinical trials. A number of the trials, however, reported the study using the median, the minimum…

Methodology · Statistics 2016-10-06 Xiang Wan , Wenqian Wang , Jiming Liu , Tiejun Tong

We review the use of differential privacy (DP) for privacy protection in machine learning (ML). We show that, driven by the aim of preserving the accuracy of the learned models, DP-based ML implementations are so loose that they do not…

Cryptography and Security · Computer Science 2023-01-09 Alberto Blanco-Justicia , David Sanchez , Josep Domingo-Ferrer , Krishnamurty Muralidhar

We propose a novel algorithm to ensure $\epsilon$-differential privacy for answering range queries on trajectory data. In order to guarantee privacy, differential privacy mechanisms add noise to either data or query, thus introducing errors…

Databases · Computer Science 2019-07-19 Soheila Ghane , Lars Kulik , Kotagiri Ramamohanarao

Regressions are commonly used in environmental science and economics to identify causal or associative relationships between variables. In these settings, remote sensing-derived map products increasingly serve as sources of variables,…

Applications · Statistics 2025-07-04 Kerri Lu , Dan M. Kluger , Stephen Bates , Sherrie Wang

The gold standard for privacy in machine learning, Differential Privacy (DP), is often interpreted through its guarantees against membership inference. However, translating DP budgets into quantitative protection against the more damaging…

This article provides, through theoretical analysis, an in-depth understanding of the classification performance of the empirical risk minimization framework, in both ridge-regularized and unregularized cases, when high dimensional data are…

Machine Learning · Statistics 2020-11-26 Xiaoyi Mai , Zhenyu Liao