English
Related papers

Related papers: Locally Private Mean Estimation: Z-test and Tight …

200 papers

There has been a recent wave of interest in intermediate trust models for differential privacy that eliminate the need for a fully trusted central data collector, but overcome the limitations of local differential privacy. This interest has…

Data Structures and Algorithms · Computer Science 2020-12-07 Albert Cheu , Jonathan Ullman

We present a simple perturbation mechanism for the release of $d$-dimensional covariance matrices $\Sigma$ under pure differential privacy. For large datasets with at least $n\geq d^2/\varepsilon$ elements, our mechanism recovers the…

Machine Learning · Computer Science 2026-02-03 Tommaso d'Orsi , Gleb Novikov

We study the running time, in terms of first order oracle queries, of differentially private empirical/population risk minimization of Lipschitz convex losses. We first consider the setting where the loss is non-smooth and the optimizer…

Machine Learning · Computer Science 2025-11-19 Michael Menart , Aleksandar Nikolov

Privacy preservation has become a critical concern in high-dimensional data analysis due to the growing prevalence of data-driven applications. Since its proposal, sliced inverse regression has emerged as a widely utilized statistical…

Machine Learning · Statistics 2025-04-08 Xintao Xia , Linjun Zhang , Zhanrui Cai

We establish a simple connection between robust and differentially-private algorithms: private mechanisms which perform well with very high probability are automatically robust in the sense that they retain accuracy even if a constant…

Machine Learning · Statistics 2022-12-02 Kristian Georgiev , Samuel B. Hopkins

We find separation rates for testing multinomial or more general discrete distributions under the constraint of local differential privacy. We construct efficient randomized algorithms and test procedures, in both the case where only…

Statistics Theory · Mathematics 2020-05-27 Thomas B. Berrett , Cristina Butucea

Differentially private mean estimation is an important building block in privacy-preserving algorithms for data analysis and machine learning. Though the trade-off between privacy and utility is well understood in the worst case, many…

Cryptography and Security · Computer Science 2024-04-11 Martin Aumüller , Christian Janos Lebeda , Boel Nelson , Rasmus Pagh

The $\beta$-model of random graphs is an exponential family model with the degree sequence as a sufficient statistic. In this paper, we contribute three key results. First, we characterize conditions that lead to a quadratic time algorithm…

Methodology · Statistics 2016-01-13 Vishesh Karwa , Aleksandra Slavković

In this paper, we study the Empirical Risk Minimization problem in the non-interactive local model of differential privacy. In the case of constant or low dimensionality ($p\ll n$), we first show that if the ERM loss function is $(\infty,…

Machine Learning · Computer Science 2018-05-18 Di Wang , Marco Gaboardi , Jinhui Xu

Shuffle model of differential privacy is a novel distributed privacy model based on a combination of local privacy mechanisms and a secure shuffler. It has been shown that the additional randomisation provided by the shuffler improves…

Cryptography and Security · Computer Science 2022-02-02 Antti Koskela , Mikko A. Heikkilä , Antti Honkela

Median regression analysis has robustness properties which make it attractive compared with regression based on the mean, while differential privacy can protect individual privacy during statistical analysis of certain datasets. In this…

Computation · Statistics 2020-06-05 E Chen , Ying Miao , Yu Tang

The challenge of producing accurate statistics while respecting the privacy of the individuals in a sample is an important area of research. We study minimax lower bounds for classes of differentially private estimators. In particular, we…

Machine Learning · Computer Science 2024-09-19 Clément Lalanne , Aurélien Garivier , Rémi Gribonval

Differentially private (DP) machine learning has recently become popular. The privacy loss of DP algorithms is commonly reported using $(\varepsilon,\delta)$-DP. In this paper, we propose a numerical accountant for evaluating the privacy…

Machine Learning · Statistics 2020-08-28 Antti Koskela , Joonas Jälkö , Antti Honkela

Local differential privacy~(LDP) is an information-theoretic privacy definition suitable for statistical surveys that involve an untrusted data curator. An LDP version of quasi-maximum likelihood estimator~(QMLE) has been developed, but the…

Machine Learning · Statistics 2022-02-16 Hajime Ono , Kazuhiro Minami , Hideitsu Hino

Recent work in differential privacy has explored the prospect of combining local randomization with a secure intermediary. Specifically, there are a variety of protocols in the secure shuffle model (where an intermediary randomly permutes…

Cryptography and Security · Computer Science 2021-12-28 Albert Cheu , Chao Yan

In the recent years, Local Differential Privacy (LDP) has been one of the corner stone of privacy preserving data analysis. However, many challenges still opposes its widespread application. One of these problems is the scalability of LDP…

Cryptography and Security · Computer Science 2022-06-15 Thomas Carette

Economics and social science research often require analyzing datasets of sensitive personal information at fine granularity, with models fit to small subsets of the data. Unfortunately, such fine-grained analysis can easily reveal…

Machine Learning · Computer Science 2020-07-13 Daniel Alabi , Audra McMillan , Jayshree Sarathy , Adam Smith , Salil Vadhan

We study the problem of Differentially Private Stochastic Convex Optimization (DP-SCO) with heavy-tailed data. Specifically, we focus on the $\ell_1$-norm linear regression in the $\epsilon$-DP model. While most of the previous work focuses…

Machine Learning · Computer Science 2022-01-11 Di Wang , Jinhui Xu

We propose an efficient $\epsilon$-differentially private algorithm, that given a simple {\em weighted} $n$-vertex, $m$-edge graph $G$ with a \emph{maximum unweighted} degree $\Delta(G) \leq n-1$, outputs a synthetic graph which…

Data Structures and Algorithms · Computer Science 2023-10-02 Jingcheng Liu , Jalaj Upadhyay , Zongrui Zou

We investigate differentially private estimators for individual parameters within larger parametric models. While generic private estimators exist, the estimators we provide repose on new local notions of estimand stability, and these…

Machine Learning · Computer Science 2025-03-24 Hilal Asi , John C. Duchi , Kunal Talwar