English
Related papers

Related papers: Private Mean Estimation of Heavy-Tailed Distributi…

200 papers

We revisit the problem of differentially private release of classification queries. In this problem, the goal is to design an algorithm that can accurately answer a sequence of classification queries based on a private training set while…

Machine Learning · Computer Science 2019-12-05 Anupama Nandi , Raef Bassily

Median regression analysis has robustness properties which make it attractive compared with regression based on the mean, while differential privacy can protect individual privacy during statistical analysis of certain datasets. In this…

Computation · Statistics 2020-06-05 E Chen , Ying Miao , Yu Tang

A wide variety of fundamental data analyses in machine learning, such as linear and logistic regression, require minimizing a convex function defined by the data. Since the data may contain sensitive information about individuals, and these…

Data Structures and Algorithms · Computer Science 2015-03-17 Jonathan Ullman

We study the canonical statistical task of computing the principal component from $n$ i.i.d.~data in $d$ dimensions under $(\varepsilon,\delta)$-differential privacy. Although extensively studied in literature, existing solutions fall short…

Machine Learning · Computer Science 2022-05-30 Xiyang Liu , Weihao Kong , Prateek Jain , Sewoong Oh

Survival analysis is widely used in applications involving sensitive individual-level data, yet differentially private hypothesis testing for right-censored data remains largely undeveloped. We initiate a finite-sample theory of private…

Statistics Theory · Mathematics 2026-05-19 Elly K. H. Hung , Yi Yu

We tackle the problem of estimating a location parameter with differential privacy guarantees and sub-Gaussian deviations. Recent work in statistics has focused on the study of estimators that achieve sub-Gaussian type deviations even for…

Statistics Theory · Mathematics 2019-07-01 Marco Avella-Medina , Victor-Emmanuel Brunel

Ratio statistics--such as relative risk and odds ratios--play a central role in hypothesis testing, model evaluation, and decision-making across many areas of machine learning, including causal inference and fairness analysis. However,…

Machine Learning · Statistics 2025-05-28 Tomer Shoham , Katrina Ligettt

We study the setup where each of $n$ users holds an element from a discrete set, and the goal is to count the number of distinct elements across all users, under the constraint of $(\epsilon, \delta)$-differentially privacy: - In the…

Cryptography and Security · Computer Science 2020-09-22 Lijie Chen , Badih Ghazi , Ravi Kumar , Pasin Manurangsi

We initiate the study of differentially private learning in the proportional dimensionality regime, in which the number of data samples $n$ and problem dimension $d$ approach infinity at rates proportional to one another, meaning that…

Machine Learning · Computer Science 2025-02-20 Cynthia Dwork , Pranay Tankala , Linjun Zhang

The exponential increase in the amount of available data makes taking advantage of them without violating users' privacy one of the fundamental problems of computer science. This question has been investigated thoroughly under the framework…

Data Structures and Algorithms · Computer Science 2023-07-19 Jakub Tětek

We prove lower bounds on the number of samples needed to privately estimate the covariance matrix of a Gaussian distribution. Our bounds match existing upper bounds in the widest known setting of parameters. Our analysis relies on the…

Data Structures and Algorithms · Computer Science 2024-04-30 Victor S. Portella , Nick Harvey

Differential privacy is the leading mathematical framework for privacy protection, providing a probabilistic guarantee that safeguards individuals' private information when publishing statistics from a dataset. This guarantee is achieved by…

Methodology · Statistics 2025-08-19 Yuki Ohnishi , Jordan Awan

We design an $(\varepsilon, \delta)$-differentially private algorithm to estimate the mean of a $d$-variate distribution, with unknown covariance $\Sigma$, that is adaptive to $\Sigma$. To within polylogarithmic factors, the estimator…

Machine Learning · Statistics 2023-01-18 John Duchi , Saminul Haque , Rohith Kuditipudi

We present new algorithms for estimating and testing \emph{collision probability}, a fundamental measure of the spread of a discrete distribution that is widely used in many scientific fields. We describe an algorithm that satisfies…

Machine Learning · Statistics 2025-04-21 Robert Busa-Fekete , Umar Syed

We consider privacy in the context of streaming algorithms for cardinality estimation. We show that a large class of algorithms all satisfy $\epsilon$-differential privacy, so long as (a) the algorithm is combined with a simple…

Data Structures and Algorithms · Computer Science 2023-02-06 Charlie Dickens , Justin Thaler , Daniel Ting

A pervasive task in the differential privacy literature is to select the $k$ items of "highest quality" out of a set of $d$ items, where the quality of each item depends on a sensitive dataset that must be protected. Variants of this task…

Data Structures and Algorithms · Computer Science 2017-04-12 Thomas Steinke , Jonathan Ullman

Privacy protection of users' entire contribution of samples is important in distributed systems. The most effective approach is the two-stage scheme, which finds a small interval first and then gets a refined estimate by clipping samples…

Machine Learning · Computer Science 2024-10-25 Puning Zhao , Lifeng Lai , Li Shen , Qingming Li , Jiafei Wu , Zhe Liu

We consider the problem of estimating a regression function from anonymized data in the framework of local differential privacy. We propose a novel partitioning estimate of the regression function, derive a rate of convergence for the…

Statistics Theory · Mathematics 2023-04-12 László Györfi , Martin Kroll

Differential privacy is becoming a gold standard for privacy research; it offers a guaranteed bound on loss of privacy due to release of query results, even under worst-case assumptions. The theory of differential privacy is an active…

In statistical learning and analysis from shared data, which is increasingly widely adopted in platforms such as federated learning and meta-learning, there are two major concerns: privacy and robustness. Each participating individual…

Machine Learning · Computer Science 2021-11-25 Xiyang Liu , Weihao Kong , Sham Kakade , Sewoong Oh