中文
相关论文

相关论文: A Fast Algorithm for Adaptive Private Mean Estimat…

200 篇论文

We provide an improved analysis of standard differentially private gradient descent for linear regression under the squared error loss. Under modest assumptions on the input, we characterize the distribution of the iterate at each time…

机器学习 · 计算机科学 2024-02-22 Gavin Brown , Krishnamurthy Dvijotham , Georgina Evans , Daogao Liu , Adam Smith , Abhradeep Thakurta

In this paper we study the problem of estimating the unknown mean $\theta$ of a unit variance Gaussian distribution in a locally differentially private (LDP) way. In the high-privacy regime ($\epsilon\le 1$), we identify an optimal privacy…

统计理论 · 数学 2025-03-06 Nikita P. Kalinin , Lukas Steinberger

We construct an algorithm, running in time $\tilde{\mathcal O}(N d + uK d)$, which is robust to outliers and heavy-tailed data and which achieves the subgaussian rate from [Lugosi, Mendelson] \begin{equation}\label{eq:intro_subgaus_rate}…

统计理论 · 数学 2019-06-28 Jules Depersin , Guillaume Lecué

We present the first $\varepsilon$-differentially private, computationally efficient algorithm that estimates the means of product distributions over $\{0,1\}^d$ accurately in total-variation distance, whilst attaining the optimal sample…

数据结构与算法 · 计算机科学 2024-01-29 Vikrant Singhal

We provide an efficient algorithm for the classical problem, going back to Galton, Pearson, and Fisher, of estimating, with arbitrary accuracy the parameters of a multivariate normal distribution from truncated samples. Truncated samples…

The Gaussian mechanism is an essential building block used in multitude of differentially private data analysis algorithms. In this paper we revisit the Gaussian mechanism and show that the original analysis has several important…

机器学习 · 计算机科学 2018-06-08 Borja Balle , Yu-Xiang Wang

Differential privacy (DP) is a rigorous notion of data privacy, used for private statistics. The canonical algorithm for differentially private mean estimation is to first clip the samples to a bounded range and then add noise to their…

In this work, we study high-dimensional mean estimation under user-level differential privacy, and design an $(\varepsilon,\delta)$-differentially private mechanism using as few users as possible. In particular, we provide a nearly optimal…

数据结构与算法 · 计算机科学 2022-06-14 Hossein Esfandiari , Vahab Mirrokni , Shyam Narayanan

We consider the problem of identifying the parameters of an unknown mixture of two arbitrary $d$-dimensional gaussians from a sequence of independent random samples. Our main results are upper and lower bounds giving a computationally…

机器学习 · 计算机科学 2015-05-19 Moritz Hardt , Eric Price

To fast approximate maximum likelihood estimators with massive data, this paper studies the Optimal Subsampling Method under the A-optimality Criterion (OSMAC) for generalized linear models. The consistency and asymptotic normality of the…

统计方法学 · 统计学 2021-06-15 Mingyao Ai , Jun Yu , Huiming Zhang , HaiYing Wang

We construct a novel estimator for the diffusion coefficient of the limiting homogenized equation, when observing the slow dynamics of a multiscale model, in the case when the slow dynamics are of bounded variation. Previous research…

统计理论 · 数学 2018-07-04 Theodoros Manikas , Anastasia Papavasiliou

We study the problem of list-decodable Gaussian mean estimation and the related problem of learning mixtures of separated spherical Gaussians. We develop a set of techniques that yield new efficient algorithms with significantly improved…

数据结构与算法 · 计算机科学 2017-11-21 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

This paper addresses the following question: given a sample of i.i.d. random variables with finite variance, can one construct an estimator of the unknown mean that performs nearly as well as if the data were normally distributed? One of…

统计理论 · 数学 2023-02-06 Stanislav Minsker

We give the first polynomial-time algorithm to estimate the mean of a $d$-variate probability distribution with bounded covariance from $\tilde{O}(d)$ independent samples subject to pure differential privacy. Prior algorithms for this…

数据结构与算法 · 计算机科学 2022-06-06 Samuel B. Hopkins , Gautam Kamath , Mahbod Majid

With the development of Big data technology, data analysis has become increasingly important. Traditional clustering algorithms such as K-means are highly sensitive to the initial centroid selection and perform poorly on non-convex…

机器学习 · 计算机科学 2023-07-28 Ying Xiao , Hou-biao Li , Yu-pu Zhang

We present a simple perturbation mechanism for the release of $d$-dimensional covariance matrices $\Sigma$ under pure differential privacy. For large datasets with at least $n\geq d^2/\varepsilon$ elements, our mechanism recovers the…

机器学习 · 计算机科学 2026-02-03 Tommaso d'Orsi , Gleb Novikov

We study the problem of list-decodable sparse mean estimation. Specifically, for a parameter $\alpha \in (0, 1/2)$, we are given $m$ points in $\mathbb{R}^n$, $\lfloor \alpha m \rfloor$ of which are i.i.d. samples from a distribution $D$…

数据结构与算法 · 计算机科学 2024-07-08 Ilias Diakonikolas , Daniel M. Kane , Sushrut Karmalkar , Ankit Pensia , Thanasis Pittas

Given a dataset of $n$ user-contributed strings, each of length at most $\ell$, a key problem is how to identify all frequent substrings while preserving each user's privacy. Recent work by Bernardini et al. (PODS'25) introduced a…

数据结构与算法 · 计算机科学 2026-03-11 Peaker Guo , Rayne Holland , Hao Wu

The simplest and most widely applied method for guaranteeing differential privacy is to add instance-independent noise to a statistic of interest that is scaled to its global sensitivity. However, global sensitivity is a worst-case notion…

统计理论 · 数学 2019-06-10 Mark Bun , Thomas Steinke

We study efficient algorithms for linear regression and covariance estimation in the absence of Gaussian assumptions on the underlying distributions of samples, making assumptions instead about only finitely-many moments. We focus on how…