English
Related papers

Related papers: Private Mean Estimation of Heavy-Tailed Distributi…

200 papers

In this paper, we investigate the differentially private estimation of data depth functions and their associated medians. We introduce several methods for privatizing depth values at a fixed point, and show that for some depth functions,…

Statistics Theory · Mathematics 2021-04-09 Kelly Ramsay , Shoja'eddin Chenouri

We show that Thompson Sampling with Gaussian Prior as detailed by Algorithm 2 in (Agrawal & Goyal, 2013) is already differentially private. Theorem 1 show that it enjoys a very competitive privacy loss of only $\mathcal{O}(\ln^2 T)$ after T…

Cryptography and Security · Computer Science 2018-06-26 Aristide C. Y. Tossou , Christos Dimitrakakis

We propose $\mathtt{PrivHP}$, a lightweight synthetic data generator with \textit{differential privacy} guarantees. $\mathtt{PrivHP}$ uses a novel hierarchical decomposition that approximates the input's cumulative distribution function…

Cryptography and Security · Computer Science 2025-12-10 Rayne Holland , Seyit Camtepe , Chandra Thapa , Minhui Xue

The problem of learning threshold functions is a fundamental one in machine learning. Classical learning theory implies sample complexity of $O(\xi^{-1} \log(1/\beta))$ (for generalization error $\xi$ with confidence $1-\beta$). The private…

Machine Learning · Computer Science 2022-11-14 Edith Cohen , Xin Lyu , Jelani Nelson , Tamás Sarlós , Uri Stemmer

In sensitive applications involving relational datasets, protecting information about individual links from adversarial queries is of paramount importance. In many such settings, the available data are summarized solely through the degrees…

Machine Learning · Statistics 2026-02-05 Bibhabasu Mandal , Sagnik Nandy

We present \textit{universal} estimators for the statistical mean, variance, and scale (in particular, the interquartile range) under pure differential privacy. These estimators are universal in the sense that they work on an arbitrary,…

Cryptography and Security · Computer Science 2023-04-04 Wei Dong , Ke Yi

Consider a database of $n$ people, each represented by a bit-string of length $d$ corresponding to the setting of $d$ binary attributes. A $k$-way marginal query is specified by a subset $S$ of $k$ attributes, and a $|S|$-dimensional binary…

Data Structures and Algorithms · Computer Science 2013-08-07 Cynthia Dwork , Aleksandar Nikolov , Kunal Talwar

We consider the problem of continually releasing an estimate of the population mean of a stream of samples that is user-level differentially private (DP). At each time instant, a user contributes a sample, and the users can arrive in…

Machine Learning · Computer Science 2022-12-21 Anand Jerry George , Lekshmi Ramesh , Aditya Vikram Singh , Himanshu Tyagi

We present a fast, differentially private algorithm for high-dimensional covariance-aware mean estimation with nearly optimal sample complexity. Only exponential-time estimators were previously known to achieve this guarantee. Given $n$…

Machine Learning · Computer Science 2025-11-26 Gavin Brown , Samuel B. Hopkins , Adam Smith

There has been a recent wave of interest in intermediate trust models for differential privacy that eliminate the need for a fully trusted central data collector, but overcome the limitations of local differential privacy. This interest has…

Data Structures and Algorithms · Computer Science 2020-12-07 Albert Cheu , Jonathan Ullman

We analyze the complexity of sampling from a class of heavy-tailed distributions by discretizing a natural class of It\^o diffusions associated with weighted Poincar\'e inequalities. Based on a mean-square analysis, we establish the…

Statistics Theory · Mathematics 2023-03-03 Ye He , Tyler Farghly , Krishnakumar Balasubramanian , Murat A. Erdogdu

We consider a private discrete distribution estimation problem with one-bit communication constraint. The privacy constraints are imposed with respect to the local differential privacy and the maximal leakage. The estimation error is…

Information Theory · Computer Science 2023-10-18 Seung-Hyun Nam , Vincent Y. F. Tan , Si-Hyeon Lee

Differential privacy is a recent notion of privacy for statistical databases that provides rigorous, meaningful confidentiality guarantees, even in the presence of an attacker with access to arbitrary side information. We show that for a…

Cryptography and Security · Computer Science 2008-09-30 Adam Smith

We consider the problem of communication-constrained collaborative personalized mean estimation under a privacy constraint in an environment of several agents continuously receiving data according to arbitrary unknown agent-specific…

Social and Information Networks · Computer Science 2025-11-10 Yauhen Yakimenka , Hsuan-Yin Lin , Eirik Rosnes , Jörg Kliewer

Differential privacy is widely adopted to provide provable privacy guarantees in data analysis. We consider the problem of combining public and private data (and, more generally, data with heterogeneous privacy needs) for estimating…

Machine Learning · Computer Science 2021-11-02 Cecilia Ferrando , Jennifer Gillenwater , Alex Kulesza

We study the problem of heavy-tailed mean estimation in settings where the variance of the data-generating distribution does not exist. Concretely, given a sample $\mathbf{X} = \{X_i\}_{i = 1}^n$ from a distribution $\mathcal{D}$ over…

Statistics Theory · Mathematics 2020-12-10 Yeshwanth Cherapanamjeri , Nilesh Tripuraneni , Peter L. Bartlett , Michael I. Jordan

We study the fundamental problem of estimating an unknown discrete distribution $p$ over $d$ symbols, given $n$ i.i.d. samples from the distribution. We are interested in minimizing the KL divergence between the true distribution and the…

Machine Learning · Statistics 2025-05-30 Jiayuan Ye , Vitaly Feldman , Kunal Talwar

For scalable machine learning on large data sets, subsampling a representative subset is a common approach for efficient model training. This is often achieved through importance sampling, whereby informative data points are sampled more…

Cryptography and Security · Computer Science 2025-03-31 Dominik Fay , Sebastian Mair , Jens Sjölund

This paper considers the private release of statistics of disjoint subsets of a dataset, in the setting of data heterogeneity, where users could contribute more than one sample, with different users contributing potentially different…

Cryptography and Security · Computer Science 2025-03-26 V. Arvind Rameshwar , Anshoo Tandon

We provide the first $\widetilde{\mathcal{O}}\left(d\right)$-sample algorithm for sampling from unbounded Gaussian distributions under the constraint of $\left(\varepsilon, \delta\right)$-differential privacy. This is a quadratic…

Data Structures and Algorithms · Computer Science 2025-03-04 Valentio Iverson , Gautam Kamath , Argyris Mouzakis
‹ Prev 1 4 5 6 7 8 10 Next ›