English
Related papers

Related papers: Private Mean Estimation of Heavy-Tailed Distributi…

200 papers

We study the problem of differentially private query release assisted by access to public data. In this problem, the goal is to answer a large class $\mathcal{H}$ of statistical queries with error no more than $\alpha$ using a combination…

Machine Learning · Computer Science 2020-04-24 Raef Bassily , Albert Cheu , Shay Moran , Aleksandar Nikolov , Jonathan Ullman , Zhiwei Steven Wu

We investigate a problem of finding the minimum, in which each user has a real value and we want to estimate the minimum of these values under the local differential privacy constraint. We reveal that this problem is fundamentally…

Statistics Theory · Mathematics 2019-05-28 Kazuto Fukuchi , Chia-Mu Yu , Arashi Haishima , Jun Sakuma

Estimating the density of a distribution from its samples is a fundamental problem in statistics. Hypothesis selection addresses the setting where, in addition to a sample set, we are given $n$ candidate distributions -- referred to as…

Data Structures and Algorithms · Computer Science 2025-10-23 Maryam Aliakbarpour , Zhan Shi , Ria Stevens , Vincent X. Wang

A key task in managing distributed, sensitive data is to measure the extent to which a distribution changes. Understanding this drift can effectively support a variety of federated learning and analytics tasks. However, in many practical…

Machine Learning · Computer Science 2024-12-02 Mary Scott , Sayan Biswas , Graham Cormode , Carsten Maple

Differential privacy guarantees allow the results of a statistical analysis involving sensitive data to be released without compromising the privacy of any individual taking part. Achieving such guarantees generally requires the injection…

Machine Learning · Statistics 2023-10-31 Jack Jewson , Sahra Ghalebikesabi , Chris Holmes

Many algorithms have been developed to estimate probability distributions subject to differential privacy (DP): such an algorithm takes as input independent samples from a distribution and estimates the density function in a way that is…

Cryptography and Security · Computer Science 2024-12-17 Albert Cheu , Debanuj Nayak

In this work, we give efficient algorithms for privately estimating a Gaussian distribution in both pure and approximate differential privacy (DP) models with optimal dependence on the dimension in the sample complexity. In the pure DP…

Data Structures and Algorithms · Computer Science 2023-06-02 Daniel Alabi , Pravesh K. Kothari , Pranay Tankala , Prayaag Venkat , Fred Zhang

Working under a model of privacy in which data remains private even from the statistician, we study the tradeoff between privacy guarantees and the utility of the resulting statistical estimators. We prove bounds on information-theoretic…

Statistics Theory · Mathematics 2014-08-28 John C. Duchi , Michael I. Jordan , Martin J. Wainwright

How to achieve the tradeoff between privacy and utility is one of fundamental problems in private data analysis.In this paper, we give a rigourous differential privacy analysis of networks in the appearance of covariates via a generalized…

Methodology · Statistics 2023-11-20 Ting Yan

We study the problem of hypothesis selection under the constraint of local differential privacy. Given a class $\mathcal{F}$ of $k$ distributions and a set of i.i.d. samples from an unknown distribution $h$, the goal of hypothesis selection…

Machine Learning · Statistics 2026-03-05 Alireza F. Pour , Hassan Ashtiani , Shahab Asoodeh

We study the optimal sample complexity of a given workload of linear queries under the constraints of differential privacy. The sample complexity of a query answering mechanism under error parameter $\alpha$ is the smallest $n$ such that…

Data Structures and Algorithms · Computer Science 2016-12-12 Assimakis Kattis , Aleksandar Nikolov

Hypothesis testing plays a central role in statistical inference, and is used in many settings where privacy concerns are paramount. This work answers a basic question about privately testing simple hypotheses: given two distributions $P$…

Data Structures and Algorithms · Computer Science 2019-04-04 Clément L. Canonne , Gautam Kamath , Audra McMillan , Adam Smith , Jonathan Ullman

We consider the minimax estimation problem of a discrete distribution with support size $k$ under locally differential privacy constraints. A privatization scheme is applied to each raw sample independently, and we need to estimate the…

Statistics Theory · Mathematics 2018-10-18 Min Ye , Alexander Barg

We design a new algorithm for the Euclidean $k$-means problem that operates in the local model of differential privacy. Unlike in the non-private literature, differentially private algorithms for the $k$-means objective incur both additive…

Machine Learning · Computer Science 2021-06-29 Uri Stemmer

We provide a detailed study of the estimation of probability distributions---discrete and continuous---in a stringent setting in which data is kept private even from the statistician. We give sharp minimax rates of convergence for…

Statistics Theory · Mathematics 2013-05-28 John C. Duchi , Michael I. Jordan , Martin J. Wainwright

We study the problem of multi-task learning under user-level differential privacy, in which $n$ users contribute data to $m$ tasks, each involving a subset of users. One important aspect of the problem, that can significantly impact…

Machine Learning · Computer Science 2023-02-17 Walid Krichene , Prateek Jain , Shuang Song , Mukund Sundararajan , Abhradeep Thakurta , Li Zhang

Private collection of statistics from a large distributed population is an important problem, and has led to large scale deployments from several leading technology companies. The dominant approach requires each user to randomly perturb…

Databases · Computer Science 2021-11-10 Graham Cormode , Samuel Maddock , Carsten Maple

We study the fundamental problem of frequency estimation under both privacy and communication constraints, where the data is distributed among $k$ parties. We consider two application scenarios: (1) one-shot, where the data is static and…

Cryptography and Security · Computer Science 2021-06-01 Ziyue Huang , Yuan Qiu , Ke Yi , Graham Cormode

Le Cam's method, Fano's inequality, and Assouad's lemma are three widely used techniques to prove lower bounds for statistical estimation tasks. We propose their analogues under central differential privacy. Our results are simple, easy to…

Machine Learning · Computer Science 2020-11-03 Jayadev Acharya , Ziteng Sun , Huanyu Zhang

Bayesian methods lie at the heart of modern data science and provide a powerful scaffolding for estimation in data-constrained settings and principled quantification and propagation of uncertainty. Yet in many real-world use cases where…

Data Structures and Algorithms · Computer Science 2026-03-20 Sitan Chen , Jingqiu Ding , Mahbod Majid , Walter McKelvie