English
Related papers

Related papers: Minimax optimal differentially private synthetic d…

200 papers

In the differentially private top-$k$ selection problem, we are given a dataset $X \in \{\pm 1\}^{n \times d}$, in which each row belongs to an individual and each column corresponds to some binary attribute, and our goal is to find a set…

Data Structures and Algorithms · Computer Science 2017-02-13 Mitali Bafna , Jonathan Ullman

We study the canonical statistical task of computing the principal component from $n$ i.i.d.~data in $d$ dimensions under $(\varepsilon,\delta)$-differential privacy. Although extensively studied in literature, existing solutions fall short…

Machine Learning · Computer Science 2022-05-30 Xiyang Liu , Weihao Kong , Prateek Jain , Sewoong Oh

Differentially private selection mechanisms offer strong privacy guarantees for queries aiming to identify the top-scoring element r from a finite set R, based on a dataset-dependent utility function. While selection queries are fundamental…

Machine Learning · Computer Science 2025-04-16 Iago Chaves , Victor Farias , Amanda Perez , Diego Mesquita , Javam Machado

Consider the following problem: given a metric space, some of whose points are "clients", open a set of at most $k$ facilities to minimize the average distance from the clients to these facilities. This is just the well-studied $k$-median…

Data Structures and Algorithms · Computer Science 2009-11-11 Anupam Gupta , Katrina Ligett , Frank McSherry , Aaron Roth , Kunal Talwar

Data synthesis is a promising solution to share data for various downstream analytic tasks without exposing raw data. However, without a theoretical privacy guarantee, a synthetic dataset would still leak some sensitive information.…

Data Structures and Algorithms · Computer Science 2024-06-28 Fangyuan Zhao , Zitao Li , Xuebin Ren , Bolin Ding , Shusen Yang , Yaliang Li

Given $n$ i.i.d. random matrices $A_i \in \mathbb{R}^{d \times d}$ that share a common expectation $\Sigma$, the objective of Differentially Private Stochastic PCA is to identify a subspace of dimension $k$ that captures the largest…

Machine Learning · Statistics 2025-08-15 Johanna Düngler , Amartya Sanyal

This work studies formal utility and privacy guarantees for a simple multiplicative database transformation, where the data are compressed by a random linear or affine transformation, reducing the number of data records substantially, while…

Machine Learning · Statistics 2009-01-13 Shuheng Zhou , Katrina Ligett , Larry Wasserman

We study the problem of differentially private synthetic data generation for hierarchical datasets in which individual data points are grouped together (e.g., people within households). In particular, to measure the similarity between the…

Machine Learning · Computer Science 2022-06-14 Terrance Liu , Zhiwei Steven Wu

Privacy and communication constraints are two major bottlenecks in federated learning (FL) and analytics (FA). We study the optimal accuracy of mean and frequency estimation (canonical models for FL and FA respectively) under joint…

Machine Learning · Statistics 2023-04-05 Wei-Ning Chen , Dan Song , Ayfer Ozgur , Peter Kairouz

Stochastic gradient descent ascent (SGDA) and its variants have been the workhorse for solving minimax problems. However, in contrast to the well-studied stochastic gradient descent (SGD) with differential privacy (DP) constraints, there is…

Machine Learning · Computer Science 2022-08-01 Zhenhuan Yang , Shu Hu , Yunwen Lei , Kush R. Varshney , Siwei Lyu , Yiming Ying

Differential privacy is becoming a gold standard for privacy research; it offers a guaranteed bound on loss of privacy due to release of query results, even under worst-case assumptions. The theory of differential privacy is an active…

Finding anonymization mechanisms to protect personal data is at the heart of recent machine learning research. Here, we consider the consequences of local differential privacy constraints on goodness-of-fit testing, i.e. the statistical…

Statistics Theory · Mathematics 2021-04-16 Joseph Lam-Weil , Béatrice Laurent , Jean-Michel Loubes

We address practical implementation of a risk-weighted pseudo posterior synthesizer for microdata dissemination with a new re-weighting strategy that maximizes utility of released synthetic data under at any level of formal privacy…

Methodology · Statistics 2022-05-02 Terrance D. Savitsky , Jingchen Hu , Matthew R. Williams

We study stochastic convex optimization with heavy-tailed data under the constraint of differential privacy (DP). Most prior work on this problem is restricted to the case where the loss function is Lipschitz. Instead, as introduced by…

Machine Learning · Computer Science 2022-11-02 Gautam Kamath , Xingtu Liu , Huanyu Zhang

We investigate a problem of finding the minimum, in which each user has a real value and we want to estimate the minimum of these values under the local differential privacy constraint. We reveal that this problem is fundamentally…

Statistics Theory · Mathematics 2019-05-28 Kazuto Fukuchi , Chia-Mu Yu , Arashi Haishima , Jun Sakuma

Tuning the hyperparameters of differentially private (DP) machine learning (ML) algorithms often requires use of sensitive data and this may leak private information via hyperparameter values. Recently, Papernot and Steinke (2022) proposed…

Machine Learning · Computer Science 2024-02-14 Antti Koskela , Tejas Kulkarni

In differential privacy (DP), a challenging problem is to generate synthetic datasets that efficiently capture the useful information in the private data. The synthetic dataset enables any task to be done without privacy concern and…

Cryptography and Security · Computer Science 2021-01-01 Zhikun Zhang , Tianhao Wang , Ninghui Li , Jean Honorio , Michael Backes , Shibo He , Jiming Chen , Yang Zhang

We initiate a systematic study of worst-group risk minimization under $(\epsilon, \delta)$-differential privacy (DP). The goal is to privately find a model that approximately minimizes the maximal risk across $p$ sub-populations (groups)…

Machine Learning · Computer Science 2024-03-01 Xinyu Zhou , Raef Bassily

Artificial intelligence and data access are already mainstream. One of the main challenges when designing an artificial intelligence or disclosing content from a database is preserving the privacy of individuals who participate in the…

Cryptography and Security · Computer Science 2023-12-13 Clément Pierquin , Bastien Zimmermann , Matthieu Boussard

The challenge of producing accurate statistics while respecting the privacy of the individuals in a sample is an important area of research. We study minimax lower bounds for classes of differentially private estimators. In particular, we…

Machine Learning · Computer Science 2024-09-19 Clément Lalanne , Aurélien Garivier , Rémi Gribonval