English

Differentially Private Low-dimensional Synthetic Data from High-dimensional Datasets

Machine Learning 2024-12-12 v3 Cryptography and Security Data Structures and Algorithms Probability Statistics Theory Statistics Theory

Abstract

Differentially private synthetic data provide a powerful mechanism to enable data analysis while protecting sensitive information about individuals. However, when the data lie in a high-dimensional space, the accuracy of the synthetic data suffers from the curse of dimensionality. In this paper, we propose a differentially private algorithm to generate low-dimensional synthetic data efficiently from a high-dimensional dataset with a utility guarantee with respect to the Wasserstein distance. A key step of our algorithm is a private principal component analysis (PCA) procedure with a near-optimal accuracy bound that circumvents the curse of dimensionality. Unlike the standard perturbation analysis, our analysis of private PCA works without assuming the spectral gap for the covariance matrix.

Keywords

Cite

@article{arxiv.2305.17148,
  title  = {Differentially Private Low-dimensional Synthetic Data from High-dimensional Datasets},
  author = {Yiyun He and Thomas Strohmer and Roman Vershynin and Yizhe Zhu},
  journal= {arXiv preprint arXiv:2305.17148},
  year   = {2024}
}

Comments

23 pages

R2 v1 2026-06-28T10:47:51.848Z