English
Related papers

Related papers: Private Estimation with Public Data

200 papers

Differentially private (DP) release of multidimensional statistics typically considers an aggregate sensitivity, e.g. the vector norm of a high-dimensional vector. However, different dimensions of that vector might have widely different…

Machine Learning · Statistics 2022-10-31 Joonas Jälkö , Lukas Prediger , Antti Honkela , Samuel Kaski

We introduce a novel framework for differentially private (DP) statistical estimation via data truncation, addressing a key challenge in DP estimation when the data support is unbounded. Traditional approaches rely on problem-specific…

Machine Learning · Computer Science 2025-11-11 Manolis Zampetakis , Felix Zhou

We study the problem of privately estimating the parameters of $d$-dimensional Gaussian Mixture Models (GMMs) with $k$ components. For this, we develop a technique to reduce the problem to its non-private counterpart. This allows us to…

Machine Learning · Statistics 2023-06-09 Jamil Arbas , Hassan Ashtiani , Christopher Liaw

Many applications of machine learning, for example in health care, would benefit from methods that can guarantee privacy of data subjects. Differential privacy (DP) has become established as a standard for protecting learning results. The…

Machine Learning · Statistics 2017-05-30 Mikko Heikkilä , Eemil Lagerspetz , Samuel Kaski , Kana Shimizu , Sasu Tarkoma , Antti Honkela

Differential Privacy (DP) is a probabilistic framework that protects privacy while preserving data utility. To protect the privacy of the individuals in the dataset, DP requires adding a precise amount of noise to a statistic of interest;…

Computation · Statistics 2025-05-05 Yu-Wei Chen , Pranav Sanghi , Jordan Awan

In modern settings of data analysis, we may be running our algorithms on datasets that are sensitive in nature. However, classical machine learning and statistical algorithms were not designed with these risks in mind, and it has been…

Data Structures and Algorithms · Computer Science 2021-08-21 Huanyu Zhang

The increasing prevalence of high-dimensional data across various applications has raised significant privacy concerns in statistical inference. In this paper, we propose a differentially private integrated statistic for testing…

Methodology · Statistics 2025-06-04 Shiwei Sang , Yicheng Zeng , Xuehu Zhu , Shurong Zheng

Differential privacy guarantees allow the results of a statistical analysis involving sensitive data to be released without compromising the privacy of any individual taking part. Achieving such guarantees generally requires the injection…

Machine Learning · Statistics 2023-10-31 Jack Jewson , Sahra Ghalebikesabi , Chris Holmes

The need to analyze sensitive data, such as medical records or financial data, has created a critical research challenge in recent years. In this paper, we adopt the framework of differential privacy, and explore mechanisms for generating…

Cryptography and Security · Computer Science 2024-05-09 Nikolija Bojkovic , Po-Ling Loh

The randomized power method has gained significant interest due to its simplicity and efficient handling of large-scale spectral analysis and recommendation tasks. However, its application to large datasets containing personal information…

Machine Learning · Computer Science 2025-06-13 Julien Nicolas , César Sabater , Mohamed Maouche , Sonia Ben Mokhtar , Mark Coates

Differential privacy (DP) is an essential technique for privacy-preserving. It was found that a large model trained for privacy preserving performs worse than a smaller model (e.g. ResNet50 performs worse than ResNet18). To better…

Machine Learning · Computer Science 2021-11-30 Yinchen Shen , Zhiguo Wang , Ruoyu Sun , Xiaojing Shen

Differential privacy provides a rigorous framework to quantify data privacy, and has received considerable interest recently. A randomized mechanism satisfying $(\epsilon, \delta)$-differential privacy (DP) roughly means that, except with a…

Cryptography and Security · Computer Science 2019-12-10 Jun Zhao , Teng Wang , Tao Bai , Kwok-Yan Lam , Zhiying Xu , Shuyu Shi , Xuebin Ren , Xinyu Yang , Yang Liu , Han Yu

Gaussian processes (GPs) are non-parametric Bayesian models that are widely used for diverse prediction tasks. Previous work in adding strong privacy protection to GPs via differential privacy (DP) has been limited to protecting only the…

Machine Learning · Computer Science 2021-11-12 Antti Honkela , Laila Melkas

Private data analysis faces a significant challenge known as the curse of dimensionality, leading to increased costs. However, many datasets possess an inherent low-dimensional structure. For instance, during optimization via gradient…

Machine Learning · Computer Science 2024-10-29 Eliad Tsfadia

A major challenge for machine learning is increasing the availability of data while respecting the privacy of individuals. Here we combine the provable privacy guarantees of the differential privacy framework with the flexibility of…

Machine Learning · Statistics 2019-01-18 Michael Thomas Smith , Max Zwiessele , Neil D. Lawrence

Gaussian copulas are widely used to estimate multivariate distributions and relationships. We present algorithms for estimating Gaussian copula correlations that ensure differential privacy. We first convert data values into sets of two-way…

Methodology · Statistics 2026-01-08 Shuo Wang , Joseph Feldman , Jerome P. Reiter

Differential privacy (DP) has become a rigorous central concept for privacy protection in the past decade. We use Gaussian differential privacy (GDP) in gauging the level of privacy protection for releasing statistical summaries from data.…

Methodology · Statistics 2025-04-01 Minwoo Kim , Jonghyeok Lee , Seung Woo Kwak , Sungkyu Jung

Differential Privacy (DP) has become a gold standard in privacy-preserving data analysis. While it provides one of the most rigorous notions of privacy, there are many settings where its applicability is limited. Our main contribution is in…

Cryptography and Security · Computer Science 2021-10-20 Aman Bansal , Rahul Chunduru , Deepesh Data , Manoj Prabhakaran

We provide sample complexity upper bounds for agnostically learning multivariate Gaussians under the constraint of approximate differential privacy. These are the first finite sample upper bounds for general Gaussians which do not impose…

Machine Learning · Statistics 2020-10-21 Ishaq Aden-Ali , Hassan Ashtiani , Gautam Kamath

Learning the parameters of Gaussian mixture models is a fundamental and widely studied problem with numerous applications. In this work, we give new algorithms for learning the parameters of a high-dimensional, well separated, Gaussian…

Data Structures and Algorithms · Computer Science 2019-10-17 Gautam Kamath , Or Sheffet , Vikrant Singhal , Jonathan Ullman