English
Related papers

Related papers: Missing Mass for Differentially Private Domain Dis…

200 papers

In this paper, we study differentially private (DP) algorithms for computing the geometric median (GM) of a dataset: Given $n$ points, $x_1,\dots,x_n$ in $\mathbb{R}^d$, the goal is to find a point $\theta$ that minimizes the sum of the…

Machine Learning · Computer Science 2024-06-12 Mahdi Haghifam , Thomas Steinke , Jonathan Ullman

Many algorithms have been developed to estimate probability distributions subject to differential privacy (DP): such an algorithm takes as input independent samples from a distribution and estimates the density function in a way that is…

Cryptography and Security · Computer Science 2024-12-17 Albert Cheu , Debanuj Nayak

Generalizing knowledge to unseen domains, where data and labels are unavailable, is crucial for machine learning models. We tackle the domain generalization problem to learn from multiple source domains and generalize to a target domain…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Fan Zhou , Zhuqing Jiang , Changjian Shui , Boyu Wang , Brahim Chaib-draa

There are many existing differentially private algorithms for releasing histograms, i.e. counts with corresponding labels, in various settings. Our focus in this survey is to revisit some of the existing differentially private algorithms…

Cryptography and Security · Computer Science 2024-08-05 Ryan Rogers

Knowledge transfer from a source domain to a different but semantically related target domain has long been an important topic in the context of unsupervised domain adaptation (UDA). A key challenge in this field is establishing a metric…

Machine Learning · Computer Science 2020-07-21 Rongzhe Wei , Fa Zhang , Bo Dong , Qinghua Zheng

We study the problem of top-$k$ selection over a large domain universe subject to user-level differential privacy. Typically, the exponential mechanism or report noisy max are the algorithms used to solve this problem. However, these…

Cryptography and Security · Computer Science 2019-09-19 David Durfee , Ryan Rogers

Gaussian differential privacy (GDP) is a single-parameter family of privacy notions that provides coherent guarantees to avoid the exposure of sensitive individual information. Despite the extra interpretability and tighter bounds under…

Cryptography and Security · Computer Science 2022-10-18 Yi Liu , Ke Sun , Linglong Kong , Bei Jiang

We provide improved differentially private algorithms for identity testing of high-dimensional distributions. Specifically, for $d$-dimensional Gaussian distributions with known covariance $\Sigma$, we can test whether the distribution…

Data Structures and Algorithms · Computer Science 2022-07-26 Shyam Narayanan

We present novel, computationally efficient, and differentially private algorithms for two fundamental high-dimensional learning problems: learning a multivariate Gaussian and learning a product distribution over the Boolean hypercube in…

Data Structures and Algorithms · Computer Science 2019-05-31 Gautam Kamath , Jerry Li , Vikrant Singhal , Jonathan Ullman

Leveraging datasets available to learn a model with high generalization ability to unseen domains is important for computer vision, especially when the unseen domain's annotated data are unavailable. We study a novel and practical problem…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Yang Shu , Zhangjie Cao , Chenyu Wang , Jianmin Wang , Mingsheng Long

Directed graphical models (DGMs) are a class of probabilistic models that are widely used for predictive analysis in sensitive domains, such as medical diagnostics. In this paper we present an algorithm for differentially private learning…

Machine Learning · Computer Science 2020-07-14 Amrita Roy Chowdhury , Theodoros Rekatsinas , Somesh Jha

Differential privacy (DP) has become a rigorous central concept for privacy protection in the past decade. We use Gaussian differential privacy (GDP) in gauging the level of privacy protection for releasing statistical summaries from data.…

Methodology · Statistics 2025-04-01 Minwoo Kim , Jonghyeok Lee , Seung Woo Kwak , Sungkyu Jung

Current practices for reporting the level of differential privacy (DP) protection for machine learning (ML) algorithms such as DP-SGD provide an incomplete and potentially misleading picture of the privacy guarantees. For instance, if only…

Machine Learning · Computer Science 2025-10-03 Juan Felipe Gomez , Bogdan Kulynych , Georgios Kaissis , Flavio P. Calmon , Jamie Hayes , Borja Balle , Antti Honkela

The verification of differential privacy algorithms that employ Gaussian distributions is little understood. This paper tackles the challenge of verifying such programs by introducing a novel approach to approximating probability…

Cryptography and Security · Computer Science 2025-09-11 Bishnu Bhusal , Rohit Chadha , A. Prasad Sistla , Mahesh Viswanathan

Many applications of machine learning, for example in health care, would benefit from methods that can guarantee privacy of data subjects. Differential privacy (DP) has become established as a standard for protecting learning results. The…

Machine Learning · Statistics 2017-05-30 Mikko Heikkilä , Eemil Lagerspetz , Samuel Kaski , Kana Shimizu , Sasu Tarkoma , Antti Honkela

When collecting information, local differential privacy (LDP) relieves the concern of privacy leakage from users' perspective, as user's private information is randomized before sent to the aggregator. We study the problem of recovering the…

Cryptography and Security · Computer Science 2019-12-04 Zitao Li , Tianhao Wang , Milan Lopuhaä-Zwakenberg , Boris Skoric , Ninghui Li

The Gaussian mechanism (GM) represents a universally employed tool for achieving differential privacy (DP), and a large body of work has been devoted to its analysis. We argue that the three prevailing interpretations of the GM, namely…

Cryptography and Security · Computer Science 2021-09-23 Georgios Kaissis , Moritz Knolle , Friederike Jungmann , Alexander Ziller , Dmitrii Usynin , Daniel Rueckert

We introduce the Poisson Binomial mechanism (PBM), a discrete differential privacy mechanism for distributed mean estimation (DME) with applications to federated learning and analytics. We provide a tight analysis of its privacy guarantees,…

Cryptography and Security · Computer Science 2022-07-21 Wei-Ning Chen , Ayfer Özgür , Peter Kairouz

Differential privacy via output perturbation has been a de facto standard for releasing query or computation results on sensitive data. However, we identify that all existing Gaussian mechanisms suffer from the curse of full-rank covariance…

Cryptography and Security · Computer Science 2024-03-15 Tianxi Ji , Pan Li

Domain shifts in the training data are common in practical applications of machine learning; they occur for instance when the data is coming from different sources. Ideally, a ML model should work well independently of these shifts, for…