English
Related papers

Related papers: Offset-Symmetric Gaussians for Differential Privac…

200 papers

Differential privacy (DP) has become the gold standard for preserving individual privacy in data analysis. However, an implicit yet fundamental assumption underlying these rigorous privacy guarantees is the correct implementation and…

Cryptography and Security · Computer Science 2026-03-17 Haochen Sun , Xi He

Individual privacy accounting enables bounding differential privacy (DP) loss individually for each participant involved in the analysis. This can be informative as often the individual privacy losses are considerably smaller than those…

Cryptography and Security · Computer Science 2023-08-25 Antti Koskela , Marlon Tobaben , Antti Honkela

A major challenge for machine learning is increasing the availability of data while respecting the privacy of individuals. Here we combine the provable privacy guarantees of the differential privacy framework with the flexibility of…

Machine Learning · Statistics 2019-01-18 Michael Thomas Smith , Max Zwiessele , Neil D. Lawrence

The Gaussian Mechanism (GM), which consists in adding Gaussian noise to a vector-valued query before releasing it, is a standard privacy protection mechanism. In particular, given that the query respects some L2 sensitivity property (the L2…

Machine Learning · Computer Science 2024-03-20 Hadrien Hendrikx , Paul Mangold , Aurélien Bellet

The standard closed form lower bound on $\sigma$ for providing $(\epsilon, \delta)$-differential privacy by adding zero mean Gaussian noise with variance $\sigma^2$ is $\sigma > \Delta\sqrt {2}(\epsilon^{-1}) \sqrt {\log \left(…

Cryptography and Security · Computer Science 2021-01-22 Staal A. Vinterbo

Differentially private (DP) machine learning has recently become popular. The privacy loss of DP algorithms is commonly reported using $(\varepsilon,\delta)$-DP. In this paper, we propose a numerical accountant for evaluating the privacy…

Machine Learning · Statistics 2020-08-28 Antti Koskela , Joonas Jälkö , Antti Honkela

In this paper, we present a notion of differential privacy (DP) for data that comes from different classes. Here, the class-membership is private information that needs to be protected. The proposed method is an output perturbation…

Signal Processing · Electrical Eng. & Systems 2023-06-12 Raksha Ramakrishna , Anna Scaglione , Tong Wu , Nikhil Ravi , Sean Peisert

In this paper, we propose a Differentially Private Stochastic Gradient Push with Compressed communication (termed DP-CSGP) for decentralized learning over directed graphs. Different from existing works, the proposed algorithm is designed to…

Machine Learning · Computer Science 2025-12-16 Zehan Zhu , Heng Zhao , Yan Huang , Joey Tianyi Zhou , Shouling Ji , Jinming Xu

Report Noisy Max and Above Threshold are two classical differentially private (DP) selection mechanisms. Their output is obtained by adding noise to a sequence of low-sensitivity queries and reporting the identity of the query whose (noisy)…

Machine Learning · Computer Science 2024-03-22 Jonathan Lebensold , Doina Precup , Borja Balle

Differential privacy (DP) is a rigorous notion of data privacy, used for private statistics. The canonical algorithm for differentially private mean estimation is to first clip the samples to a bounded range and then add noise to their…

Statistics Theory · Mathematics 2024-10-10 Gautam Kamath , Argyris Mouzakis , Matthew Regehr , Vikrant Singhal , Thomas Steinke , Jonathan Ullman

The Sampled Gaussian Mechanism (SGM)---a composition of subsampling and the additive Gaussian noise---has been successfully used in a number of machine learning applications. The mechanism's unexpected power is derived from privacy…

Machine Learning · Computer Science 2019-08-29 Ilya Mironov , Kunal Talwar , Li Zhang

Differential privacy (DP) is becoming increasingly important for deployed machine learning applications because it provides strong guarantees for protecting the privacy of individuals whose data is used to train models. However, DP…

We study mean estimation for Gaussian distributions under \textit{personalized differential privacy} (PDP), where each record has its own privacy budget. PDP is commonly considered in two variants: \textit{bounded} and \textit{unbounded}…

Data Structures and Algorithms · Computer Science 2026-01-23 Wei Dong , Li Ge

Personalized privacy becomes critical in deep learning for Trustworthy AI. While Differentially Private Stochastic Gradient Descent (DP-SGD) is widely used in deep learning methods supporting privacy, it provides the same level of privacy…

Machine Learning · Computer Science 2023-05-25 Geon Heo , Junseok Seo , Steven Euijong Whang

Achieving differential privacy (DP) guarantees in fully decentralized machine learning is challenging due to the absence of a central aggregator and varying trust assumptions among nodes. We present a framework for DP analysis of…

Machine Learning · Computer Science 2026-02-06 Antti Koskela , Tejas Kulkarni

Motivation: Researchers need a rich trove of genomic datasets that they can leverage to gain a better understanding of the genetic basis of the human genome and identify associations between phenotypes and specific parts of DNA. However,…

Cryptography and Security · Computer Science 2021-06-10 Nour Almadhoun Alserr , Gulce Kale , Onur Mutlu , Oznur Tastan , Erman Ayday

Differentially Private Stochastic Gradient Descent (DP-SGD) and its variants have been proposed to ensure rigorous privacy for fine-tuning large-scale pre-trained language models. However, they rely heavily on the Gaussian mechanism, which…

Cryptography and Security · Computer Science 2024-05-30 Qin Yang , Meisam Mohammad , Han Wang , Ali Payani , Ashish Kundu , Kai Shu , Yan Yan , Yuan Hong

Differentially Private Stochastic Gradient Descent (DPSGD) is widely used to protect sensitive data during the training of machine learning models, but its privacy guarantee often comes at a large cost of model performance due to the lack…

Machine Learning · Computer Science 2026-01-16 Hao Liang , Wanrong Zhang , Xinlei He , Kaishun Wu , Hong Xing

The widespread proliferation of data-driven decision-making has ushered in a recent interest in the design of privacy-preserving algorithms. In this paper, we consider the ubiquitous problem of gaussian process (GP) bandit optimization from…

Machine Learning · Statistics 2021-02-25 Abhimanyu Dubey

This work studies anomaly detection under differential privacy (DP) with Gaussian perturbation using both statistical and information-theoretic tools. In our setting, the adversary aims to modify the content of a statistical dataset by…

Information Theory · Computer Science 2022-08-23 Ayse Unsal , Melek Onen