English
Related papers

Related papers: Auditing Differential Privacy Guarantees Using Den…

200 papers

Achieving differential privacy (DP) guarantees in fully decentralized machine learning is challenging due to the absence of a central aggregator and varying trust assumptions among nodes. We present a framework for DP analysis of…

Machine Learning · Computer Science 2026-02-06 Antti Koskela , Tejas Kulkarni

Privacy estimation techniques for differentially private (DP) algorithms are useful for comparing against analytical bounds, or to empirically measure privacy loss in settings where known analytical bounds are not tight. However, existing…

Machine Learning · Computer Science 2024-04-19 Galen Andrew , Peter Kairouz , Sewoong Oh , Alina Oprea , H. Brendan McMahan , Vinith M. Suriyakumar

The wide deployment of machine learning in recent years gives rise to a great demand for large-scale and high-dimensional data, for which the privacy raises serious concern. Differential privacy (DP) mechanisms are conventionally developed…

Cryptography and Security · Computer Science 2021-05-03 Jungang Yang , Liyao Xiang , Weiting Li , Wei Liu , Xinbing Wang

Differential Privacy (DP) has become a gold standard in privacy-preserving data analysis. While it provides one of the most rigorous notions of privacy, there are many settings where its applicability is limited. Our main contribution is in…

Cryptography and Security · Computer Science 2021-10-20 Aman Bansal , Rahul Chunduru , Deepesh Data , Manoj Prabhakaran

Federated learning is distributed model training across several clients without disclosing raw data. Despite advancements in data privacy, risks still remain. Differential Privacy (DP) is a technique to protect sensitive data by adding…

Machine Learning · Computer Science 2025-10-14 Tejash Varsani

We consider three different variants of differential privacy (DP), namely approximate DP, R\'enyi DP (RDP), and hypothesis test DP. In the first part, we develop a machinery for optimally relating approximate DP to RDP based on the joint…

Information Theory · Computer Science 2021-01-26 Shahab Asoodeh , Jiachun Liao , Flavio P. Calmon , Oliver Kosut , Lalitha Sankar

Differential privacy (DP) auditing aims to provide empirical lower bounds on the privacy guarantees of DP mechanisms like DP-SGD. While some existing techniques require many training runs that are prohibitively costly, recent work…

Machine Learning · Computer Science 2025-06-19 Terrance Liu , Matteo Boglioni , Yiwei Fu , Shengyuan Hu , Pratiksha Thaker , Zhiwei Steven Wu

Differential privacy schemes have been widely adopted in recent years to address issues of data privacy protection. We propose a new Gaussian scheme combining with another data protection technique, called random orthogonal matrix masking,…

Cryptography and Security · Computer Science 2023-04-13 A. Adam Ding , Samuel S. Wu , Guanhong Miao , Shigang Chen

Differential privacy provides a rigorous framework to quantify data privacy, and has received considerable interest recently. A randomized mechanism satisfying $(\epsilon, \delta)$-differential privacy (DP) roughly means that, except with a…

Cryptography and Security · Computer Science 2019-12-10 Jun Zhao , Teng Wang , Tao Bai , Kwok-Yan Lam , Zhiying Xu , Shuyu Shi , Xuebin Ren , Xinyu Yang , Yang Liu , Han Yu

We present a framework to statistically audit the privacy guarantee conferred by a differentially private machine learner in practice. While previous works have taken steps toward evaluating privacy loss through poisoning attacks or…

Machine Learning · Computer Science 2023-01-10 Fred Lu , Joseph Munoz , Maya Fuchs , Tyler LeBlond , Elliott Zaresky-Williams , Edward Raff , Francis Ferraro , Brian Testa

The Differentially Private Stochastic Gradient Descent (DP-SGD) algorithm supports the training of machine learning (ML) models with formal Differential Privacy (DP) guarantees. Traditionally, DP-SGD processes training data in batches using…

Cryptography and Security · Computer Science 2025-12-15 Meenatchi Sundaram Muthu Selva Annamalai , Borja Balle , Jamie Hayes , Emiliano De Cristofaro

Differentially private (DP) machine learning has recently become popular. The privacy loss of DP algorithms is commonly reported using $(\varepsilon,\delta)$-DP. In this paper, we propose a numerical accountant for evaluating the privacy…

Machine Learning · Statistics 2020-08-28 Antti Koskela , Joonas Jälkö , Antti Honkela

Report Noisy Max and Above Threshold are two classical differentially private (DP) selection mechanisms. Their output is obtained by adding noise to a sequence of low-sensitivity queries and reporting the identity of the query whose (noisy)…

Machine Learning · Computer Science 2024-03-22 Jonathan Lebensold , Doina Precup , Borja Balle

Differential privacy (DP) provides a formal privacy guarantee that prevents adversaries with access to machine learning models from extracting information about individual training points. Differentially private stochastic gradient descent…

Cryptography and Security · Computer Science 2022-12-15 Jie Fu , Zhili Chen , XinPeng Ling

Differential privacy (DP) is a rigorous notion of data privacy, used for private statistics. The canonical algorithm for differentially private mean estimation is to first clip the samples to a bounded range and then add noise to their…

Statistics Theory · Mathematics 2024-10-10 Gautam Kamath , Argyris Mouzakis , Matthew Regehr , Vikrant Singhal , Thomas Steinke , Jonathan Ullman

Differential privacy (DP) is widely employed to provide privacy protection for individuals by limiting information leakage from the aggregated data. Two well-known models of DP are the central model and the local model. The former requires…

Cryptography and Security · Computer Science 2024-11-05 Yucheng Fu , Tianhao Wang

To protect privacy for data-collection-based services, local differential privacy (LDP) is widely adopted due to its rigorous theoretical bound on privacy loss. However, mistakes in complex theoretical analysis or subtle implementation…

Cryptography and Security · Computer Science 2025-08-18 Jingnan Xu , Leixia Wang , Xiaofeng Meng

Individual privacy accounting enables bounding differential privacy (DP) loss individually for each participant involved in the analysis. This can be informative as often the individual privacy losses are considerably smaller than those…

Cryptography and Security · Computer Science 2023-08-25 Antti Koskela , Marlon Tobaben , Antti Honkela

The ratio of two Gaussians is useful in many contexts of statistical inference. We discuss statistically valid inference of the ratio under Differential Privacy (DP). We use the delta method to derive the asymptotic distribution of the…

Methodology · Statistics 2022-06-30 Jingang Miao , Yiming Paul Li

This work proposes an algorithmic method to verify differential privacy for estimation mechanisms with performance guarantees. Differential privacy makes it hard to distinguish outputs of a mechanism produced by adjacent inputs. While…

Systems and Control · Electrical Eng. & Systems 2021-12-03 Yunhai Han , Sonia Martínez