English
Related papers

Related papers: Proving Differential Privacy with Shadow Execution

200 papers

The software-based implementation of differential privacy mechanisms has been shown to be neither friendly for lightweight devices nor secure against side-channel attacks. In this work, we aim to develop a hardware-based technique to…

Cryptography and Security · Computer Science 2024-03-27 Jianqing Liu , Na Gong , Hritom Das

Noisy Max and Sparse Vector are selection algorithms for differential privacy and serve as building blocks for more complex algorithms. In this paper we show that both algorithms can release additional information for free (i.e., at no…

Machine Learning · Computer Science 2019-09-17 Zeyu Ding , Yuxin Wang , Danfeng Zhang , Daniel Kifer

Ensuring the privacy of sensitive data used to train modern machine learning models is of paramount importance in many areas of practice. One approach to study these concerns is through the lens of differential privacy. In this framework,…

Machine Learning · Computer Science 2020-03-03 Lichao Sun , Yingbo Zhou , Philip S. Yu , Caiming Xiong

Differential Privacy (DP) is a formal definition of privacy that provides rigorous guarantees against risks of privacy breaches during data processing. It makes no assumptions about the knowledge or computational power of adversaries, and…

Cryptography and Security · Computer Science 2022-05-20 Roxana Danger

We study black-box auditing for machine learning algorithms that claim R \ 'enyi differential privacy (RDP) guarantees. We introduce an auditing framework, based on hypothesis testing, that directly estimates R\'enyi divergence between…

Machine Learning · Computer Science 2026-05-22 Benjamin D. Kim , Lav R. Varshney , Daniel Alabi

The problem of privately releasing data is to provide a version of a dataset without revealing sensitive information about the individuals who contribute to the data. The model of differential privacy allows such private release while…

Databases · Computer Science 2011-03-07 Graham Cormode , Magda Procopiuc , Divesh Srivastava , Thanh T. L. Tran

The standard definition of differential privacy (DP) ensures that a mechanism's output distribution on adjacent datasets is indistinguishable. However, real-world implementations of DP can, and often do, reveal information through their…

Cryptography and Security · Computer Science 2024-11-26 Zachary Ratliff , Salil Vadhan

We present a novel method for accurately auditing the differential privacy (DP) guarantees of DP mechanisms. In particular, our solution is applicable to auditing DP guarantees of machine learning (ML) models. Previous auditing methods…

Machine Learning · Computer Science 2026-01-14 Antti Koskela , Jafar Mohammadi

We propose a practical sequential test for auditing differential privacy guarantees of black-box mechanisms. The test processes streams of mechanisms' outputs providing anytime-valid inference while controlling Type I error, overcoming the…

Cryptography and Security · Computer Science 2025-11-17 Tomás González , Mateo Dulce-Rubio , Aaditya Ramdas , Mónica Ribero

Traditional approaches to differential privacy assume a fixed privacy requirement $\epsilon$ for a computation, and attempt to maximize the accuracy of the computation subject to the privacy constraint. As differential privacy is…

Machine Learning · Computer Science 2017-06-01 Katrina Ligett , Seth Neel , Aaron Roth , Bo Waggoner , Z. Steven Wu

Differential privacy has become a de facto standard for releasing data in a privacy-preserving way. Creating a differentially private algorithm is a process that often starts with a noise-free (non-private) algorithm. The designer then…

Cryptography and Security · Computer Science 2021-09-16 Yuxin Wang , Zeyu Ding , Yingtai Xiao , Daniel Kifer , Danfeng Zhang

We introduce the novel problem of benchmarking fraud detectors on private graph-structured data. Currently, many types of fraud are managed in part by automated detection algorithms that operate over graphs. We consider the scenario where a…

Cryptography and Security · Computer Science 2025-07-31 Alexander Goldberg , Giulia Fanti , Nihar Shah , Zhiwei Steven Wu

Differential privacy (DP) provides formal guarantees that the output of a database query does not reveal too much information about any individual present in the database. While many differentially private algorithms have been proposed in…

Cryptography and Security · Computer Science 2019-11-27 Royce J Wilson , Celia Yuxin Zhang , William Lam , Damien Desfontaines , Daniel Simmons-Marengo , Bryant Gipson

The task of statistical inference, which includes the building of confidence intervals and tests for parameters and effects of interest to a researcher, is still an open area of investigation in a differentially private (DP) setting.…

Methodology · Statistics 2025-07-17 Ogonnaya Michael Romanus , Younes Boulaguiem , Roberto Molinari

Differential privacy is a widely accepted measure of privacy in the context of deep learning algorithms, and achieving it relies on a noisy training approach known as differentially private stochastic gradient descent (DP-SGD). DP-SGD…

Machine Learning · Computer Science 2023-07-26 Ce Feng , Nuo Xu , Wujie Wen , Parv Venkitasubramaniam , Caiwen Ding

Differential privacy (DP) quantifies privacy loss by analyzing noise injected into output statistics. For non-trivial statistics, this noise is necessary to ensure finite privacy loss. However, data curators frequently release collections…

Cryptography and Security · Computer Science 2022-12-15 Jeremy Seeman , Matthew Reimherr , Aleksandra Slavkovic

We review the use of differential privacy (DP) for privacy protection in machine learning (ML). We show that, driven by the aim of preserving the accuracy of the learned models, DP-based ML implementations are so loose that they do not…

Cryptography and Security · Computer Science 2023-01-09 Alberto Blanco-Justicia , David Sanchez , Josep Domingo-Ferrer , Krishnamurty Muralidhar

To resolve the acute problem of privacy protection and guarantee that data can be used in the context of threat intelligence, this paper considers the implementation of Differential Privacy (DP) in cybersecurity analytics. DP, which is a…

Cryptography and Security · Computer Science 2026-01-05 Brahim Khalil Sedraoui , Abdelmadjid Benmachiche , Amina Makhlouf , Chaouki Chemam

In this paper, we study the problem of privacy audit in one run and show that our method achieves tight audit results for various differentially private protocols. This includes obtaining tight results for auditing $(\varepsilon,\delta)$-DP…

Cryptography and Security · Computer Science 2025-09-11 Zihang Xiang , Tianhao Wang , Hanshen Xiao , Yuan Tian , Di Wang

Differential privacy (DP) is a widely used approach for mitigating privacy risks when training machine learning models on sensitive data. DP mechanisms add noise during training to limit the risk of information leakage. The scale of the…

Machine Learning · Computer Science 2024-11-11 Bogdan Kulynych , Juan Felipe Gomez , Georgios Kaissis , Flavio du Pin Calmon , Carmela Troncoso