English
Related papers

Related papers: Why Does Differential Privacy with Large Epsilon D…

200 papers

Differential Privacy (DP) provides an elegant mathematical framework for defining a provable disclosure risk in the presence of arbitrary adversaries; it guarantees that whether an individual is in a database or not, the results of a DP…

Cryptography and Security · Computer Science 2021-08-19 Aleksandra Slavkovic , Roberto Molinari

Differential privacy (DP) is the de facto notion of privacy both in theory and in practice. However, despite its popularity, DP imposes strict requirements which guard against strong worst-case scenarios. For example, it guards against…

Data Structures and Algorithms · Computer Science 2025-12-01 Guy Blanc , William Pires , Toniann Pitassi

Given a trained model and a data sample, membership-inference (MI) attacks predict whether the sample was in the model's training set. A common countermeasure against MI attacks is to utilize differential privacy (DP) during model training…

Cryptography and Security · Computer Science 2022-04-14 Saeed Mahloujifar , Alexandre Sablayrolles , Graham Cormode , Somesh Jha

Differential privacy is a strong notion for privacy that can be used to prove formal guarantees, in terms of a privacy budget, $\epsilon$, about how much information is leaked by a mechanism. However, implementations of privacy-preserving…

Machine Learning · Computer Science 2019-08-14 Bargav Jayaraman , David Evans

Differential Privacy (DP) is a mathematical framework that is increasingly deployed to mitigate privacy risks associated with machine learning and statistical analyses. Despite the growing adoption of DP, its technical privacy parameters do…

Cryptography and Security · Computer Science 2024-05-06 Rachel Cummings , Shlomi Hod , Jayshree Sarathy , Marika Swanberg

Current practices for reporting the level of differential privacy (DP) protection for machine learning (ML) algorithms such as DP-SGD provide an incomplete and potentially misleading picture of the privacy guarantees. For instance, if only…

Machine Learning · Computer Science 2025-10-03 Juan Felipe Gomez , Bogdan Kulynych , Georgios Kaissis , Flavio P. Calmon , Jamie Hayes , Borja Balle , Antti Honkela

Differential privacy (DP) enables private data analysis. In a typical DP deployment, controllers manage individuals' sensitive data and are responsible for answering analysts' queries while protecting individuals' privacy. They do so by…

Databases · Computer Science 2026-05-05 Zhiru Zhu , Raul Castro Fernandez

Machine learning algorithms, when applied to sensitive data, pose a potential threat to privacy. A growing body of prior work has demonstrated that membership inference attack (MIA) can disclose specific private information in the training…

Cryptography and Security · Computer Science 2020-01-27 Bo Zhang , Ruotong Yu , Haipei Sun , Yanying Li , Jun Xu , Hui Wang

Designing privacy-preserving machine learning algorithms has received great attention in recent years, especially in the setting when the data contains sensitive information. Differential privacy (DP) is a widely used mechanism for data…

Machine Learning · Computer Science 2025-09-11 Chunyang Liao , Deanna Needell , Hayden Schaeffer , Alexander Xue

We review the use of differential privacy (DP) for privacy protection in machine learning (ML). We show that, driven by the aim of preserving the accuracy of the learned models, DP-based ML implementations are so loose that they do not…

Cryptography and Security · Computer Science 2023-01-09 Alberto Blanco-Justicia , David Sanchez , Josep Domingo-Ferrer , Krishnamurty Muralidhar

We consider a refinement of differential privacy --- per instance differential privacy (pDP), which captures the privacy of a specific individual with respect to a fixed data set. We show that this is a strict generalization of the standard…

Machine Learning · Statistics 2018-11-15 Yu-Xiang Wang

Machine learning models should not reveal particular information that is not otherwise accessible. Differential privacy provides a formal framework to mitigate privacy risks by ensuring that the inclusion or exclusion of any single data…

Cryptography and Security · Computer Science 2026-03-12 Francisco Aguilera-Martínez , Fernando Berzal

Differential Privacy (DP) is a widely adopted standard for privacy-preserving data analysis, but it assumes a uniform privacy budget across all records, limiting its applicability when privacy requirements vary with data values. Per-record…

Databases · Computer Science 2025-11-25 Xinghe Chen , Dajun Sun , Quanqing Xu , Wei Dong

Membership inference attacks (MIAs) are used to test practical privacy of machine learning models. MIAs complement formal guarantees from differential privacy (DP) under a more realistic adversary model. We analyse MIA vulnerability of…

Cryptography and Security · Computer Science 2026-02-03 Marlon Tobaben , Hibiki Ito , Joonas Jälkö , Yuan He , Antti Honkela

The widespread collection and sharing of location data, even in aggregated form, raises major privacy concerns. Previous studies used meta-classifier-based membership inference attacks~(MIAs) with multi-layer perceptrons~(MLPs) to estimate…

Cryptography and Security · Computer Science 2024-12-31 Yuhan Liu , Florent Guepin , Igor Shilov , Yves-Alexandre De Montjoye

Label differential privacy (label-DP) is a popular framework for training private ML models on datasets with public features and sensitive private labels. Despite its rigorous privacy guarantee, it has been observed that in practice…

Machine Learning · Computer Science 2023-06-06 Ruihan Wu , Jin Peng Zhou , Kilian Q. Weinberger , Chuan Guo

Differential privacy allows bounding the influence that training data records have on a machine learning model. To use differential privacy in machine learning, data scientists must choose privacy parameters $(\epsilon,\delta)$. Choosing…

Cryptography and Security · Computer Science 2021-07-21 Daniel Bernau , Günther Eibl , Philip W. Grassal , Hannah Keller , Florian Kerschbaum

Privacy-preserving machine learning aims to train models on private data without leaking sensitive information. Differential privacy (DP) is considered the gold standard framework for privacy-preserving training, as it provides formal…

In this paper, we present a notion of differential privacy (DP) for data that comes from different classes. Here, the class-membership is private information that needs to be protected. The proposed method is an output perturbation…

Signal Processing · Electrical Eng. & Systems 2023-06-12 Raksha Ramakrishna , Anna Scaglione , Tong Wu , Nikhil Ravi , Sean Peisert

Differential privacy (DP) has established itself as one of the standards for ensuring privacy of individual data. However, reasoning about DP is a challenging and error-prone task, hence methods for formal verification and refutation of DP…

Programming Languages · Computer Science 2026-04-13 Krishnendu Chatterjee , Ehsan Kafshdar Goharshady , Đorđe Žikelić