English
Related papers

Related papers: Auditing Differential Privacy in the Black-Box Set…

200 papers

In this work we study black-box privacy auditing, where the goal is to lower bound the privacy parameter of a differentially private learning algorithm using only the algorithm's outputs (i.e., final trained model). For DP-SGD (the most…

Machine Learning · Computer Science 2025-07-22 Matteo Boglioni , Terrance Liu , Andrew Ilyas , Zhiwei Steven Wu

Differential Privacy (DP) is a well-established framework to quantify privacy loss incurred by any algorithm. Traditional DP formulations impose a uniform privacy requirement for all users, which is often inconsistent with real-world…

Cryptography and Security · Computer Science 2023-05-18 Syomantak Chaudhuri , Thomas A. Courtade

Differential privacy (DP) is a formal privacy framework that enables training machine learning (ML) models while protecting individuals' data. As pointed out by prior work, ML models are part of larger systems, which can lead to so-called…

Machine Learning · Computer Science 2026-04-27 Marlon Tobaben , Talal Alrawajfeh , Marcus Klasson , Mikko Heikkilä , Arno Solin , Antti Honkela

In this paper, we provide two views of constrained differential private (DP) mechanisms. The first one is as belief revision. A constrained DP mechanism is obtained by standard probabilistic conditioning, and hence can be naturally…

Cryptography and Security · Computer Science 2023-03-02 Likang Liu , Keke Sun , Chunlai Zhou , Yuan Feng

Differential private (DP) query and response mechanisms have been widely adopted in various applications based on Internet of Things (IoT) to leverage variety of benefits through data analysis. The protection of sensitive information is…

Cryptography and Security · Computer Science 2022-12-09 Muhammad Islam , Mubashir Husain Rehmani , Jinjun Chen

We develop differentially private hypothesis testing methods for the small sample regime. Given a sample $\cal D$ from a categorical distribution $p$ over some domain $\Sigma$, an explicitly described distribution $q$ over $\Sigma$, some…

Data Structures and Algorithms · Computer Science 2017-06-08 Bryan Cai , Constantinos Daskalakis , Gautam Kamath

Differential Privacy (DP) has emerged as a pivotal approach for safeguarding individual privacy in data analysis, yet its practical adoption is often hindered by challenges in the implementation and communication of DP. This paper presents…

Human-Computer Interaction · Computer Science 2025-07-03 Onyinye Dibia , Prianka Bhattacharjee , Brad Stenger , Steven Baldasty , Mako Bates , Ivoline C. Ngong , Yuanyuan Feng , Joseph P. Near

Differentially private (DP) mechanisms are difficult to interpret and calibrate because existing methods for mapping standard privacy parameters to concrete privacy risks -- re-identification, attribute inference, and data reconstruction --…

Differential privacy schemes have been widely adopted in recent years to address issues of data privacy protection. We propose a new Gaussian scheme combining with another data protection technique, called random orthogonal matrix masking,…

Cryptography and Security · Computer Science 2023-04-13 A. Adam Ding , Samuel S. Wu , Guanhong Miao , Shigang Chen

We describe a new algorithm for answering a given set of range queries under $\epsilon$-differential privacy which often achieves substantially lower error than competing methods. Our algorithm satisfies differential privacy by adding noise…

Databases · Computer Science 2014-10-02 Chao Li , Michael Hay , Gerome Miklau , Yue Wang

ML models are ubiquitous in real world applications and are a constant focus of research. At the same time, the community has started to realize the importance of protecting the privacy of ML training data. Differential Privacy (DP) has…

Differential privacy (DP) has emerged as a de facto standard privacy notion for a wide range of applications. Since the meaning of data utility in different applications may vastly differ, a key challenge is to find the optimal…

Cryptography and Security · Computer Science 2020-09-25 Meisam Mohammady , Shangyu Xie , Yuan Hong , Mengyuan Zhang , Lingyu Wang , Makan Pourzandi , Mourad Debbabi

We study the relationship between two desiderata of algorithms in statistical inference and machine learning: differential privacy and robustness to adversarial data corruptions. Their conceptual similarity was first observed by Dwork and…

Machine Learning · Computer Science 2023-02-06 Hilal Asi , Jonathan Ullman , Lydia Zakynthinou

The literature on differential privacy almost invariably assumes that the data to be analyzed are fully observed. In most practical applications this is an unrealistic assumption. A popular strategy to address this problem is imputation, in…

Databases · Computer Science 2022-07-15 Soumojit Das , Jorg Drechsler , Keith Merrill , Shawn Merrill

Quantum computing has been widely applied in various fields, such as quantum physics simulations, quantum machine learning, and big data analysis. However, in the domains of data-driven paradigm, how to ensure the privacy of the database is…

Quantum Physics · Physics 2024-04-10 Yuqing Li , Yusheng Zhao , Xinyue Zhang , Hui Zhong , Miao Pan , Chi Zhang

Machine learning models should not reveal particular information that is not otherwise accessible. Differential privacy provides a formal framework to mitigate privacy risks by ensuring that the inclusion or exclusion of any single data…

Cryptography and Security · Computer Science 2026-03-12 Francisco Aguilera-Martínez , Fernando Berzal

In this note, we consider the problem of differentially privately (DP) computing an anonymized histogram, which is defined as the multiset of counts of the input dataset (without bucket labels). In the low-privacy regime $\epsilon \geq 1$,…

Data Structures and Algorithms · Computer Science 2021-11-08 Pasin Manurangsi

Through the lens of information-theoretic reductions, we examine a reductions approach to fair optimization and learning where a black-box optimizer is used to learn a fair model for classification or regression. Quantifying the complexity,…

Machine Learning · Computer Science 2021-05-25 Daniel Alabi

Differential privacy (DP) is a formal notion for quantifying the privacy loss of algorithms. Algorithms in the central model of DP achieve high accuracy but make the strongest trust assumptions whereas those in the local DP model make the…

Cryptography and Security · Computer Science 2021-06-09 Badih Ghazi , Ravi Kumar , Pasin Manurangsi , Rasmus Pagh

We consider the problem of property testing for differential privacy: with black-box access to a purportedly private algorithm, can we verify its privacy guarantees? In particular, we show that any privacy guarantee that can be efficiently…

Cryptography and Security · Computer Science 2019-02-14 Anna Gilbert , Audra McMillan