English
Related papers

Related papers: Auditing Differential Privacy in the Black-Box Set…

200 papers

Local Differential Privacy (LDP) provides provable privacy protection for data collection without the assumption of the trusted data server. In the real-world scenario, different data have different privacy requirements due to the distinct…

Cryptography and Security · Computer Science 2020-02-25 Xiaolan Gu , Ming Li , Li Xiong , Yang Cao

$\epsilon$-Differential privacy (DP) is a well-known privacy model that offers strong privacy guarantees. However, when applied to data releases, DP significantly deteriorates the analytical utility of the protected outcomes. To keep data…

Cryptography and Security · Computer Science 2023-12-22 Jordi Soria-Comas , David Sánchez , Josep Domingo-Ferrer , Sergio Martínez , Luis Del Vasto-Terrientes

This paper presents an auditing procedure for the Differentially Private Stochastic Gradient Descent (DP-SGD) algorithm in the black-box threat model that is substantially tighter than prior work. The main intuition is to craft worst-case…

Cryptography and Security · Computer Science 2024-11-05 Meenatchi Sundaram Muthu Selva Annamalai , Emiliano De Cristofaro

Differential privacy (DP) enables private data analysis. In a typical DP deployment, controllers manage individuals' sensitive data and are responsible for answering analysts' queries while protecting individuals' privacy. They do so by…

Databases · Computer Science 2026-05-05 Zhiru Zhu , Raul Castro Fernandez

We propose a scheme for auditing differentially private machine learning systems with a single training run. This exploits the parallelism of being able to add or remove multiple training examples independently. We analyze this using the…

Machine Learning · Computer Science 2023-05-16 Thomas Steinke , Milad Nasr , Matthew Jagielski

Black-box machine learning models are used in critical decision-making domains, giving rise to several calls for more algorithmic transparency. The drawback is that model explanations can leak information about the training data and the…

Machine Learning · Computer Science 2020-06-17 Neel Patel , Reza Shokri , Yair Zick

Differential privacy (DP) provides formal guarantees that the output of a database query does not reveal too much information about any individual present in the database. While many differentially private algorithms have been proposed in…

Cryptography and Security · Computer Science 2019-11-27 Royce J Wilson , Celia Yuxin Zhang , William Lam , Damien Desfontaines , Daniel Simmons-Marengo , Bryant Gipson

Differential privacy (DP) has been applied in deep learning for preserving privacy of the underlying training sets. Existing DP practice falls into three categories - objective perturbation, gradient perturbation and output perturbation.…

Cryptography and Security · Computer Science 2022-04-28 Zhigang Lu , Hassan Jameel Asghar , Mohamed Ali Kaafar , Darren Webb , Peter Dickinson

As the use of differential privacy (DP) becomes widespread, the development of effective tools for reasoning about the privacy guarantee becomes increasingly critical. In pursuit of this goal, we demonstrate novel relationships between DP…

Cryptography and Security · Computer Science 2025-07-15 Zeki Kazan , Sagar Sharma , Wanrong Zhang , Bo Jiang , Qiang Yan

How can agents exchange information to learn while protecting privacy? Healthcare centers collaborating on clinical trials must balance knowledge sharing with safeguarding sensitive patient data. We address this challenge by using…

Machine Learning · Computer Science 2025-03-19 Marios Papachristou , M. Amin Rahimian

Private and public organizations regularly collect and analyze digitalized data about their associates, volunteers, clients, etc. However, because most personal data are sensitive, there is a key challenge in designing privacy-preserving…

Cryptography and Security · Computer Science 2022-04-05 Héber H. Arcolezi

We study the problem of performing counting queries at different levels in hierarchical structures while preserving individuals' privacy. Motivated by applications, we propose a new error measure for this problem by considering a…

Data Structures and Algorithms · Computer Science 2023-04-28 Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Kewen Wu

Estimating causal effects from randomized experiments is only possible if participants are willing to disclose their potentially sensitive responses. Differential privacy, a widely used framework for ensuring an algorithms privacy…

Machine Learning · Statistics 2025-05-29 Adel Javanmard , Vahab Mirrokni , Jean Pouget-Abadie

As data-driven technologies advance swiftly, maintaining strong privacy measures becomes progressively difficult. Conventional $(\epsilon, \delta)$-differential privacy, while prevalent, exhibits limited adaptability for many applications.…

Cryptography and Security · Computer Science 2025-07-03 Yifeng Liu , Zehua Wang

Differential privacy (DP) has become the de facto standard of privacy preservation due to its strong protection and sound mathematical foundation, which is widely adopted in different applications such as big data analysis, graph data…

Cryptography and Security · Computer Science 2021-12-06 Honglu Jiang , Yifeng Gao , S M Sarwar , Luis GarzaPerez , Mahmudul Robin

In this paper, we present a framework based on differential privacy (DP) for querying electric power measurements to detect system anomalies or bad data. Our DP approach conceals consumption and system matrix data, while simultaneously…

Signal Processing · Electrical Eng. & Systems 2024-03-26 Nikhil Ravi , Anna Scaglione , Sean Peisert , Parth Pradhan

Fine-tuning large language models (LLMs) has become an essential strategy for adapting them to specialized tasks; however, this process introduces significant privacy challenges, as sensitive training data may be inadvertently memorized and…

Cryptography and Security · Computer Science 2025-05-02 Hao Du , Shang Liu , Yang Cao

Differentially private (DP) decentralized Federated Learning (FL) allows local users to collaborate without sharing their data with a central server. However, accurately quantifying the privacy budget of private FL algorithms is challenging…

Machine Learning · Computer Science 2025-10-24 Xiang Li , Buxin Su , Chendi Wang , Qi Long , Weijie J. Su

Auditing differential privacy has emerged as an important area of research that supports the design of privacy-preserving mechanisms. Privacy audits help to obtain empirical estimates of the privacy parameter, to expose flawed…

Cryptography and Security · Computer Science 2025-09-25 Önder Askin , Tim Kutta , Holger Dette

We present a rigorous methodology for auditing differentially private machine learning algorithms by adding multiple carefully designed examples called canaries. We take a first principles approach based on three key components. First, we…

Machine Learning · Computer Science 2023-05-31 Krishna Pillutla , Galen Andrew , Peter Kairouz , H. Brendan McMahan , Alina Oprea , Sewoong Oh