English
Related papers

Related papers: Debugging Differential Privacy: A Case Study for P…

200 papers

Ensuring differential privacy of models learned from sensitive user data is an important goal that has been studied extensively in recent years. It is now known that for some basic learning problems, especially those involving…

Machine Learning · Computer Science 2018-05-10 Cynthia Dwork , Vitaly Feldman

Differential privacy (DP) is the prevailing technique for protecting user data in machine learning models. However, deficits to this framework include a lack of clarity for selecting the privacy budget $\epsilon$ and a lack of…

Machine Learning · Computer Science 2023-06-29 Tyler LeBlond , Joseph Munoz , Fred Lu , Maya Fuchs , Elliott Zaresky-Williams , Edward Raff , Brian Testa

Context: Differential testing is a useful approach that uses different implementations of the same algorithms and compares the results for software testing. In recent years, this approach was successfully used for test campaigns of deep…

Software Engineering · Computer Science 2022-07-26 Steffen Herbold , Steffen Tunkel

This paper introduces a novel theoretical framework for auditing differential privacy (DP) in a black-box setting. Leveraging the concept of $f$-differential privacy, we explicitly define type I and type II errors and propose an auditing…

Methodology · Statistics 2025-04-14 Kaining Shi , Cong Ma

Differential privacy (DP) allows the quantification of privacy loss when the data of individuals is subjected to algorithmic processing such as machine learning, as well as the provision of objective privacy guarantees. However, while…

Cryptography and Security · Computer Science 2021-11-30 Tamara T. Mueller , Alexander Ziller , Dmitrii Usynin , Moritz Knolle , Friederike Jungmann , Daniel Rueckert , Georgios Kaissis

Protecting the privacy of people whose data is used by machine learning algorithms is important. Differential Privacy is the appropriate mathematical framework for formal guarantees of privacy, and boosted decision trees are a popular…

Machine Learning · Computer Science 2022-02-01 Vahid R. Asadi , Marco L. Carmosino , Mohammadmahdi Jahanara , Akbar Rafiey , Bahar Salamatian

Achieving differential privacy (DP) guarantees in fully decentralized machine learning is challenging due to the absence of a central aggregator and varying trust assumptions among nodes. We present a framework for DP analysis of…

Machine Learning · Computer Science 2026-02-06 Antti Koskela , Tejas Kulkarni

Differential privacy is a cryptographically-motivated approach to privacy that has become a very active field of research over the last decade in theoretical computer science and machine learning. In this paradigm one assumes there is a…

Machine Learning · Computer Science 2023-08-02 Marco Avella-Medina

Bayesian optimization is a powerful tool for fine-tuning the hyper-parameters of a wide variety of machine learning models. The success of machine learning has led practitioners in diverse real-world settings to learn classifiers for…

Machine Learning · Statistics 2015-02-24 Matt J. Kusner , Jacob R. Gardner , Roman Garnett , Kilian Q. Weinberger

Fairness auditing of AI systems can identify and quantify biases. However, traditional auditing using real-world data raises security and privacy concerns. It exposes auditors to security risks as they become custodians of sensitive…

Computers and Society · Computer Science 2025-05-01 Chih-Cheng Rex Yuan , Bow-Yaw Wang

Differential privacy (DP) implementations are notoriously prone to errors, with subtle bugs frequently invalidating theoretical guarantees. Existing verification methods are often impractical: formal tools are too restrictive, while…

Cryptography and Security · Computer Science 2026-02-20 Tudor Cebere , David Erb , Damien Desfontaines , Aurélien Bellet , Jack Fitzsimons

In this work we address the practical challenges of training machine learning models on privacy-sensitive datasets by introducing a modular approach that minimizes changes to training algorithms, provides a variety of configuration…

Machine Learning · Computer Science 2019-03-05 H. Brendan McMahan , Galen Andrew , Ulfar Erlingsson , Steve Chien , Ilya Mironov , Nicolas Papernot , Peter Kairouz

ML models are ubiquitous in real world applications and are a constant focus of research. At the same time, the community has started to realize the importance of protecting the privacy of ML training data. Differential Privacy (DP) has…

Since being proposed in 2006, differential privacy has become a standard method for quantifying certain risks in publishing or sharing analyses of sensitive data. At its heart, differential privacy measures risk in terms of the differences…

Information Theory · Computer Science 2025-11-19 Anand D. Sarwate , Flavio P. Calmon , Oliver Kosut , Lalitha Sankar

The use of Deep Neural Network based systems in the real world is growing. They have achieved state-of-the-art performance on many image, speech and text datasets. They have been shown to be powerful systems that are capable of learning…

Machine Learning · Computer Science 2026-04-21 Alizishaan Anwar Hussein Khatri

Quantum machine learning (QML) promises significant computational advantages, yet models trained on sensitive data risk memorizing individual records, creating serious privacy vulnerabilities. While Quantum Differential Privacy (QDP)…

Machine Learning · Computer Science 2025-12-17 Baobao Song , Shiva Raj Pokhrel , Athanasios V. Vasilakos , Tianqing Zhu , Gang Li

Differential privacy is a rigorous, worst-case notion of privacy-preserving computation. Informally, a probabilistic program is differentially private if the participation of a single individual in the input database has a limited effect on…

Logic in Computer Science · Computer Science 2018-03-16 Gilles Barthe , Marco Gaboardi , Emilio Jesús Gallego Arias , Justin Hsu , César Kunz , Pierre-Yves Strub

As in traditional machine learning models, models trained with federated learning may exhibit disparate performance across demographic groups. Model holders must identify these disparities to mitigate undue harm to the groups. However,…

Machine Learning · Computer Science 2023-01-12 Marc Juarez , Aleksandra Korolova

We study the privatization of distributed learning and optimization strategies. We focus on differential privacy schemes and study their effect on performance. We show that the popular additive random perturbation scheme degrades…

Machine Learning · Computer Science 2023-01-18 Elsa Rizk , Stefan Vlaski , Ali H. Sayed

We study a pitfall in the typical workflow for differentially private machine learning. The use of differentially private learning algorithms in a "drop-in" fashion -- without accounting for the impact of differential privacy (DP) noise…

Cryptography and Security · Computer Science 2022-05-16 Wenxuan Bao , Luke A. Bauer , Vincent Bindschaedler