English
Related papers

Related papers: Sequentially Auditing Differential Privacy

200 papers

Significant success has been realized recently on applying machine learning to real-world applications. There have also been corresponding concerns on the privacy of training data, which relates to data security and confidentiality issues.…

Machine Learning · Statistics 2017-12-27 Bai Li , Changyou Chen , Hao Liu , Lawrence Carin

Differential Privacy (DP) is a key property to protect data and models from integrity attacks. In the Deep Learning (DL) field, it is commonly implemented through the Differentially Private Stochastic Gradient Descent (DP-SGD). However,…

Machine Learning · Computer Science 2023-11-21 Jiménez-López , Daniel , Rodríguez-Barroso , Nuria , Luzón , M. Victoria , Herrera , Francisco

We describe a new algorithm for answering a given set of range queries under $\epsilon$-differential privacy which often achieves substantially lower error than competing methods. Our algorithm satisfies differential privacy by adding noise…

Databases · Computer Science 2014-10-02 Chao Li , Michael Hay , Gerome Miklau , Yue Wang

As the use of differential privacy (DP) becomes widespread, the development of effective tools for reasoning about the privacy guarantee becomes increasingly critical. In pursuit of this goal, we demonstrate novel relationships between DP…

Cryptography and Security · Computer Science 2025-07-15 Zeki Kazan , Sagar Sharma , Wanrong Zhang , Bo Jiang , Qiang Yan

A common goal of privacy research is to release synthetic data that satisfies a formal privacy guarantee and can be used by an analyst in place of the original data. To achieve reasonable accuracy, a synthetic data set must be tuned to…

Databases · Computer Science 2015-03-20 Chao Li , Gerome Miklau

Fine-tuning large language models (LLMs) has become an essential strategy for adapting them to specialized tasks; however, this process introduces significant privacy challenges, as sensitive training data may be inadvertently memorized and…

Cryptography and Security · Computer Science 2025-05-02 Hao Du , Shang Liu , Yang Cao

Synthetic data generation methods, and in particular, private synthetic data generation methods, are gaining popularity as a means to make copies of sensitive databases that can be shared widely for research and data analysis. Some of the…

Databases · Computer Science 2023-09-18 Shweta Patwa , Danyu Sun , Amir Gilad , Ashwin Machanavajjhala , Sudeepa Roy

Differentially Private Stochastic Gradient Descent (DPSGD) is widely used to protect sensitive data during the training of machine learning models, but its privacy guarantee often comes at a large cost of model performance due to the lack…

Machine Learning · Computer Science 2026-01-16 Hao Liang , Wanrong Zhang , Xinlei He , Kaishun Wu , Hong Xing

Differential privacy has become the dominant standard in the research community for strong privacy protection. There has been a flood of research into query answering algorithms that meet this standard. Algorithms are becoming increasingly…

Databases · Computer Science 2015-12-16 Michael Hay , Ashwin Machanavajjhala , Gerome Miklau , Yan Chen , Dan Zhang

Differential Privacy (DP) is the current gold-standard for ensuring privacy for statistical queries. Estimation problems under DP constraints appearing in the literature have largely focused on providing equal privacy to all users. We…

Machine Learning · Computer Science 2025-04-22 Syomantak Chaudhuri , Thomas A. Courtade

In this paper, we systematize research on auditing Differential Privacy (DP) techniques, aiming to identify key insights and open challenges. First, we introduce a comprehensive framework for reviewing work in the field and establish three…

Cryptography and Security · Computer Science 2025-12-15 Meenatchi Sundaram Muthu Selva Annamalai , Borja Balle , Jamie Hayes , Georgios Kaissis , Emiliano De Cristofaro

Differential privacy (DP) is a key technique for protecting sensitive patient data in medical deep learning (DL). As clinical models grow more data-dependent, balancing privacy with utility and fairness has become a critical challenge. This…

Differentially private (DP) mechanisms face the challenge of providing accurate results while protecting their inputs: the privacy-utility trade-off. A simple but powerful technique for DP adds noise to sensitivity-bounded query outputs to…

Cryptography and Security · Computer Science 2021-07-28 David M. Sommer , Lukas Abfalterer , Sheila Zingg , Esfandiar Mohammadi

In this paper, we describe our approach to achieve distributed differential privacy by sampling alone. Our mechanism works in the semi-honest setting (honest-but-curious whereby aggregators attempt to peek at the data though follow the…

Cryptography and Security · Computer Science 2017-06-16 Joshua Joy

Differentially private noise mechanisms commonly use symmetric noise distributions. This is attractive both for achieving the differential privacy definition, and for unbiased expectations in the noised answers. However, there are contexts…

Cryptography and Security · Computer Science 2021-10-18 Benjamin M. Case , James Honaker , Mahnush Movahedi

To protect the privacy of individuals whose data is being shared, it is of high importance to develop methods allowing researchers and companies to release textual data while providing formal privacy guarantees to its originators. In the…

Machine Learning · Computer Science 2022-10-27 Justus Mattern , Zhijing Jin , Benjamin Weggenmann , Bernhard Schoelkopf , Mrinmaya Sachan

Differentially private (DP) mechanisms have been deployed in a variety of high-impact social settings (perhaps most notably by the U.S. Census). Since all DP mechanisms involve adding noise to results of statistical queries, they are…

Cryptography and Security · Computer Science 2023-12-20 Lucas Rosenblatt , Julia Stoyanovich , Christopher Musco

While significant progress has been made in conventional fairness-aware machine learning (ML) and differentially private ML (DPML), the fairness of privacy protection across groups remains underexplored. Existing studies have proposed…

Machine Learning · Computer Science 2025-11-18 Zhi Yang , Changwu Huang , Ke Tang , Xin Yao

Differential privacy is a promising privacy-preserving paradigm for statistical query processing over sensitive data. It works by injecting random noise into each query result, such that it is provably hard for the adversary to infer the…

Databases · Computer Science 2015-02-27 Ganzhao Yuan , Zhenjie Zhang , Marianne Winslett , Xiaokui Xiao , Yin Yang , Zhifeng Hao

In the arena of privacy-preserving machine learning, differentially private stochastic gradient descent (DP-SGD) has outstripped the objective perturbation mechanism in popularity and interest. Though unrivaled in versatility, DP-SGD…

Machine Learning · Computer Science 2024-01-02 Rachel Redberg , Antti Koskela , Yu-Xiang Wang