English
Related papers

Related papers: Adversarial Sample-Based Approach for Tighter Priv…

200 papers

We consider the problem of minimizing a convex risk with stochastic subgradients guaranteeing $\epsilon$-locally differentially private ($\epsilon$-LDP). While it has been shown that stochastic optimization is possible with $\epsilon$-LDP…

Machine Learning · Computer Science 2019-11-22 Kwang-Sung Jun , Francesco Orabona

We explore the training of generative adversarial networks with differential privacy to anonymize image data sets. On MNIST, we numerically measure the privacy-utility trade-off using parameters from $\epsilon$-$\delta$ differential privacy…

Machine Learning · Computer Science 2020-05-07 Justus T. C. Schwabedal , Pascal Michel , Mario S. Riontino

Differential privacy (DP) has become an essential framework for privacy-preserving machine learning. Existing DP learning methods, however, often have disparate impacts on model predictions, e.g., for minority groups. Gradient clipping,…

Machine Learning · Computer Science 2025-06-03 Linzh Zhao , Aki Rehn , Mikko A. Heikkilä , Razane Tajeddine , Antti Honkela

Differentially Private Stochastic Gradients Descent (DP-SGD) is a prominent paradigm for preserving privacy in deep learning. It ensures privacy by perturbing gradients with random noise calibrated to their entire norm at each training…

Cryptography and Security · Computer Science 2024-06-06 Yixuan Liu , Li Xiong , Yuhan Liu , Yujie Gu , Ruixuan Liu , Hong Chen

Privacy concerns have led to the development of privacy-preserving approaches for learning models from sensitive data. Yet, in practice, even models learned with privacy guarantees can inadvertently memorize unique training examples or leak…

Machine Learning · Statistics 2019-11-11 Mario Diaz , Peter Kairouz , Jiachun Liao , Lalitha Sankar

The increased application of machine learning (ML) in sensitive domains requires protecting the training data through privacy frameworks, such as differential privacy (DP). DP requires to specify a uniform privacy level $\varepsilon$ that…

Machine Learning · Computer Science 2024-01-31 Krishna Acharya , Franziska Boenisch , Rakshit Naidu , Juba Ziani

Differentially Private Stochastic Gradient Descent (DP-SGD) and its variants have been proposed to ensure rigorous privacy for fine-tuning large-scale pre-trained language models. However, they rely heavily on the Gaussian mechanism, which…

Cryptography and Security · Computer Science 2024-05-30 Qin Yang , Meisam Mohammad , Han Wang , Ali Payani , Ashish Kundu , Kai Shu , Yan Yan , Yuan Hong

Differentially private stochastic gradient descent (DP-SGD) is the gold standard for training machine learning models with formal differential privacy guarantees. Several recent extensions improve its accuracy by introducing correlated…

Machine Learning · Computer Science 2026-05-13 Nikita P. Kalinin , Ryan McKenna , Rasmus Pagh , Christoph H. Lampert

Preserving privacy in contemporary NLP models allows us to work with sensitive data, but unfortunately comes at a price. We know that stricter privacy guarantees in differentially-private stochastic gradient descent (DP-SGD) generally…

Computation and Language · Computer Science 2023-02-01 Manuel Senge , Timour Igamberdiev , Ivan Habernal

In this paper we propose new methods to statistically assess $f$-Differential Privacy ($f$-DP), a recent refinement of differential privacy (DP) that remedies certain weaknesses of standard DP (including tightness under algorithmic…

Cryptography and Security · Computer Science 2025-06-16 Önder Askin , Holger Dette , Martin Dunsche , Tim Kutta , Yun Lu , Yu Wei , Vassilis Zikas

Understanding the relationship between generalization and privacy remains a central challenge in modern machine learning theory, particularly for deep networks trained by variants of differentially private stochastic gradient descent…

Machine Learning · Computer Science 2026-05-27 Christoph H. Lampert , Hossein Zakerinia

Differential privacy (DP) considers a scenario, where an adversary has almost complete information about the entries of a database This worst-case assumption is likely to overestimate the privacy thread for an individual in real life.…

Cryptography and Security · Computer Science 2025-04-16 Dennis Breutigam , Rüdiger Reischuk

This work studies anomaly detection under differential privacy (DP) with Gaussian perturbation using both statistical and information-theoretic tools. In our setting, the adversary aims to modify the content of a statistical dataset by…

Information Theory · Computer Science 2022-08-23 Ayse Unsal , Melek Onen

Differentially private stochastic gradient descent (DP-SGD) is the standard algorithm for training machine learning models under differential privacy (DP). The most common DP-SGD privacy accountants rely on Poisson subsampling to ensure the…

Machine Learning · Computer Science 2026-01-14 Sebastian Rodriguez Beltran , Marlon Tobaben , Joonas Jälkö , Niki Loppi , Antti Honkela

Differentially Private Stochastic Gradient Descent (DP-SGD) forms a fundamental building block in many applications for learning over sensitive data. Two standard approaches, privacy amplification by subsampling, and privacy amplification…

Machine Learning · Computer Science 2020-07-31 Borja Balle , Peter Kairouz , H. Brendan McMahan , Om Thakkar , Abhradeep Thakurta

Privacy preserving machine learning algorithms are crucial for learning models over user data to protect sensitive information. Motivated by this, differentially private stochastic gradient descent (SGD) algorithms for training machine…

Machine Learning · Computer Science 2019-10-25 Venkatadheeraj Pichapati , Ananda Theertha Suresh , Felix X. Yu , Sashank J. Reddi , Sanjiv Kumar

While the existing literature on Differential Privacy (DP) auditing predominantly focuses on the centralized model (e.g., in auditing the DP-SGD algorithm), we advocate for extending this approach to audit Local DP (LDP). To achieve this,…

Cryptography and Security · Computer Science 2024-07-15 Héber H. Arcolezi , Sébastien Gambs

We demonstrate a substantial gap between the privacy guarantees of the Adaptive Batch Linear Queries (ABLQ) mechanism under different types of batch sampling: (i) Shuffling, and (ii) Poisson subsampling; the typical analysis of…

Machine Learning · Computer Science 2024-06-07 Lynn Chua , Badih Ghazi , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Amer Sinha , Chiyuan Zhang

Differentially private stochastic gradient descent (DP-SGD) is a standard approach to privacy-preserving learning based on per-example clipping, subsampling, Gaussian perturbation, and privacy accounting. Classical DP-SGD releases a noisy…

Cryptography and Security · Computer Science 2026-05-12 Mohammad Partohaghighi , Roummel Marcia

In this paper, we revisit the problem of using in-distribution public data to improve the privacy/utility trade-offs for differentially private (DP) model training. (Here, public data refers to auxiliary data sets that have no privacy…