English
Related papers

Related papers: Efficient DP-SGD for LLMs with Randomized Clipping

200 papers

Large language models (LLMs) trained on web-scale corpora can memorize sensitive training data, posing significant privacy risks. Differential privacy (DP) has emerged as a principled framework that limits the influence of individual data…

Computation and Language · Computer Science 2026-05-13 Eduardo Tenorio , Karuna Bhaila , Xintao Wu

Training machine learning models based on neural networks requires large datasets, which may contain sensitive information. The models, however, should not expose private information from these datasets. Differentially private SGD [DP-SGD]…

Machine Learning · Computer Science 2024-09-26 Francisco Aguilera-Martínez , Fernando Berzal

Large language models (LLMs) are increasingly adapted to proprietary and domain-specific corpora that contain sensitive information, creating a tension between formal privacy guarantees and efficient deployment through model compression.…

Machine Learning · Computer Science 2026-04-07 Fatemeh Khadem , Sajad Mousavi , Yi Fang , Yuhong Liu

Differentially Private Stochastic Gradient Descent with Gradient Clipping (DPSGD-GC) is a powerful tool for training deep learning models using sensitive data, providing both a solid theoretical privacy guarantee and high efficiency.…

Machine Learning · Computer Science 2024-04-18 Xinwei Zhang , Zhiqi Bu , Zhiwei Steven Wu , Mingyi Hong

Differential Privacy (DP) is a widely adopted technique, valued for its effectiveness in protecting the privacy of task-specific datasets, making it a critical tool for large language models. However, its effectiveness in Multimodal Large…

Cryptography and Security · Computer Science 2025-06-10 Qianshan Wei , Jiaqi Li , Zihan You , Yi Zhan , Kecen Li , Jialin Wu , Xinfeng Li Hengjun Liu , Yi Yu , Bin Cao , Yiwen Xu , Yang Liu , Guilin Qi

Differentially Private Stochastic Gradient Descent (DP-SGD) is widely used to protect training data in machine learning. Its privacy guarantee is commonly analyzed through a security game in which an adversary infers whether a target record…

Cryptography and Security · Computer Science 2026-05-18 Wenhao Wang , Shujie Cui , Hui Cui , Xingliang Yuan

Training large neural networks with meaningful/usable differential privacy security guarantees is a demanding challenge. In this paper, we tackle this problem by revisiting the two key operations in Differentially Private Stochastic…

Machine Learning · Computer Science 2022-10-11 Hanshen Xiao , Jun Wan , Srinivas Devadas

Privacy preservation in machine learning, particularly through Differentially Private Stochastic Gradient Descent (DP-SGD), is critical for sensitive data analysis. However, existing statistical inference methods for SGD predominantly focus…

Machine Learning · Statistics 2025-12-15 Xintao Xia , Linjun Zhang , Zhanrui Cai

Differential Privacy (DP) provides a formal privacy guarantee preventing adversaries with access to a machine learning model from extracting information about individual training points. Differentially Private Stochastic Gradient Descent…

Machine Learning · Computer Science 2022-06-17 Soham De , Leonard Berrada , Jamie Hayes , Samuel L. Smith , Borja Balle

We present backpropagation clipping, a novel variant of differentially private stochastic gradient descent (DP-SGD) for privacy-preserving deep learning. Our approach clips each trainable layer's inputs (during the forward pass) and its…

Machine Learning · Computer Science 2022-02-21 Timothy Stevens , Ivoline C. Ngong , David Darais , Calvin Hirsch , David Slater , Joseph P. Near

Differentially private stochastic gradient descent (DP-SGD) is a standard approach to privacy-preserving learning based on per-example clipping, subsampling, Gaussian perturbation, and privacy accounting. Classical DP-SGD releases a noisy…

Cryptography and Security · Computer Science 2026-05-12 Mohammad Partohaghighi , Roummel Marcia

Machine learning models are known to memorize private data to reduce their training loss, which can be inadvertently exploited by privacy attacks such as model inversion and membership inference. To protect against these attacks,…

Machine Learning · Computer Science 2023-11-30 Jie Fu , Qingqing Ye , Haibo Hu , Zhili Chen , Lulu Wang , Kuncan Wang , Xun Ran

Differential privacy (DP) is a popular mechanism for training machine learning models with bounded leakage about the presence of specific points in the training data. The cost of differential privacy is a reduction in the model's accuracy.…

Machine Learning · Computer Science 2019-10-29 Eugene Bagdasaryan , Vitaly Shmatikov

Differentially private stochastic gradient descent (DP-SGD) is broadly considered to be the gold standard for training and fine-tuning neural networks under differential privacy (DP). With the increasing availability of high-quality…

Differentially private (DP) training preserves the data privacy usually at the cost of slower convergence (and thus lower accuracy), as well as more severe mis-calibration than its non-private counterpart. To analyze the convergence of DP…

Machine Learning · Computer Science 2023-06-21 Zhiqi Bu , Hua Wang , Zongyu Dai , Qi Long

Differentially Private Stochastic Gradient Descent (DP-SGD) is a cornerstone technique for ensuring privacy in deep learning, widely used in both training from scratch and fine-tuning large-scale language models. While DP-SGD predominantly…

Cryptography and Security · Computer Science 2026-03-10 Meisam Mohammady , Qin Yang , Nicholas Stout , Ayesha Samreen , Han Wang , Christopher J Quinn , Yuan Hong

Training generative models with differential privacy (DP) typically involves injecting noise into gradient updates or adapting the discriminator's training procedure. As a result, such approaches often struggle with hyper-parameter tuning…

Machine Learning · Computer Science 2024-10-29 Kristjan Greenewald , Yuancheng Yu , Hao Wang , Kai Xu

Differential Privacy (DP) is becoming central to large-scale training as privacy regulations tighten. We revisit how DP noise interacts with adaptivity in optimization through the lens of stochastic differential equations, providing the…

In privacy-preserving machine learning, differentially private stochastic gradient descent (DP-SGD) performs worse than SGD due to per-sample gradient clipping and noise addition. A recent focus in private learning research is improving the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Xinyu Tang , Ashwinee Panda , Vikash Sehwag , Prateek Mittal

Privacy preserving machine learning algorithms are crucial for learning models over user data to protect sensitive information. Motivated by this, differentially private stochastic gradient descent (SGD) algorithms for training machine…

Machine Learning · Computer Science 2019-10-25 Venkatadheeraj Pichapati , Ananda Theertha Suresh , Felix X. Yu , Sashank J. Reddi , Sanjiv Kumar