English
Related papers

Related papers: Understanding Gradient Clipping in Private SGD: A …

200 papers

In this paper, an adjustment to the original differentially private stochastic gradient descent (DPSGD) algorithm for deep learning models is proposed. As a matter of motivation, to date, almost no state-of-the-art machine learning…

Machine Learning · Computer Science 2021-07-13 Mehdi Amian

Training generative models with differential privacy (DP) typically involves injecting noise into gradient updates or adapting the discriminator's training procedure. As a result, such approaches often struggle with hyper-parameter tuning…

Machine Learning · Computer Science 2024-10-29 Kristjan Greenewald , Yuancheng Yu , Hao Wang , Kai Xu

Models need to be trained with privacy-preserving learning algorithms to prevent leakage of possibly sensitive information contained in their training data. However, canonical algorithms like differentially private stochastic gradient…

Machine Learning · Computer Science 2022-10-06 Yannis Cattan , Christopher A. Choquette-Choo , Nicolas Papernot , Abhradeep Thakurta

The success of modern machine learning is due in part to the adaptive optimization methods that have been developed to deal with the difficulties of training large models over complex datasets. One such method is gradient clipping: a…

Machine Learning · Statistics 2024-10-08 Noah Marshall , Ke Liang Xiao , Atish Agarwala , Elliot Paquette

As the use of large embedding models in recommendation systems and language applications increases, concerns over user data privacy have also risen. DP-SGD, a training algorithm that combines differential privacy with stochastic gradient…

Machine Learning · Computer Science 2023-11-15 Badih Ghazi , Yangsibo Huang , Pritish Kamath , Ravi Kumar , Pasin Manurangsi , Amer Sinha , Chiyuan Zhang

Differentially private stochastic gradient descent (DP-SGD) is the workhorse algorithm for recent advances in private deep learning. It provides a single privacy guarantee to all datapoints in the dataset. We propose output-specific…

Machine Learning · Computer Science 2024-07-26 Da Yu , Gautam Kamath , Janardhan Kulkarni , Tie-Yan Liu , Jian Yin , Huishuai Zhang

Differential privacy (DP) provides strong protection for sensitive data, but often reduces model performance and fairness, especially for underrepresented groups. One major reason is gradient clipping in DP-SGD, which can disproportionately…

Machine Learning · Computer Science 2025-10-08 Dorsa Soleymani , Ali Dadsetan , Frank Rudzicz

The privacy leakage of the model about the training data can be bounded in the differential privacy mechanism. However, for meaningful privacy parameters, a differentially private model degrades the utility drastically when the model…

Machine Learning · Computer Science 2021-10-13 Da Yu , Huishuai Zhang , Wei Chen , Tie-Yan Liu

The Deep Leakage from Gradient (DLG) attack has emerged as a prevalent and highly effective method for extracting sensitive training data by inspecting exchanged gradients. This approach poses a substantial threat to the privacy of…

Machine Learning · Computer Science 2023-11-27 Chenyang Li , Zhao Song , Weixin Wang , Chiwun Yang

Gradient clipping is commonly used in training deep neural networks partly due to its practicability in relieving the exploding gradient problem. Recently, \citet{zhang2019gradient} show that clipped (stochastic) Gradient Descent (GD)…

Machine Learning · Computer Science 2020-10-30 Bohang Zhang , Jikai Jin , Cong Fang , Liwei Wang

Recent work on Renyi Differential Privacy has shown the feasibility of applying differential privacy to deep learning tasks. Despite their promise, however, differentially private deep networks often lag far behind their non-private…

Machine Learning · Computer Science 2020-09-08 Jaewoo Lee , Daniel Kifer

Differential privacy (DP) provides a formal privacy guarantee that prevents adversaries with access to machine learning models from extracting information about individual training points. Differentially private stochastic gradient descent…

Cryptography and Security · Computer Science 2022-12-15 Jie Fu , Zhili Chen , XinPeng Ling

Differentially Private Stochastic Gradients Descent (DP-SGD) is a prominent paradigm for preserving privacy in deep learning. It ensures privacy by perturbing gradients with random noise calibrated to their entire norm at each training…

Cryptography and Security · Computer Science 2024-06-06 Yixuan Liu , Li Xiong , Yuhan Liu , Yujie Gu , Ruixuan Liu , Hong Chen

Differentially private stochastic gradient descent (DP-SGD) is broadly considered to be the gold standard for training and fine-tuning neural networks under differential privacy (DP). With the increasing availability of high-quality…

The application of differential privacy to the training of deep neural networks holds the promise of allowing large-scale (decentralized) use of sensitive data while providing rigorous privacy guarantees to the individual. The predominant…

Machine Learning · Computer Science 2021-08-11 Moritz Knolle , Dmitrii Usynin , Alexander Ziller , Marcus R. Makowski , Daniel Rueckert , Georgios Kaissis

Training differentially private machine learning models requires constraining an individual's contribution to the optimization process. This is achieved by clipping the $2$-norm of their gradient at a predetermined threshold prior to…

Machine Learning · Computer Science 2024-01-09 Filippo Galli , Catuscia Palamidessi , Tommaso Cucinotta

With the vigorous development of artificial intelligence technology, various engineering technology applications have been implemented one after another. The gradient descent method plays an important role in solving various optimization…

Machine Learning · Computer Science 2021-04-27 Jinhuan Duan , Xianxian Li , Shiqi Gao , Jinyan Wang , Zili Zhong

Stochastic optimization is a pivotal enabler in modern machine learning, producing effective models for various tasks. However, several existing works have shown that model parameters and gradient information are susceptible to privacy…

Machine Learning · Computer Science 2025-09-15 Zhanhong Jiang , Md Zahid Hasan , Nastaran Saadati , Aditya Balu , Chao Liu , Soumik Sarkar

In privacy-preserving machine learning, differentially private stochastic gradient descent (DP-SGD) performs worse than SGD due to per-sample gradient clipping and noise addition. A recent focus in private learning research is improving the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Xinyu Tang , Ashwinee Panda , Vikash Sehwag , Prateek Mittal

When we enforce differential privacy in machine learning, the utility-privacy trade-off is different w.r.t. each group. Gradient clipping and random noise addition disproportionately affect underrepresented and complex classes and…

Machine Learning · Computer Science 2020-09-29 Depeng Xu , Wei Du , Xintao Wu