English
Related papers

Related papers: Q-ShiftDP: A Differentially Private Parameter-Shif…

200 papers

The application of differential privacy to the training of deep neural networks holds the promise of allowing large-scale (decentralized) use of sensitive data while providing rigorous privacy guarantees to the individual. The predominant…

Machine Learning · Computer Science 2021-08-11 Moritz Knolle , Dmitrii Usynin , Alexander Ziller , Marcus R. Makowski , Daniel Rueckert , Georgios Kaissis

Differentially Private Stochastic Gradient Descent (DP-SGD) is a key method for applying privacy in the training of deep learning models. It applies isotropic Gaussian noise to gradients during training, which can perturb these gradients in…

Machine Learning · Computer Science 2023-11-28 Pedro Faustini , Natasha Fernandes , Shakila Tonni , Annabelle McIver , Mark Dras

Differential Privacy (DP) is a widely adopted technique, valued for its effectiveness in protecting the privacy of task-specific datasets, making it a critical tool for large language models. However, its effectiveness in Multimodal Large…

Cryptography and Security · Computer Science 2025-06-10 Qianshan Wei , Jiaqi Li , Zihan You , Yi Zhan , Kecen Li , Jialin Wu , Xinfeng Li Hengjun Liu , Yi Yu , Bin Cao , Yiwen Xu , Yang Liu , Guilin Qi

Differentially private stochastic gradient descent (DP-SGD) adds noise to gradients in back-propagation, safeguarding training data from privacy leakage, particularly membership inference. It fails to cover (inference-time) threats like…

Cryptography and Security · Computer Science 2023-09-20 Minxin Du , Xiang Yue , Sherman S. M. Chow , Tianhao Wang , Chenyu Huang , Huan Sun

Differential privacy (DP) is the prevailing technique for protecting user data in machine learning models. However, deficits to this framework include a lack of clarity for selecting the privacy budget $\epsilon$ and a lack of…

Machine Learning · Computer Science 2023-06-29 Tyler LeBlond , Joseph Munoz , Fred Lu , Maya Fuchs , Elliott Zaresky-Williams , Edward Raff , Brian Testa

We review the use of differential privacy (DP) for privacy protection in machine learning (ML). We show that, driven by the aim of preserving the accuracy of the learned models, DP-based ML implementations are so loose that they do not…

Cryptography and Security · Computer Science 2023-01-09 Alberto Blanco-Justicia , David Sanchez , Josep Domingo-Ferrer , Krishnamurty Muralidhar

While modern machine learning models rely on increasingly large training datasets, data is often limited in privacy-sensitive domains. Generative models trained with differential privacy (DP) on sensitive data can sidestep this challenge,…

Machine Learning · Statistics 2024-01-02 Tim Dockhorn , Tianshi Cao , Arash Vahdat , Karsten Kreis

Centralized differential privacy has been successfully applied to quantum computing and information processing to protect privacy and avoid leaks in the connections between neighboring quantum states. Consequently, quantum local…

Quantum Physics · Physics 2025-09-17 Ji Guan

Large language models (LLMs) are increasingly integrated into real-time machine learning applications, where safeguarding user privacy is paramount. Traditional differential privacy mechanisms often struggle to balance privacy and accuracy,…

Cryptography and Security · Computer Science 2024-10-04 Jessica Smith , David Williams , Emily Brown

An important problem in deep learning is the privacy and security of neural networks (NNs). Both aspects have long been considered separately. To date, it is still poorly understood how privacy enhancing training affects the robustness of…

Cryptography and Security · Computer Science 2021-05-18 Franziska Boenisch , Philip Sperl , Konstantin Böttinger

Differential Privacy (DP) provides a formal framework for training machine learning models with individual example level privacy. In the field of deep learning, Differentially Private Stochastic Gradient Descent (DP-SGD) has emerged as a…

Machine Learning · Computer Science 2022-05-24 Harsh Mehta , Abhradeep Thakurta , Alexey Kurakin , Ashok Cutkosky

Differentially private stochastic gradient descent (DP-SGD) is the workhorse algorithm for recent advances in private deep learning. It provides a single privacy guarantee to all datapoints in the dataset. We propose output-specific…

Machine Learning · Computer Science 2024-07-26 Da Yu , Gautam Kamath , Janardhan Kulkarni , Tie-Yan Liu , Jian Yin , Huishuai Zhang

In this paper, an adjustment to the original differentially private stochastic gradient descent (DPSGD) algorithm for deep learning models is proposed. As a matter of motivation, to date, almost no state-of-the-art machine learning…

Machine Learning · Computer Science 2021-07-13 Mehdi Amian

Machine learning (ML) models trained by differentially private stochastic gradient descent (DP-SGD) have much lower utility than the non-private ones. To mitigate this degradation, we propose a DP Laplacian smoothing SGD (DP-LSSGD) to train…

Machine Learning · Computer Science 2019-12-10 Bao Wang , Quanquan Gu , March Boedihardjo , Farzin Barekat , Stanley J. Osher

In privacy-preserving machine learning, differentially private stochastic gradient descent (DP-SGD) performs worse than SGD due to per-sample gradient clipping and noise addition. A recent focus in private learning research is improving the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Xinyu Tang , Ashwinee Panda , Vikash Sehwag , Prateek Mittal

Modern machine learning algorithms aim to extract fine-grained information from data to provide accurate predictions, which often conflicts with the goal of privacy protection. This paper addresses the practical and theoretical importance…

Machine Learning · Statistics 2023-07-17 Puyu Wang , Yunwen Lei , Yiming Ying , Ding-Xuan Zhou

For gradient-based machine learning (ML) methods commonly adopted in practice such as stochastic gradient descent, the de facto differential privacy (DP) technique is perturbing the gradients with random Gaussian noise. Data valuation…

Machine Learning · Computer Science 2024-12-24 Zijian Zhou , Xinyi Xu , Daniela Rus , Bryan Kian Hsiang Low

Differential privacy (DP) is a popular mechanism for training machine learning models with bounded leakage about the presence of specific points in the training data. The cost of differential privacy is a reduction in the model's accuracy.…

Machine Learning · Computer Science 2019-10-29 Eugene Bagdasaryan , Vitaly Shmatikov

Learning often involves sensitive data and as such, privacy preserving extensions to Stochastic Gradient Descent (SGD) and other machine learning algorithms have been developed using the definitions of Differential Privacy (DP). In…

Machine Learning · Computer Science 2021-10-14 Friedrich Dörmann , Osvald Frisk , Lars Nørvang Andersen , Christian Fischer Pedersen

The increased application of machine learning (ML) in sensitive domains requires protecting the training data through privacy frameworks, such as differential privacy (DP). DP requires to specify a uniform privacy level $\varepsilon$ that…

Machine Learning · Computer Science 2024-01-31 Krishna Acharya , Franziska Boenisch , Rakshit Naidu , Juba Ziani