English
Related papers

Related papers: NeuralDP Differentially private neural networks by…

200 papers

To protect the privacy of individuals whose data is being shared, it is of high importance to develop methods allowing researchers and companies to release textual data while providing formal privacy guarantees to its originators. In the…

Machine Learning · Computer Science 2022-10-27 Justus Mattern , Zhijing Jin , Benjamin Weggenmann , Bernhard Schoelkopf , Mrinmaya Sachan

Large data collections required for the training of neural networks often contain sensitive information such as the medical histories of patients, and the privacy of the training data must be preserved. In this paper, we introduce a dropout…

Machine Learning · Statistics 2017-12-06 Beyza Ermis , Ali Taylan Cemgil

Deep neural networks often use large, high-quality datasets to achieve high performance on many machine learning tasks. When training involves potentially sensitive data, this process can raise privacy concerns, as large models have been…

Machine Learning · Computer Science 2025-06-23 Felix Zhou , Samson Zhou , Vahab Mirrokni , Alessandro Epasto , Vincent Cohen-Addad

This monograph explores the design and analysis of correlated noise mechanisms for differential privacy (DP), focusing on their application to private training of AI and machine learning models via the core primitive of estimation of…

In the arena of privacy-preserving machine learning, differentially private stochastic gradient descent (DP-SGD) has outstripped the objective perturbation mechanism in popularity and interest. Though unrivaled in versatility, DP-SGD…

Machine Learning · Computer Science 2024-01-02 Rachel Redberg , Antti Koskela , Yu-Xiang Wang

Mobile apps and location-based services generate large amounts of location data that can benefit research on traffic optimization, context-aware notifications and public health (e.g., spread of contagious diseases). To preserve individual…

Databases · Computer Science 2021-08-04 Sepanta Zeighami , Ritesh Ahuja , Gabriel Ghinita , Cyrus Shahabi

In this paper, we propose a differentially private decentralized learning method (termed PrivSGP-VR) which employs stochastic gradient push with variance reduction and guarantees $(\epsilon, \delta)$-differential privacy (DP) for each node.…

Machine Learning · Computer Science 2024-05-07 Zehan Zhu , Yan Huang , Xin Wang , Jinming Xu

Differentially Private (DP) learning has seen limited success for building large deep learning models of text, and straightforward attempts at applying Differentially Private Stochastic Gradient Descent (DP-SGD) to NLP tasks have resulted…

Machine Learning · Computer Science 2022-11-11 Xuechen Li , Florian Tramèr , Percy Liang , Tatsunori Hashimoto

Differentially Private-SGD (DP-SGD) of Abadi et al. (2016) and its variations are the only known algorithms for private training of large scale neural networks. This algorithm requires computation of per-sample gradients norms which is…

Machine Learning · Computer Science 2021-02-08 Zhiqi Bu , Sivakanth Gopi , Janardhan Kulkarni , Yin Tat Lee , Judy Hanwen Shen , Uthaipon Tantipongpipat

Differential privacy (DP) protects sensitive data during neural network training, but standard methods like DP-Adam suffer from high memory overhead due to per-sample gradient clipping, limiting scalability. We introduce DP-GRAPE (Gradient…

Machine Learning · Computer Science 2026-05-19 Alex Mulrooney , Devansh Gupta , James Flemings , Huanyu Zhang , Murali Annavaram , Meisam Razaviyayn , Xinwei Zhang

We study private prediction where differential privacy is achieved by adding noise to the outputs of a non-private model. Existing methods rely on noise proportional to the global sensitivity of the model, often resulting in sub-optimal…

Machine learning (ML) models trained by differentially private stochastic gradient descent (DP-SGD) have much lower utility than the non-private ones. To mitigate this degradation, we propose a DP Laplacian smoothing SGD (DP-LSSGD) to train…

Machine Learning · Computer Science 2019-12-10 Bao Wang , Quanquan Gu , March Boedihardjo , Farzin Barekat , Stanley J. Osher

While machine learning has achieved remarkable results in a wide variety of domains, the training of models often requires large datasets that may need to be collected from different individuals. As sensitive information may be contained in…

Machine Learning · Computer Science 2023-02-07 Richeng Jin , Xiaofan He , Huaiyu Dai

Preserving privacy in contemporary NLP models allows us to work with sensitive data, but unfortunately comes at a price. We know that stricter privacy guarantees in differentially-private stochastic gradient descent (DP-SGD) generally…

Computation and Language · Computer Science 2023-02-01 Manuel Senge , Timour Igamberdiev , Ivan Habernal

Recent research shows that modern deep learning models achieve high predictive accuracy partly by memorizing individual training samples. Such memorization raises serious privacy concerns, motivating the widespread adoption of…

Machine Learning · Computer Science 2026-02-05 Jiaming Zhang , Huanyi Xie , Meng Ding , Shaopeng Fu , Jinyan Liu , Di Wang

Deep learning models are increasingly popular in many machine learning applications where the training data may contain sensitive information. To provide formal and rigorous privacy guarantee, many learning systems now incorporate…

Machine Learning · Computer Science 2021-03-19 Xiangyi Chen , Zhiwei Steven Wu , Mingyi Hong

Differential privacy (DP) has seen immense applications in learning on tabular, image, and sequential data where instance-level privacy is concerned. In learning on graphs, contrastingly, works on node-level privacy are highly sparse.…

Machine Learning · Computer Science 2025-09-23 Zihang Xiang , Tianhao Wang , Di Wang

Applying differential privacy (DP) by means of the DP-SGD algorithm to protect individual data points during training is becoming increasingly popular in NLP. However, the choice of granularity at which DP is applied is often neglected. For…

Computation and Language · Computer Science 2024-09-27 Doan Nam Long Vu , Timour Igamberdiev , Ivan Habernal

Deep learning models are known to put the privacy of their training data at risk, which poses challenges for their safe and ethical release to the public. Differentially private stochastic gradient descent is the de facto standard for…

Machine Learning · Computer Science 2023-01-03 Morgane Ayle , Jan Schuchardt , Lukas Gosch , Daniel Zügner , Stephan Günnemann

Machine learning (ML) models have been shown to leak private information from their training datasets. Differential Privacy (DP), typically implemented through the differential private stochastic gradient descent algorithm (DP-SGD), has…

Machine Learning · Computer Science 2025-02-17 Dariush Wahdany , Matthew Jagielski , Adam Dziedzic , Franziska Boenisch