English
Related papers

Related papers: Differentially Private Language Models Benefit fro…

200 papers

Machine learning models should not reveal particular information that is not otherwise accessible. Differential privacy provides a formal framework to mitigate privacy risks by ensuring that the inclusion or exclusion of any single data…

Cryptography and Security · Computer Science 2026-03-12 Francisco Aguilera-Martínez , Fernando Berzal

Large language models (LLMs) are commonly adapted to downstream tasks through fine-tuning, but fine-tuning data often contains sensitive information that may be leaked by the resulting model. Differential privacy (DP) offers formal…

Machine Learning · Computer Science 2026-05-19 Haichao Sha , Zihao Wang , Yuncheng Wu , Hong Chen , Wei Dong

We demonstrate that it is possible to train large recurrent language models with user-level differential privacy guarantees with only a negligible cost in predictive accuracy. Our work builds on recent advances in the training of deep…

Machine Learning · Computer Science 2018-02-27 H. Brendan McMahan , Daniel Ramage , Kunal Talwar , Li Zhang

Large language models have repeatedly shown outstanding performance across diverse applications. However, deploying these models can inadvertently risk user privacy. The significant memory demands during training pose a major challenge in…

Cryptography and Security · Computer Science 2025-02-21 Yanming Liu , Xinyue Peng , Yuwei Zhang , Xiaolan Ke , Songhang Deng , Jiannan Cao , Chen Ma , Mengchen Fu , Tianyu Du , Sheng Cheng , Xun Wang , Jianwei Yin , Xuhong Zhang

Fairness and privacy are two important values machine learning (ML) practitioners often seek to operationalize in models. Fairness aims to reduce model bias for social/demographic sub-groups. Privacy via differential privacy (DP)…

Machine Learning · Computer Science 2024-02-08 Sanjari Srivastava , Piotr Mardziel , Zhikhun Zhang , Archana Ahlawat , Anupam Datta , John C Mitchell

The performance of differentially private machine learning can be boosted significantly by leveraging the transfer learning capabilities of non-private models pretrained on large public datasets. We critically review this approach. We…

Machine Learning · Computer Science 2024-07-18 Florian Tramèr , Gautam Kamath , Nicholas Carlini

Black-box machine learning models are used in critical decision-making domains, giving rise to several calls for more algorithmic transparency. The drawback is that model explanations can leak information about the training data and the…

Machine Learning · Computer Science 2020-06-17 Neel Patel , Reza Shokri , Yair Zick

Differential privacy provides strong privacy guarantees for machine learning applications. Much recent work has been focused on developing differentially private models, however there has been a gap in other stages of the machine learning…

Machine Learning · Computer Science 2021-09-07 Ashly Lau , Jonathan Passerat-Palmbach

Language models are capable of memorizing detailed patterns and information, leading to a double-edged effect: they achieve impressive modeling performance on downstream tasks with the stored knowledge but also raise significant privacy…

Artificial Intelligence · Computer Science 2024-10-07 Xianzhi Li , Ran Zmigrod , Zhiqiang Ma , Xiaomo Liu , Xiaodan Zhu

Large language models (LLMs) have significantly transformed natural language understanding and generation, but they raise privacy concerns due to potential exposure of sensitive information. Studies have highlighted the risk of information…

Machine Learning · Computer Science 2025-11-20 Bishnu Bhusal , Manoj Acharya , Ramneet Kaur , Colin Samplawski , Anirban Roy , Adam D. Cobb , Rohit Chadha , Susmit Jha

Natural Language Processing (NLP) techniques can be applied to help with the diagnosis of medical conditions such as depression, using a collection of a person's utterances. Depression is a serious medical illness that can have adverse…

Computation and Language · Computer Science 2022-06-17 Priyam Basu , Tiasa Singha Roy , Rakshit Naidu , Zumrut Muftuoglu , Sahib Singh , Fatemehsadat Mireshghallah

Differential privacy (DP) is the prevailing technique for protecting user data in machine learning models. However, deficits to this framework include a lack of clarity for selecting the privacy budget $\epsilon$ and a lack of…

Machine Learning · Computer Science 2023-06-29 Tyler LeBlond , Joseph Munoz , Fred Lu , Maya Fuchs , Elliott Zaresky-Williams , Edward Raff , Brian Testa

We give simpler, sparser, and faster algorithms for differentially private fine-tuning of large-scale pre-trained language models, which achieve the state-of-the-art privacy versus utility tradeoffs on many standard NLP tasks. We propose a…

Machine learning models have shone in a variety of domains and attracted increasing attention from both the security and the privacy communities. One important yet worrying question is: Will training models under the differential privacy…

Machine Learning · Computer Science 2023-11-22 Yuan Zhang , Zhiqi Bu

Differentially Private (DP) learning has seen limited success for building large deep learning models of text, and straightforward attempts at applying Differentially Private Stochastic Gradient Descent (DP-SGD) to NLP tasks have resulted…

Machine Learning · Computer Science 2022-11-11 Xuechen Li , Florian Tramèr , Percy Liang , Tatsunori Hashimoto

Protecting privacy in contemporary NLP models is gaining in importance. So does the need to mitigate social biases of such models. But can we have both at the same time? Existing research suggests that privacy preservation comes at the…

Computation and Language · Computer Science 2023-05-25 Cleo Matzken , Steffen Eger , Ivan Habernal

Machine learning (ML) models have been shown to leak private information from their training datasets. Differential Privacy (DP), typically implemented through the differential private stochastic gradient descent algorithm (DP-SGD), has…

Machine Learning · Computer Science 2025-02-17 Dariush Wahdany , Matthew Jagielski , Adam Dziedzic , Franziska Boenisch

The privacy concerns associated with the use of Large Language Models (LLMs) have grown recently with the development of LLMs such as ChatGPT. Differential Privacy (DP) techniques are explored in existing work to mitigate their privacy…

Artificial Intelligence · Computer Science 2024-03-08 Tiejin Chen , Longchao Da , Huixue Zhou , Pingzhi Li , Kaixiong Zhou , Tianlong Chen , Hua Wei

We address the challenge of ensuring differential privacy (DP) guarantees in training deep retrieval systems. Training these systems often involves the use of contrastive-style losses, which are typically non-per-example decomposable,…

Computation and Language · Computer Science 2024-05-24 Aldo Gael Carranza , Rezsa Farahani , Natalia Ponomareva , Alex Kurakin , Matthew Jagielski , Milad Nasr

Differential Privacy (DP) is a key property to protect data and models from integrity attacks. In the Deep Learning (DL) field, it is commonly implemented through the Differentially Private Stochastic Gradient Descent (DP-SGD). However,…

Machine Learning · Computer Science 2023-11-21 Jiménez-López , Daniel , Rodríguez-Barroso , Nuria , Luzón , M. Victoria , Herrera , Francisco