English
Related papers

Related papers: Differentially Private Fine-tuning of Language Mod…

200 papers

Differentially Private Stochastic Gradient Descent (DP-SGD) and its variants have been proposed to ensure rigorous privacy for fine-tuning large-scale pre-trained language models. However, they rely heavily on the Gaussian mechanism, which…

Cryptography and Security · Computer Science 2024-05-30 Qin Yang , Meisam Mohammad , Han Wang , Ali Payani , Ashish Kundu , Kai Shu , Yan Yan , Yuan Hong

Differentially Private (DP) learning has seen limited success for building large deep learning models of text, and straightforward attempts at applying Differentially Private Stochastic Gradient Descent (DP-SGD) to NLP tasks have resulted…

Machine Learning · Computer Science 2022-11-11 Xuechen Li , Florian Tramèr , Percy Liang , Tatsunori Hashimoto

Applying machine learning (ML) to sensitive domains requires privacy protection of the underlying training data through formal privacy frameworks, such as differential privacy (DP). Yet, usually, the privacy of the training data comes at…

Machine Learning · Computer Science 2022-11-09 Franziska Boenisch , Christopher Mühl , Roy Rinberg , Jannis Ihrig , Adam Dziedzic

With the rapid adoption of Federated Learning (FL) as the training and tuning protocol for applications utilizing Large Language Models (LLMs), recent research highlights the need for significant modifications to FL to accommodate the…

Cryptography and Security · Computer Science 2024-03-11 Minh N. Vu , Truc Nguyen , Tre' R. Jeter , My T. Thai

As on-device large language model (LLM) systems become increasingly prevalent, federated fine-tuning enables advanced language understanding and generation directly on edge devices; however, it also involves processing sensitive,…

Cryptography and Security · Computer Science 2025-09-12 Honghui Xu , Shiva Shrestha , Wei Chen , Zhiyuan Li , Zhipeng Cai

Deep learning techniques based on neural networks have shown significant success in a wide range of AI tasks. Large-scale training datasets are one of the critical factors for their success. However, when the training datasets are…

Cryptography and Security · Computer Science 2019-12-23 Lei Yu , Ling Liu , Calton Pu , Mehmet Emre Gursoy , Stacey Truex

Efficient finetuning of pretrained language transformers is becoming increasingly prevalent for solving natural language processing tasks. While effective, it can still require a large number of tunable parameters. This can be a drawback…

Computation and Language · Computer Science 2023-05-31 Umang Gupta , Aram Galstyan , Greg Ver Steeg

The widespread practice of fine-tuning large language models (LLMs) on domain-specific data faces two major challenges in memory and privacy. First, as the size of LLMs continues to grow, the memory demands of gradient-based training…

Machine Learning · Computer Science 2024-06-07 Liang Zhang , Bingcong Li , Kiran Koshy Thekumparampil , Sewoong Oh , Niao He

Fine-tuning on task-specific datasets is a widely-embraced paradigm of harnessing the powerful capability of pretrained LLMs for various downstream tasks. Due to the popularity of LLMs fine-tuning and its accompanying privacy concerns,…

Machine Learning · Computer Science 2025-03-11 Z Liu , J Lou , W Bao , Y Hu , B Li , Z Qin , K Ren

Differentially private (DP) optimization is the standard paradigm to learn large neural networks that are accurate and privacy-preserving. The computational cost for DP deep learning, however, is notoriously heavy due to the per-sample…

Machine Learning · Computer Science 2023-09-20 Zhiqi Bu , Yu-Xiang Wang , Sheng Zha , George Karypis

The surge in interest and application of large language models (LLMs) has sparked a drive to fine-tune these models to suit specific applications, such as finance and medical science. However, concerns regarding data privacy have emerged,…

Machine Learning · Computer Science 2024-06-04 Xiao-Yang Liu , Rongyi Zhu , Daochen Zha , Jiechao Gao , Shan Zhong , Matt White , Meikang Qiu

Large language models (LLMs) are excellent in-context learners. However, the sensitivity of data contained in prompts raises privacy concerns. Our work first shows that these concerns are valid: we instantiate a simple but highly effective…

Machine Learning · Computer Science 2023-05-26 Haonan Duan , Adam Dziedzic , Nicolas Papernot , Franziska Boenisch

Machine learning (ML) models can memorize training datasets. As a result, training ML models over private datasets can lead to the violation of individuals' privacy. Differential privacy (DP) is a rigorous privacy notion to preserve the…

Machine Learning · Computer Science 2024-02-13 Mohammad Hoseinpour , Milad Hoseinpour , Ali Aghagolzadeh

With the rise of large language models, service providers offer language models as a service, enabling users to fine-tune customized models via uploaded private datasets. However, this raises concerns about sensitive data leakage. Prior…

Cryptography and Security · Computer Science 2026-01-22 Yi Liu , Weixiang Han , Chengjun Cai , Xingliang Yuan , Cong Wang

Neural language models are known to have a high capacity for memorization of training samples. This may have serious privacy implications when training models on user content such as email correspondence. Differential privacy (DP), a…

Tuning the hyperparameters of differentially private (DP) machine learning (ML) algorithms often requires use of sensitive data and this may leak private information via hyperparameter values. Recently, Papernot and Steinke (2022) proposed…

Machine Learning · Computer Science 2024-02-14 Antti Koskela , Tejas Kulkarni

Natural Language Processing (NLP) techniques can be applied to help with the diagnosis of medical conditions such as depression, using a collection of a person's utterances. Depression is a serious medical illness that can have adverse…

Computation and Language · Computer Science 2022-06-17 Priyam Basu , Tiasa Singha Roy , Rakshit Naidu , Zumrut Muftuoglu , Sahib Singh , Fatemehsadat Mireshghallah

In machine learning, privacy requirements at inference or deployment time often evolve due to changing policies, regulations, or user preferences. In this work, we aim to construct a magnitude of models to satisfy any target differential…

Machine Learning · Computer Science 2026-05-21 Qichuan Yin , Manzil Zaheer , Tian Li

Privacy-preserving machine learning aims to train models on private data without leaking sensitive information. Differential privacy (DP) is considered the gold standard framework for privacy-preserving training, as it provides formal…

Pre-training on public data is an effective method to improve the performance for federated learning (FL) with differential privacy (DP). This paper investigates how large language models (LLMs) trained on public data can improve the…

Machine Learning · Computer Science 2024-08-08 Shanshan Wu , Zheng Xu , Yanxiang Zhang , Yuanbo Zhang , Daniel Ramage