English
Related papers

Related papers: Differentially Private Language Models Benefit fro…

200 papers

Privately generating synthetic data from a table is an important brick of a privacy-first world. We propose and investigate a simple approach of treating each row in a table as a sentence and training a language model with differential…

Machine Learning · Computer Science 2023-06-09 Alexandre Sablayrolles , Yue Wang , Brian Karrer

Rapid advances in Natural Language Processing (NLP) have revolutionized many fields, including healthcare. However, these advances raise significant privacy concerns, especially when pre-trained models fine-tuned and specialized on…

Computation and Language · Computer Science 2026-05-21 Antoine Boutet , Lucas Magnana , Juliette Sénéchal

The rapid development of language models (LMs) brings unprecedented accessibility and usage for both models and users. On the one hand, powerful LMs achieve state-of-the-art performance over numerous downstream NLP tasks. On the other hand,…

Computation and Language · Computer Science 2024-06-04 Haoran Li , Dadi Guo , Donghao Li , Wei Fan , Qi Hu , Xin Liu , Chunkit Chan , Duanyi Yao , Yuan Yao , Yangqiu Song

Differentially private gradient descent (DP-GD) is a popular algorithm to train deep learning models with provable guarantees on the privacy of the training data. In the last decade, the problem of understanding its performance cost with…

Machine Learning · Statistics 2025-05-29 Simone Bombari , Marco Mondelli

In-context learning (ICL) enables large language models (LLMs) to adapt to new tasks by conditioning on demonstrations of question-answer pairs and it has been shown to have comparable performance to costly model retraining and fine-tuning.…

Cryptography and Security · Computer Science 2024-03-12 Alycia N. Carey , Karuna Bhaila , Kennedy Edemacu , Xintao Wu

We show that adding differential privacy to Explainable Boosting Machines (EBMs), a recent method for training interpretable ML models, yields state-of-the-art accuracy while protecting privacy. Our experiments on multiple classification…

Machine Learning · Computer Science 2021-06-18 Harsha Nori , Rich Caruana , Zhiqi Bu , Judy Hanwen Shen , Janardhan Kulkarni

Differentially private (DP) optimization is the standard paradigm to learn large neural networks that are accurate and privacy-preserving. The computational cost for DP deep learning, however, is notoriously heavy due to the per-sample…

Machine Learning · Computer Science 2023-09-20 Zhiqi Bu , Yu-Xiang Wang , Sheng Zha , George Karypis

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse natural language processing tasks, but their tendency to memorize training data poses significant privacy risks, particularly during fine-tuning…

Computation and Language · Computer Science 2025-08-21 Badrinath Ramakrishnan , Akshaya Balaji

This paper presents a framework for privacy-preserving verification of machine learning models, focusing on models trained on sensitive data. Integrating Local Differential Privacy (LDP) with model explanations from LIME and SHAP, our…

Machine Learning · Computer Science 2025-01-15 Wenbiao Li , Anisa Halimi , Xiaoqian Jiang , Jaideep Vaidya , Erman Ayday

Federated learning (FL) allows clients to collaboratively train a global model without sharing their local data with a server. However, clients' contributions to the server can still leak sensitive information. Differential privacy (DP)…

Machine Learning · Computer Science 2025-02-18 Jie Xu , Karthikeyan Saravanan , Rogier van Dalen , Haaris Mehmood , David Tuckey , Mete Ozay

Data holders are increasingly seeking to protect their user's privacy, whilst still maximizing their ability to produce machine models with high quality predictions. In this work, we empirically evaluate various implementations of…

Cryptography and Security · Computer Science 2020-09-16 Benjamin Zi Hao Zhao , Mohamed Ali Kaafar , Nicolas Kourtellis

We identify a novel phenomenon in language models: benign fine-tuning of frontier models can lead to privacy collapse. We find that diverse, subtle patterns in training data can degrade contextual privacy, including optimisation for…

Computation and Language · Computer Science 2026-04-21 Anmol Goel , Cornelius Emde , Sangdoo Yun , Seong Joon Oh , Martin Gubri

Differential Privacy can provide provable privacy guarantees for training data in machine learning. However, the presence of proofs does not preclude the presence of errors. Inspired by recent advances in auditing which have been used for…

Machine Learning · Computer Science 2022-03-29 Florian Tramer , Andreas Terzis , Thomas Steinke , Shuang Song , Matthew Jagielski , Nicholas Carlini

Learning with relational and network-structured data is increasingly vital in sensitive domains where protecting the privacy of individual entities is paramount. Differential Privacy (DP) offers a principled approach for quantifying privacy…

Machine Learning · Computer Science 2026-02-04 Yinan Huang , Haoteng Yin , Eli Chien , Rongzhe Wei , Pan Li

Motivated by problems arising in digital advertising, we introduce the task of training differentially private (DP) machine learning models with semi-sensitive features. In this setting, a subset of the features is known to the attacker…

Label differential privacy (DP) is designed for learning problems involving private labels and public features. While various methods have been proposed for learning under label DP, the theoretical limits remain largely unexplored. In this…

Machine Learning · Computer Science 2025-03-04 Puning Zhao , Chuan Ma , Li Shen , Shaowei Wang , Rongfei Fan

In statistical disclosure control, the goal of data analysis is twofold: The released information must provide accurate and useful statistics about the underlying population of interest, while minimizing the potential for an individual…

Methodology · Statistics 2016-07-15 Jing Lei , Anne-Sophie Charest , Aleksandra Slavkovic , Adam Smith , Stephen Fienberg

Large language models (LLMs) are increasingly integrated into real-time machine learning applications, where safeguarding user privacy is paramount. Traditional differential privacy mechanisms often struggle to balance privacy and accuracy,…

Cryptography and Security · Computer Science 2024-10-04 Jessica Smith , David Williams , Emily Brown

In the privacy-utility tradeoff of a model trained on benchmark language and vision tasks, remarkable improvements have been widely reported with the use of pretraining on publicly available data. This is in part due to the benefits of…

Machine Learning · Computer Science 2023-02-21 Arun Ganesh , Mahdi Haghifam , Milad Nasr , Sewoong Oh , Thomas Steinke , Om Thakkar , Abhradeep Thakurta , Lun Wang

Large language models (LLMs) are complex artificial intelligence systems capable of understanding, generating and translating human language. They learn language patterns by analyzing large amounts of text data, allowing them to perform…

Cryptography and Security · Computer Science 2024-03-15 Biwei Yan , Kun Li , Minghui Xu , Yueyan Dong , Yue Zhang , Zhaochun Ren , Xiuzhen Cheng
‹ Prev 1 8 9 10 Next ›