English
Related papers

Related papers: 1-Diffractor: Efficient and Utility-Preserving Tex…

200 papers

Deep learning (DL) models for natural language processing (NLP) tasks often handle private data, demanding protection against breaches and disclosures. Data protection laws, such as the European Union's General Data Protection Regulation…

Computation and Language · Computer Science 2022-05-23 Samuel Sousa , Roman Kern

Language models are capable of memorizing detailed patterns and information, leading to a double-edged effect: they achieve impressive modeling performance on downstream tasks with the stored knowledge but also raise significant privacy…

Artificial Intelligence · Computer Science 2024-10-07 Xianzhi Li , Ran Zmigrod , Zhiqiang Ma , Xiaomo Liu , Xiaodan Zhu

Many works at the intersection of Differential Privacy (DP) in Natural Language Processing aim to protect privacy by transforming texts under DP guarantees. This can be performed in a variety of ways, from word perturbations to full…

Computation and Language · Computer Science 2025-08-29 Stephen Meisenbacher , Maulik Chevli , Florian Matthes

With the increasing applications of language models, it has become crucial to protect these models from leaking private information. Previous work has attempted to tackle this challenge by training RNN-based language models with…

Computation and Language · Computer Science 2022-07-19 Weiyan Shi , Aiqi Cui , Evan Li , Ruoxi Jia , Zhou Yu

The privacy concerns associated with the use of Large Language Models (LLMs) have grown recently with the development of LLMs such as ChatGPT. Differential Privacy (DP) techniques are explored in existing work to mitigate their privacy…

Artificial Intelligence · Computer Science 2024-03-08 Tiejin Chen , Longchao Da , Huixue Zhou , Pingzhi Li , Kaixiong Zhou , Tianlong Chen , Hua Wei

Local differential privacy (LDP) is a recently proposed privacy standard for collecting and analyzing data, which has been used, e.g., in the Chrome browser, iOS and macOS. In LDP, each user perturbs her information locally, and only sends…

Cryptography and Security · Computer Science 2019-07-02 Ning Wang , Xiaokui Xiao , Yin Yang , Jun Zhao , Siu Cheung Hui , Hyejin Shin , Junbum Shin , Ge Yu

Local differential privacy (LDP) has become a central topic in data privacy research, offering strong privacy guarantees by perturbing user data at the source and removing the need for a trusted curator. However, the noise introduced by LDP…

Machine Learning · Computer Science 2026-03-04 Caihong Qin , Yang Bai

Recent work in Differential Privacy with Natural Language Processing (DP NLP) has proposed numerous promising techniques in the form of text rewriting mechanisms. In the evaluation of these mechanisms, an often-ignored aspect is that of…

Computation and Language · Computer Science 2025-11-04 Stephen Meisenbacher , Florian Matthes

Large language models (LLMs), especially those based on the Transformer architecture, have had a profound impact on various aspects of daily life, such as natural language processing, content generation, research methodologies, and more.…

Machine Learning · Computer Science 2024-10-15 Yeqi Gao , Zhao Song , Xin Yang , Yufa Zhou

LDP (Local Differential Privacy) has been widely studied to estimate statistics of personal data (e.g., distribution underlying the data) while protecting users' privacy. Although LDP does not require a trusted third party, it regards all…

Databases · Computer Science 2019-05-28 Takao Murakami , Yusuke Kawamoto

Large language models (LLMs), like ChatGPT, have greatly simplified text generation tasks. However, they have also raised concerns about privacy risks such as data leakage and unauthorized data collection. Existing solutions for…

Cryptography and Security · Computer Science 2026-03-19 Meng Tong , Kejiang Chen , Jie Zhang , Yuang Qi , Weiming Zhang , Nenghai Yu , Tianwei Zhang , Zhikun Zhang

Accurately learning from user data while ensuring quantifiable privacy guarantees provides an opportunity to build better Machine Learning (ML) models while maintaining user trust. Recent literature has demonstrated the applicability of a…

Machine Learning · Computer Science 2020-12-11 Oluwaseyi Feyisetan , Abhinav Aggarwal , Zekun Xu , Nathanael Teissier

Preserving privacy in contemporary NLP models allows us to work with sensitive data, but unfortunately comes at a price. We know that stricter privacy guarantees in differentially-private stochastic gradient descent (DP-SGD) generally…

Computation and Language · Computer Science 2023-02-01 Manuel Senge , Timour Igamberdiev , Ivan Habernal

The goal of differentially private text obfuscation is to obfuscate, or "perturb", input texts with Differential Privacy (DP) guarantees, such that the private output texts are quantifiably indistinguishable from the originals. While…

Computation and Language · Computer Science 2026-05-05 Stephen Meisenbacher , Angelo Kleinert , Florian Matthes

Natural Language Processing (NLP) techniques can be applied to help with the diagnosis of medical conditions such as depression, using a collection of a person's utterances. Depression is a serious medical illness that can have adverse…

Computation and Language · Computer Science 2022-06-17 Priyam Basu , Tiasa Singha Roy , Rakshit Naidu , Zumrut Muftuoglu , Sahib Singh , Fatemehsadat Mireshghallah

Privacy preservation remains a key challenge in data mining and Natural Language Understanding (NLU). Previous research shows that the input text or even text embeddings can leak private information. This concern motivates our research on…

Computation and Language · Computer Science 2021-08-23 Chen Qu , Weize Kong , Liu Yang , Mingyang Zhang , Michael Bendersky , Marc Najork

We propose a Neighbourhood-Aware Differential Privacy (NADP) mechanism considering the neighbourhood of a word in a pretrained static word embedding space to determine the minimal amount of noise required to guarantee a specified privacy…

Machine Learning · Computer Science 2023-09-20 Danushka Bollegala , Shuichi Otake , Tomoya Machide , Ken-ichi Kawarabayashi

Recent literature has seen a considerable uptick in $\textit{Differentially Private Natural Language Processing}$ (DP NLP). This includes DP text privatization, where potentially sensitive input texts are transformed under DP to achieve…

Computation and Language · Computer Science 2025-03-13 Stephen Meisenbacher , Alexandra Klymenko , Alexander Karpp , Florian Matthes

Differentially private (DP) mechanisms face the challenge of providing accurate results while protecting their inputs: the privacy-utility trade-off. A simple but powerful technique for DP adds noise to sensitivity-bounded query outputs to…

Cryptography and Security · Computer Science 2021-07-28 David M. Sommer , Lukas Abfalterer , Sheila Zingg , Esfandiar Mohammadi

Local Differential Privacy (LDP) provides provable privacy protection for data collection without the assumption of the trusted data server. In the real-world scenario, different data have different privacy requirements due to the distinct…

Cryptography and Security · Computer Science 2020-02-25 Xiaolan Gu , Ming Li , Li Xiong , Yang Cao