English
Related papers

Related papers: ER-AE: Differentially Private Text Generation for …

200 papers

Privacy preserving deep learning is an emerging field in machine learning that aims to mitigate the privacy risks in the use of deep neural networks. One such risk is training data extraction from language models that have been trained on…

Computation and Language · Computer Science 2024-12-02 Andor Diera , Nicolas Lell , Aygul Garifullina , Ansgar Scherp

Text sanitization is the task of redacting a document to mask all occurrences of (direct or indirect) personal identifiers, with the goal of concealing the identity of the individual(s) referred in it. In this paper, we consider a two-step…

Computation and Language · Computer Science 2023-10-24 Anthi Papadopoulou , Pierre Lison , Mark Anderson , Lilja Øvrelid , Ildikó Pilán

Recent privacy research on large language models (LLMs) has shown that they achieve near-human-level performance at inferring personal data from online texts. With ever-increasing model capabilities, existing text anonymization methods are…

Artificial Intelligence · Computer Science 2025-02-04 Robin Staab , Mark Vero , Mislav Balunović , Martin Vechev

Privatized text rewriting with local differential privacy (LDP) is a recent approach that enables sharing of sensitive textual documents while formally guaranteeing privacy protection to individuals. However, existing systems face several…

Cryptography and Security · Computer Science 2025-08-14 Timour Igamberdiev , Ivan Habernal

Deep learning models can achieve high inference accuracy by extracting rich knowledge from massive well-annotated data, but may pose the risk of data privacy leakage in practical deployment. In this paper, we present an effective…

Machine Learning · Computer Science 2024-09-20 Bochao Liu , Jianghu Lu , Pengju Wang , Junjie Zhang , Dan Zeng , Zhenxing Qian , Shiming Ge

As major progress in LLM-based long-form text generation enables paradigms such as retrieval-augmented generation (RAG) and inference-time scaling, safely incorporating private information into the generation remains a critical open…

Machine Learning · Computer Science 2026-05-06 Vishnu Vinod , Krishna Pillutla , Abhradeep Guha Thakurta

We propose a differentially private data generation paradigm using random feature representations of kernel mean embeddings when comparing the distribution of true data with that of synthetic data. We exploit the random feature…

Machine Learning · Computer Science 2021-06-02 Frederik Harder , Kamil Adamczewski , Mijung Park

We study private synthetic data generation for query release, where the goal is to construct a sanitized version of a sensitive dataset, subject to differential privacy, that approximately preserves the answers to a large collection of…

Machine Learning · Computer Science 2021-12-10 Terrance Liu , Giuseppe Vietri , Zhiwei Steven Wu

Given the increasing privacy concerns from identity theft and the re-identification of speakers through content in the speech field, this paper proposes a prompt-based speech generation pipeline that ensures dual anonymization of both…

Sound · Computer Science 2025-07-11 Belinda Soh Hui Hui , Xiaoxiao Miao , Xin Wang

As privacy issues are receiving increasing attention within the Natural Language Processing (NLP) community, numerous methods have been proposed to sanitize texts subject to differential privacy. However, the state-of-the-art text…

Cryptography and Security · Computer Science 2023-09-04 Huimin Chen , Fengran Mo , Yanhao Wang , Cen Chen , Jian-Yun Nie , Chengyu Wang , Jamie Cui

The increasing use of synthetic data generated by Large Language Models (LLMs) presents both opportunities and challenges in data-driven applications. While synthetic data provides a cost-effective, scalable alternative to real-world data…

Computation and Language · Computer Science 2025-07-25 Tevin Atwal , Chan Nam Tieu , Yefeng Yuan , Zhan Shi , Yuhong Liu , Liang Cheng

Artificial intelligence and machine learning have been integrated into all aspects of our lives and the privacy of personal data has attracted more and more attention. Since the generation of the model needs to extract the effective…

Cryptography and Security · Computer Science 2022-02-14 Ruikang Yang , Jianfeng Ma , Yinbin Miao , Xindi Ma

Recent studies have shown that large language models (LLMs) can infer private user attributes (e.g., age, location, gender) from user-generated text shared online, enabling rapid and large-scale privacy breaches. Existing…

Cryptography and Security · Computer Science 2026-04-21 Dong Yan , Jian Liang , Ran He , Tieniu Tan

The widespread exchange of digital documents in various domains has resulted in abundant private information being shared. This proliferation necessitates redaction techniques to protect sensitive content and user privacy. While numerous…

Cryptography and Security · Computer Science 2024-04-22 Mirco Beltrame , Mauro Conti , Pierpaolo Guglielmin , Francesco Marchiori , Gabriele Orazi

Differential privacy provides a formal approach to privacy of individuals. Applications of differential privacy in various scenarios, such as protecting users' original utterances, must satisfy certain mathematical properties. Our…

Computation and Language · Computer Science 2022-03-07 Ivan Habernal

Personalized text generation is an emerging research area that has attracted much attention in recent years. Most studies in this direction focus on a particular domain by designing bespoke features or models. In this work, we propose a…

Computation and Language · Computer Science 2023-08-17 Cheng Li , Mingyang Zhang , Qiaozhu Mei , Yaqing Wang , Spurthi Amba Hombaiah , Yi Liang , Michael Bendersky

Natural language processing (NLP) models may leak private information in different ways, including membership inference, reconstruction or attribute inference attacks. Sensitive information may not be explicit in the text, but hidden in…

Computation and Language · Computer Science 2024-07-01 Pedro Faustini , Shakila Mahjabin Tonni , Annabelle McIver , Qiongkai Xu , Mark Dras

AI writing assistants can reduce effort and improve fluency, but they may also weaken writers' sense of authorship. We study this tension with an ownership-aware co-writing editor that offers on-demand, sentence-level suggestions and tests…

Human-Computer Interaction · Computer Science 2026-01-16 Bohan Zhang , Chengke Bu , Paramveer S. Dhillon

Retrieval-Augmented Generation (RAG) enhances the utility of Large Language Models (LLMs) by retrieving external documents. Since the knowledge databases in RAG are predominantly utilized via cloud services, private data in sensitive…

Cryptography and Security · Computer Science 2026-05-29 Xinyuan Zhu , Zekun Fei , Enye Wang , Ruiqi He , Jia Guo , Ruijie Wang , Zheli Liu , Qingkai Zeng

With the increasing use of cloud-based services for training and deploying machine learning models, data privacy has become a major concern. This is particularly important for natural language processing (NLP) models, which often process…

Computation and Language · Computer Science 2023-05-08 Davut Emre Tasar , Ceren Ocal Tasar