English
Related papers

Related papers: DP-MGTD: Privacy-Preserving Machine-Generated Text…

200 papers

Large language models (LLMs) such as ChatGPT have exhibited remarkable performance in generating human-like texts. However, machine-generated texts (MGTs) may carry critical risks, such as plagiarism issues, misleading information, or…

Computation and Language · Computer Science 2024-03-01 Shuhai Zhang , Yiliao Song , Jiahao Yang , Yuanqing Li , Bo Han , Mingkui Tan

Large language models (LLMs) are increasingly adapted to proprietary and domain-specific corpora that contain sensitive information, creating a tension between formal privacy guarantees and efficient deployment through model compression.…

Machine Learning · Computer Science 2026-04-07 Fatemeh Khadem , Sajad Mousavi , Yi Fang , Yuhong Liu

Differentially private text sanitization refers to the process of privatizing texts under the framework of Differential Privacy (DP), providing provable privacy guarantees while also empirically defending against adversaries seeking to harm…

Cryptography and Security · Computer Science 2025-08-27 Stephen Meisenbacher , Alexandra Klymenko , Andreea-Elena Bodea , Florian Matthes

Modern machine learning models heavily rely on large datasets that often include sensitive and private information, raising serious privacy concerns. Differentially private (DP) data generation offers a solution by creating synthetic…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Runkai Zheng , Vishnu Asutosh Dasu , Yinong Oliver Wang , Haohan Wang , Fernando De la Torre

Differential Privacy (DP) has been tailored to address the unique challenges of text-to-text privatization. However, text-to-text privatization is known for degrading the performance of language models when trained on perturbed text.…

Computation and Language · Computer Science 2023-10-18 Stefan Arnold , Nils Kemmerzell , Annika Schreiner

Prompt privacy is crucial, especially when using online large language models (LLMs), due to the sensitive information often contained within prompts. While LLMs can enhance prompt privacy through text rewriting, existing methods primarily…

Computation and Language · Computer Science 2025-11-18 Mingchen Li , Heng Fan , Song Fu , Junhua Ding , Yunhe Feng

Differentially private (DP) synthetic data generation plays a pivotal role in developing large language models (LLMs) on private data, where data owners cannot provide eyes-on access to individual examples. Generating DP synthetic data…

While modern machine learning models rely on increasingly large training datasets, data is often limited in privacy-sensitive domains. Generative models trained with differential privacy (DP) on sensitive data can sidestep this challenge,…

Machine Learning · Statistics 2024-01-02 Tim Dockhorn , Tianshi Cao , Arash Vahdat , Karsten Kreis

Differentially-private mechanisms for text generation typically add carefully calibrated noise to input words and use the nearest neighbor to the noised input as the output word. When the noise is small in magnitude, these mechanisms are…

Computation and Language · Computer Science 2021-04-27 Zekun Xu , Abhinav Aggarwal , Oluwaseyi Feyisetan , Nathanael Teissier

Text data has become extremely valuable due to the emergence of machine learning algorithms that learn from it. A lot of high-quality text data generated in the real world is private and therefore cannot be shared or used freely due to…

Computation and Language · Computer Science 2024-07-25 Chulin Xie , Zinan Lin , Arturs Backurs , Sivakanth Gopi , Da Yu , Huseyin A Inan , Harsha Nori , Haotian Jiang , Huishuai Zhang , Yin Tat Lee , Bo Li , Sergey Yekhanin

Many works at the intersection of Differential Privacy (DP) in Natural Language Processing aim to protect privacy by transforming texts under DP guarantees. This can be performed in a variety of ways, from word perturbations to full…

Computation and Language · Computer Science 2025-08-29 Stephen Meisenbacher , Maulik Chevli , Florian Matthes

Natural language processing (NLP) models may leak private information in different ways, including membership inference, reconstruction or attribute inference attacks. Sensitive information may not be explicit in the text, but hidden in…

Computation and Language · Computer Science 2024-07-01 Pedro Faustini , Shakila Mahjabin Tonni , Annabelle McIver , Qiongkai Xu , Mark Dras

Privatized text rewriting with local differential privacy (LDP) is a recent approach that enables sharing of sensitive textual documents while formally guaranteeing privacy protection to individuals. However, existing systems face several…

Cryptography and Security · Computer Science 2025-08-14 Timour Igamberdiev , Ivan Habernal

Data privacy is a core tenet of responsible computing, and in the United States, differential privacy (DP) is the dominant technical operationalization of privacy-preserving data analysis. With this study, we qualitatively examine one class…

Human-Computer Interaction · Computer Science 2024-12-18 Lucas Rosenblatt , Bill Howe , Julia Stoyanovich

Synthetic tabular data generation with differential privacy is a crucial problem to enable data sharing with formal privacy. Despite a rich history of methodological research and development, developing differentially private tabular data…

Machine Learning · Computer Science 2024-06-05 Toan V. Tran , Li Xiong

Text rewriting with differential privacy (DP) provides concrete theoretical guarantees for protecting the privacy of individuals in textual documents. In practice, existing systems may lack the means to validate their privacy-preserving…

Computation and Language · Computer Science 2022-08-23 Timour Igamberdiev , Thomas Arnold , Ivan Habernal

Synthetic data from generative models emerges as the privacy-preserving data sharing solution. Such a synthetic data set shall resemble the original data without revealing identifiable private information. Till date, the prior focus on…

Machine Learning · Computer Science 2025-07-23 Chaoyi Zhu , Jiayi Tang , Juan F. Pérez , Marten van Dijk , Lydia Y. Chen

Metric Differential Privacy is a generalization of differential privacy tailored to address the unique challenges of text-to-text privatization. By adding noise to the representation of words in the geometric space of embeddings, words are…

Computation and Language · Computer Science 2023-06-05 Stefan Arnold , Dilara Yesilbas , Sven Weinzierl

High quality data is needed to unlock the full potential of AI for end users. However finding new sources of such data is getting harder: most publicly-available human generated data will soon have been used. Additionally, publicly…

Large language models (LLMs) have significantly transformed natural language understanding and generation, but they raise privacy concerns due to potential exposure of sensitive information. Studies have highlighted the risk of information…

Machine Learning · Computer Science 2025-11-20 Bishnu Bhusal , Manoj Acharya , Ramneet Kaur , Colin Samplawski , Anirban Roy , Adam D. Cobb , Rohit Chadha , Susmit Jha