English
Related papers

Related papers: Evaluating Differentially Private Generation of Do…

200 papers

We present an approach for generating differentially private synthetic text using large language models (LLMs), via private prediction. In the private prediction framework, we only require the output synthetic data to satisfy differential…

Machine Learning · Computer Science 2024-10-10 Kareem Amin , Alex Bie , Weiwei Kong , Alexey Kurakin , Natalia Ponomareva , Umar Syed , Andreas Terzis , Sergei Vassilvitskii

Privacy protection with synthetic data generation often uses differentially private statistics and model parameters to quantitatively express theoretical security. However, these methods do not take into account privacy protection due to…

Cryptography and Security · Computer Science 2023-04-03 Takayuki Miura , Toshiki Shibahara , Masanobu Kii , Atsunori Ichikawa , Juko Yamamoto , Koji Chida

The analysis of the privacy properties of Privacy-Preserving Ads APIs is an area of research that has received strong interest from academics, industry, and regulators. Despite this interest, the empirical study of these methods is hindered…

Cryptography and Security · Computer Science 2025-07-01 Travis Dick , Alessandro Epasto , Adel Javanmard , Josh Karlin , Andres Munoz Medina , Vahab Mirrokni , Sergei Vassilvitskii , Peilin Zhong

Differential privacy (DP) data synthesizers support public release of sensitive information, offering theoretical guarantees for privacy but limited evidence of utility in practical settings. Utility is typically measured as the error on…

Differentially-private mechanisms for text generation typically add carefully calibrated noise to input words and use the nearest neighbor to the noised input as the output word. When the noise is small in magnitude, these mechanisms are…

Computation and Language · Computer Science 2021-04-27 Zekun Xu , Abhinav Aggarwal , Oluwaseyi Feyisetan , Nathanael Teissier

Synthetic data generators, when trained using privacy-preserving techniques like differential privacy, promise to produce synthetic data with formal privacy guarantees, facilitating the sharing of sensitive data. However, it is crucial to…

Machine Learning · Computer Science 2024-11-20 Flavio Hafner , Chang Sun

Ensuring user privacy by synthesizing data from large language models (LLMs) tuned under differential privacy (DP) has become popular recently. However, the impact of DP fine-tuned LLMs on the quality of the language and the utility of the…

Computation and Language · Computer Science 2025-09-16 Erion Çano , Ivan Habernal

The integration of Differential Privacy (DP) with diffusion models (DMs) presents a promising yet challenging frontier, particularly due to the substantial memorization capabilities of DMs that pose significant privacy risks. Differential…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yu-Lin Tsai , Yizhe Li , Zekai Chen , Po-Yu Chen , Chia-Mu Yu , Xuebin Ren , Francois Buet-Golfouse

Many works at the intersection of Differential Privacy (DP) in Natural Language Processing aim to protect privacy by transforming texts under DP guarantees. This can be performed in a variety of ways, from word perturbations to full…

Computation and Language · Computer Science 2025-08-29 Stephen Meisenbacher , Maulik Chevli , Florian Matthes

Most of privacy protection studies for textual data focus on removing explicit sensitive identifiers. However, personal writing style, as a strong indicator of the authorship, is often neglected. Recent studies, such as SynTF, have shown…

Cryptography and Security · Computer Science 2021-05-14 Haohan Bo , Steven H. H. Ding , Benjamin C. M. Fung , Farkhund Iqbal

While modern machine learning models rely on increasingly large training datasets, data is often limited in privacy-sensitive domains. Generative models trained with differential privacy (DP) on sensitive data can sidestep this challenge,…

Machine Learning · Statistics 2024-01-02 Tim Dockhorn , Tianshi Cao , Arash Vahdat , Karsten Kreis

Privacy attacks, particularly membership inference attacks (MIAs), are widely used to assess the privacy of generative models for tabular synthetic data, including those with Differential Privacy (DP) guarantees. These attacks often exploit…

Cryptography and Security · Computer Science 2025-04-15 Georgi Ganev , Meenatchi Sundaram Muthu Selva Annamalai , Sofiane Mahiou , Emiliano De Cristofaro

Differentially Private Synthetic Data Generation (DP-SDG) is a key enabler of private and secure tabular-data sharing, producing artificial data that carries through the underlying statistical properties of the input data. This typically…

Machine Learning · Computer Science 2025-04-16 Samuel Maddock , Shripad Gade , Graham Cormode , Will Bullock

Synthetic data from generative models emerges as the privacy-preserving data sharing solution. Such a synthetic data set shall resemble the original data without revealing identifiable private information. Till date, the prior focus on…

Machine Learning · Computer Science 2025-07-23 Chaoyi Zhu , Jiayi Tang , Juan F. Pérez , Marten van Dijk , Lydia Y. Chen

Text data has become extremely valuable due to the emergence of machine learning algorithms that learn from it. A lot of high-quality text data generated in the real world is private and therefore cannot be shared or used freely due to…

Computation and Language · Computer Science 2024-07-25 Chulin Xie , Zinan Lin , Arturs Backurs , Sivakanth Gopi , Da Yu , Huseyin A Inan , Harsha Nori , Haotian Jiang , Huishuai Zhang , Yin Tat Lee , Bo Li , Sergey Yekhanin

As the issues of privacy and trust are receiving increasing attention within the research community, various attempts have been made to anonymize textual data. A significant subset of these approaches incorporate differentially private…

Cryptography and Security · Computer Science 2022-05-05 Justus Mattern , Benjamin Weggenmann , Florian Kerschbaum

Data engineering often requires accuracy (utility) constraints on results, posing significant challenges in designing differentially private (DP) mechanisms, particularly under stringent privacy parameter $\epsilon$. In this paper, we…

Cryptography and Security · Computer Science 2024-12-17 Bo Jiang , Wanrong Zhang , Donghang Lu , Jian Du , Sagar Sharma , Qiang Yan

The objective of differential privacy (DP) is to protect privacy by producing an output distribution that is indistinguishable between any two neighboring databases. However, traditional differentially private mechanisms tend to produce…

Cryptography and Security · Computer Science 2023-11-07 Kai Zhang , Yanjun Zhang , Ruoxi Sun , Pei-Wei Tsai , Muneeb Ul Hassan , Xin Yuan , Minhui Xue , Jinjun Chen

Generative adversarial network (GAN) has attracted increasing attention recently owing to its impressive ability to generate realistic samples with high privacy protection. Without directly interactive with training examples, the generative…

Machine Learning · Computer Science 2020-07-07 Chuan Ma , Jun Li , Ming Ding , Bo Liu , Kang Wei , Jian Weng , H. Vincent Poor

Machine Learning (ML) is accelerating progress across fields and industries, but relies on accessible and high-quality training data. Some of the most important datasets are found in biomedical and financial domains in the form of…

Machine Learning · Computer Science 2023-08-30 Gianluca Truda