English
Related papers

Related papers: Synthetic Text Generation with Differential Privac…

200 papers

Ensuring user privacy by synthesizing data from large language models (LLMs) tuned under differential privacy (DP) has become popular recently. However, the impact of DP fine-tuned LLMs on the quality of the language and the utility of the…

Computation and Language · Computer Science 2025-09-16 Erion Çano , Ivan Habernal

Large language models (LLMs) have presented outstanding performance in code generation and completion. However, fine-tuning these models on private datasets can raise privacy and proprietary concerns, such as the leakage of sensitive…

Cryptography and Security · Computer Science 2026-01-16 Zheng Liu , Chen Gong , Terry Yue Zhuo , Kecen Li , Weichen Yu , Matt Fredrikson , Tianhao Wang

While many deep learning models trained on private datasets have been deployed in various practical tasks, they may pose a privacy leakage risk as attackers could recover informative data or label knowledge from models. In this work, we…

Machine Learning · Computer Science 2026-01-28 Bochao Liu , Shiming Ge , Pengju Wang , Shikun Li , Tongliang Liu

Deep learning models have demonstrated superior performance in several application problems, such as image classification and speech processing. However, creating a deep learning model using health record data requires addressing certain…

Machine Learning · Computer Science 2021-12-14 Amirsina Torfi , Edward A. Fox , Chandan K. Reddy

Many works at the intersection of Differential Privacy (DP) in Natural Language Processing aim to protect privacy by transforming texts under DP guarantees. This can be performed in a variety of ways, from word perturbations to full…

Computation and Language · Computer Science 2025-08-29 Stephen Meisenbacher , Maulik Chevli , Florian Matthes

In differential privacy (DP), a challenging problem is to generate synthetic datasets that efficiently capture the useful information in the private data. The synthetic dataset enables any task to be done without privacy concern and…

Cryptography and Security · Computer Science 2021-01-01 Zhikun Zhang , Tianhao Wang , Ninghui Li , Jean Honorio , Michael Backes , Shibo He , Jiming Chen , Yang Zhang

Diferentially private (DP) synthetic datasets are a powerful approach for training machine learning models while respecting the privacy of individual data providers. The effect of DP on the fairness of the resulting trained models is not…

Machine Learning · Statistics 2021-06-21 Mayana Pereira , Meghana Kshirsagar , Sumit Mukherjee , Rahul Dodhia , Juan Lavista Ferres

Deep neural networks often use large, high-quality datasets to achieve high performance on many machine learning tasks. When training involves potentially sensitive data, this process can raise privacy concerns, as large models have been…

Machine Learning · Computer Science 2025-06-23 Felix Zhou , Samson Zhou , Vahab Mirrokni , Alessandro Epasto , Vincent Cohen-Addad

In cross-silo federated learning (FL), sensitive text datasets remain confined to local organizations due to privacy regulations, making repeated training for each downstream task both communication-intensive and privacy-demanding. A…

Machine Learning · Computer Science 2026-03-10 Jiayi Wang , John Gounley , Heidi Hanson

Synthetic data offers a promising path to train models while preserving data privacy. Differentially private (DP) finetuning of large language models (LLMs) as data generator is effective, but is impractical when computation resources are…

Computation and Language · Computer Science 2025-07-18 Bowen Tan , Zheng Xu , Eric Xing , Zhiting Hu , Shanshan Wu

The need to analyze sensitive data, such as medical records or financial data, has created a critical research challenge in recent years. In this paper, we adopt the framework of differential privacy, and explore mechanisms for generating…

Cryptography and Security · Computer Science 2024-05-09 Nikolija Bojkovic , Po-Ling Loh

As the utilization of network traces for the network measurement research becomes increasingly prevalent, concerns regarding privacy leakage from network traces have garnered the public's attention. To safeguard network traces, researchers…

Cryptography and Security · Computer Science 2024-09-10 Danyu Sun , Joann Qiongna Chen , Chen Gong , Tianhao Wang , Zhou Li

Task-oriented dialogue systems often assist users with personal or confidential matters. For this reason, the developers of such a system are generally prohibited from observing actual usage. So how can they know where the system is failing…

Computation and Language · Computer Science 2023-06-12 Fatemehsadat Mireshghallah , Yu Su , Tatsunori Hashimoto , Jason Eisner , Richard Shin

Artificial intelligence and data access are already mainstream. One of the main challenges when designing an artificial intelligence or disclosing content from a database is preserving the privacy of individuals who participate in the…

Cryptography and Security · Computer Science 2023-12-13 Clément Pierquin , Bastien Zimmermann , Matthieu Boussard

Generating tabular data under differential privacy (DP) protection ensures theoretical privacy guarantees but poses challenges for training machine learning models, primarily due to the need to capture complex structures under noisy…

Machine Learning · Computer Science 2025-04-30 Tejumade Afonja , Hui-Po Wang , Raouf Kerkouche , Mario Fritz

Synthetic data has gained significant momentum thanks to sophisticated machine learning tools that enable the synthesis of high-dimensional datasets. However, many generation techniques do not give the data controller control over what…

Cryptography and Security · Computer Science 2022-11-22 Florimond Houssiau , Samuel N. Cohen , Lukasz Szpruch , Owen Daniel , Michaela G. Lawrence , Robin Mitra , Henry Wilde , Callum Mole

Differential privacy is a formal, mathematical definition of data privacy that has gained traction in academia, industry, and government. The task of correctly constructing differentially private algorithms is non-trivial, and mistakes have…

Cryptography and Security · Computer Science 2021-01-05 Subhajit Roy , Justin Hsu , Aws Albarghouthi

Generative Adversarial Networks (GANs) are one of the well-known models to generate synthetic data including images, especially for research communities that cannot use original sensitive datasets because they are not publicly accessible.…

Machine Learning · Computer Science 2020-01-28 Reihaneh Torkzadehmahani , Peter Kairouz , Benedict Paten

Differentially private (DP) synthetic data generation is a practical method for improving access to data as a means to encourage productive partnerships. One issue inherent to DP is that the "privacy budget" is generally "spent" evenly…

Machine Learning · Computer Science 2022-08-11 Lucas Rosenblatt , Joshua Allen , Julia Stoyanovich

Access to genomic data is highly regulated due to its sensitive nature. While safeguards are essential, cumbersome data access processes pose a significant barrier to the development of AI methods for genomics. Synthetic data generation can…

Cryptography and Security · Computer Science 2026-05-01 Daniil Filienko , Martine De Cock , Sikha Pentyala