English
Related papers

Related papers: Synthetic Query Generation for Privacy-Preserving …

200 papers

Large language models (LLMs) have emerged as a powerful tool for synthetic data generation. A particularly important use case is producing synthetic replicas of private text, which requires carefully balancing privacy and utility. We…

Cryptography and Security · Computer Science 2026-04-14 Qian Ma , Sarah Rajtmajer

Synthetic data offers a promising path to train models while preserving data privacy. Differentially private (DP) finetuning of large language models (LLMs) as data generator is effective, but is impractical when computation resources are…

Computation and Language · Computer Science 2025-07-18 Bowen Tan , Zheng Xu , Eric Xing , Zhiting Hu , Shanshan Wu

Large language models (LLMs) are commonly adapted to downstream tasks through fine-tuning, but fine-tuning data often contains sensitive information that may be leaked by the resulting model. Differential privacy (DP) offers formal…

Machine Learning · Computer Science 2026-05-19 Haichao Sha , Zihao Wang , Yuncheng Wu , Hong Chen , Wei Dong

Differential Privacy (DP) is commonly employed to safeguard graph analysis or publishing. Distance, a critical factor in graph analysis, is typically handled using curator DP, where a trusted curator holds the complete neighbor lists of all…

Cryptography and Security · Computer Science 2025-08-08 Weihong Sheng , Jiajun Chen , Bin Cai , Chunqiang Hu , Meng Han , Jiguo Yu

The increasing use of synthetic data generated by Large Language Models (LLMs) presents both opportunities and challenges in data-driven applications. While synthetic data provides a cost-effective, scalable alternative to real-world data…

Computation and Language · Computer Science 2025-07-25 Tevin Atwal , Chan Nam Tieu , Yefeng Yuan , Zhan Shi , Yuhong Liu , Liang Cheng

Machine learning (ML) models have been shown to leak private information from their training datasets. Differential Privacy (DP), typically implemented through the differential private stochastic gradient descent algorithm (DP-SGD), has…

Machine Learning · Computer Science 2025-02-17 Dariush Wahdany , Matthew Jagielski , Adam Dziedzic , Franziska Boenisch

Differential Privacy (DP) image data synthesis, which leverages the DP technique to generate synthetic data to replace the sensitive data, allowing organizations to share and utilize synthetic images without privacy concerns. Previous…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Kecen Li , Chen Gong , Zhixiang Li , Yuzhong Zhao , Xinwen Hou , Tianhao Wang

Deep learning models have been extensively adopted in various regions due to their ability to represent hierarchical features, which highly rely on the training set and procedures. Thus, protecting the training process and deep learning…

Cryptography and Security · Computer Science 2025-03-12 Haodi Wang , Tangyu Jiang , Yu Guo , Chengjun Cai , Cong Wang , Xiaohua Jia

Data privacy is a core tenet of responsible computing, and in the United States, differential privacy (DP) is the dominant technical operationalization of privacy-preserving data analysis. With this study, we qualitatively examine one class…

Human-Computer Interaction · Computer Science 2024-12-18 Lucas Rosenblatt , Bill Howe , Julia Stoyanovich

Deep learning models can achieve high inference accuracy by extracting rich knowledge from massive well-annotated data, but may pose the risk of data privacy leakage in practical deployment. In this paper, we present an effective…

Machine Learning · Computer Science 2024-09-20 Bochao Liu , Jianghu Lu , Pengju Wang , Junjie Zhang , Dan Zeng , Zhenxing Qian , Shiming Ge

Existing differentially private (DP) synthetic data generation mechanisms typically assume a single-source table. In practice, data is often distributed across multiple tables with relationships across tables. In this paper, we introduce…

Machine Learning · Computer Science 2025-01-22 Kaveh Alimohammadi , Hao Wang , Ojas Gulati , Akash Srivastava , Navid Azizan

A common goal of privacy research is to release synthetic data that satisfies a formal privacy guarantee and can be used by an analyst in place of the original data. To achieve reasonable accuracy, a synthetic data set must be tuned to…

Databases · Computer Science 2015-03-20 Chao Li , Gerome Miklau

With the increasing applications of language models, it has become crucial to protect these models from leaking private information. Previous work has attempted to tackle this challenge by training RNN-based language models with…

Computation and Language · Computer Science 2022-07-19 Weiyan Shi , Aiqi Cui , Evan Li , Ruoxi Jia , Zhou Yu

Large language models (LLMs) have emerged as powerful tools for tackling complex tasks across diverse domains, but they also raise privacy concerns when fine-tuned on sensitive data due to potential memorization. While differential privacy…

Computation and Language · Computer Science 2024-08-19 Lynn Chua , Badih Ghazi , Yangsibo Huang , Pritish Kamath , Ravi Kumar , Daogao Liu , Pasin Manurangsi , Amer Sinha , Chiyuan Zhang

Deep learning holds immense promise for aiding radiologists in breast cancer detection. However, achieving optimal model performance is hampered by limitations in availability and sharing of data commonly associated to patient privacy…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Richard Osuala , Daniel M. Lang , Anneliese Riess , Georgios Kaissis , Zuzanna Szafranowska , Grzegorz Skorupko , Oliver Diaz , Julia A. Schnabel , Karim Lekadir

Synthetic data from generative models emerges as the privacy-preserving data sharing solution. Such a synthetic data set shall resemble the original data without revealing identifiable private information. Till date, the prior focus on…

Machine Learning · Computer Science 2025-07-23 Chaoyi Zhu , Jiayi Tang , Juan F. Pérez , Marten van Dijk , Lydia Y. Chen

Nowadays, machine learning models and applications have become increasingly pervasive. With this rapid increase in the development and employment of machine learning models, a concern regarding privacy has risen. Thus, there is a legitimate…

Machine Learning · Computer Science 2022-11-22 Samah Baraheem , Zhongmei Yao

The difficulty of anonymizing text data hinders the development and deployment of NLP in high-stakes domains that involve private data, such as healthcare and social services. Poorly anonymized sensitive data cannot be easily shared with…

Computation and Language · Computer Science 2024-10-14 Krithika Ramesh , Nupoor Gandhi , Pulkit Madaan , Lisa Bauer , Charith Peris , Anjalie Field

Training generative models with differential privacy (DP) typically involves injecting noise into gradient updates or adapting the discriminator's training procedure. As a result, such approaches often struggle with hyper-parameter tuning…

Machine Learning · Computer Science 2024-10-29 Kristjan Greenewald , Yuancheng Yu , Hao Wang , Kai Xu

The integration of Differential Privacy (DP) with diffusion models (DMs) presents a promising yet challenging frontier, particularly due to the substantial memorization capabilities of DMs that pose significant privacy risks. Differential…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Yu-Lin Tsai , Yizhe Li , Zekai Chen , Po-Yu Chen , Chia-Mu Yu , Xuebin Ren , Francois Buet-Golfouse