English
Related papers

Related papers: Private Synthetic Text Generation with Diffusion M…

200 papers

Differentially private (DP) synthetic data is a versatile tool for enabling the analysis of private data. Recent advancements in large language models (LLMs) have inspired a number of algorithm techniques for improving DP synthetic data…

Machine Learning · Computer Science 2025-02-11 Marika Swanberg , Ryan McKenna , Edo Roth , Albert Cheu , Peter Kairouz

Recently, powerful Large Language Models (LLMs) have become easily accessible to hundreds of millions of users world-wide. However, their strong capabilities and vast world knowledge do not come without associated privacy risks. In this…

Machine Learning · Computer Science 2024-11-05 Hanna Yukhymenko , Robin Staab , Mark Vero , Martin Vechev

Recent advancements in diffusion models have significantly impacted content creation, leading to the emergence of Personalized Content Synthesis (PCS). By utilizing a small set of user-provided examples featuring the same subject, PCS aims…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Xulu Zhang , Xiaoyong Wei , Wentao Hu , Jinlin Wu , Jiaxin Wu , Wengyu Zhang , Zhaoxiang Zhang , Zhen Lei , Qing Li

Training generative machine learning models to produce synthetic tabular data has become a popular approach for enhancing privacy in data sharing. As this typically involves processing sensitive personal information, releasing either the…

Cryptography and Security · Computer Science 2026-02-02 Georgi Ganev , Emiliano De Cristofaro

Modern vision models excel at general purpose downstream tasks. It is unclear, however, how they may be used for personalized vision tasks, which are both fine-grained and data-scarce. Recent works have successfully applied synthetic data…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Shobhita Sundaram , Julia Chae , Yonglong Tian , Sara Beery , Phillip Isola

Latent Diffusion Models (LDMs) enable high-quality image synthesis while avoiding excessive compute demands by training a diffusion model in a compressed lower-dimensional latent space. Here, we apply the LDM paradigm to high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Andreas Blattmann , Robin Rombach , Huan Ling , Tim Dockhorn , Seung Wook Kim , Sanja Fidler , Karsten Kreis

Synthetic data has gained significant momentum thanks to sophisticated machine learning tools that enable the synthesis of high-dimensional datasets. However, many generation techniques do not give the data controller control over what…

Cryptography and Security · Computer Science 2022-11-22 Florimond Houssiau , Samuel N. Cohen , Lukasz Szpruch , Owen Daniel , Michaela G. Lawrence , Robin Mitra , Henry Wilde , Callum Mole

Text-to-image diffusion models have achieved widespread popularity due to their unprecedented image generation capability. In particular, their ability to synthesize and modify human faces has spurred research into using generated face…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Harrison Rosenberg , Shimaa Ahmed , Guruprasad V Ramesh , Ramya Korlakai Vinayak , Kassem Fawaz

Training data plays a crucial role in Large Language Models (LLM) scaling, yet high quality data is of limited supply. Synthetic data techniques offer a potential path toward sidestepping these limitations. We conduct a large-scale…

Generative foundation models like Stable Diffusion comprise a diverse spectrum of knowledge in computer vision with the potential for transfer learning, e.g., via generating data to train student models for downstream tasks. This could…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Leonhard Hennicke , Christian Medeiros Adriano , Holger Giese , Jan Mathias Koehler , Lukas Schott

Face recognition models are trained on large-scale datasets, which have privacy and ethical concerns. Lately, the use of synthetic data to complement or replace genuine data for the training of face recognition models has been proposed.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 David Geissbühler , Hatef Otroshi Shahreza , Sébastien Marcel

Recent advancements in diffusion models have significantly impacted the trajectory of generative machine learning research, with many adopting the strategy of fine-tuning pre-trained models using domain-specific text-to-image datasets.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Mischa Dombrowski , Hadrien Reynaud , Johanna P. Müller , Matthew Baugh , Bernhard Kainz

Recent years have witnessed a surge in the popularity of Machine Learning (ML), applied across diverse domains. However, progress is impeded by the scarcity of training data due to expensive acquisition and privacy legislation. Synthetic…

Machine Learning · Computer Science 2024-02-05 André Bauer , Simon Trapp , Michael Stenger , Robert Leppich , Samuel Kounev , Mark Leznik , Kyle Chard , Ian Foster

Institutions collect massive learning traces but they may not disclose it for privacy issues. Synthetic data generation opens new opportunities for research in education. In this paper we present a generative model for educational data that…

Computers and Society · Computer Science 2022-07-09 Jill-Jênn Vie , Tomas Rigaux , Sein Minn

Accurately learning from user data while ensuring quantifiable privacy guarantees provides an opportunity to build better Machine Learning (ML) models while maintaining user trust. Recent literature has demonstrated the applicability of a…

Machine Learning · Computer Science 2020-12-11 Oluwaseyi Feyisetan , Abhinav Aggarwal , Zekun Xu , Nathanael Teissier

Differential Privacy (DP) image data synthesis, which leverages the DP technique to generate synthetic data to replace the sensitive data, allowing organizations to share and utilize synthetic images without privacy concerns. Previous…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Kecen Li , Chen Gong , Zhixiang Li , Yuzhong Zhao , Xinwen Hou , Tianhao Wang

Using Large Language Models (LLMs) to generate synthetic data for model training has become increasingly popular in recent years. While LLMs are capable of producing realistic training data, the effectiveness of data generation is…

Computation and Language · Computer Science 2024-07-23 Yinheng Li , Rogerio Bonatti , Sara Abdali , Justin Wagle , Kazuhito Koishida

Recent advances in computer vision have shown promising results in image generation. Diffusion probabilistic models in particular have generated realistic images from textual input, as demonstrated by DALL-E 2, Imagen and Stable Diffusion.…

Pre-training large transformer models with in-domain data improves domain adaptation and helps gain performance on the domain-specific downstream tasks. However, sharing models pre-trained on potentially sensitive data is prone to…

Computation and Language · Computer Science 2025-08-14 Ying Yin , Ivan Habernal

Text generation aims to produce human-like natural language output for down-stream tasks. It covers a wide range of applications like machine translation, document summarization, dialogue generation and so on. Recently deep neural…

Computation and Language · Computer Science 2022-03-07 Xiaoyu Shen