English
Related papers

Related papers: Private Synthetic Text Generation with Diffusion M…

200 papers

While diffusion models have significantly advanced the quality of image generation their capability to accurately and coherently render text within these images remains a substantial challenge. Conventional diffusion-based methods for scene…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qilong Zhangli , Jindong Jiang , Di Liu , Licheng Yu , Xiaoliang Dai , Ankit Ramchandani , Guan Pang , Dimitris N. Metaxas , Praveen Krishnan

Text-to-image diffusion models are a class of deep generative models that have demonstrated an impressive capacity for high-quality image generation. However, these models are susceptible to implicit biases that arise from web-scale…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Yinan Zhang , Eric Tzeng , Yilun Du , Dmitry Kislyuk

Generating tabular data under differential privacy (DP) protection ensures theoretical privacy guarantees but poses challenges for training machine learning models, primarily due to the need to capture complex structures under noisy…

Machine Learning · Computer Science 2025-04-30 Tejumade Afonja , Hui-Po Wang , Raouf Kerkouche , Mario Fritz

Recent advances in synthetic imaging open up opportunities for obtaining additional data in the field of surgical imaging. This data can provide reliable supplements supporting surgical applications and decision-making through computer…

Image and Video Processing · Electrical Eng. & Systems 2023-12-07 Simeon Allmendinger , Patrick Hemmer , Moritz Queisner , Igor Sauer , Leopold Müller , Johannes Jakubik , Michael Vössing , Niklas Kühl

Generating clinical synthetic text represents an effective solution for common clinical NLP issues like sparsity and privacy. This paper aims to conduct a systematic review on generating synthetic medical free-text by formulating…

Computation and Language · Computer Science 2025-07-25 Basel Alshaikhdeeb , Ahmed Abdelmonem Hemedan , Soumyabrata Ghosh , Irina Balaur , Venkata Satagopam

The increasingly pervasive facial recognition (FR) systems raise serious concerns about personal privacy, especially for billions of users who have publicly shared their photos on social media. Several attempts have been made to protect…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jiang Liu , Chun Pong Lau , Zhongliang Guo , Yuxiang Guo , Zhaoyang Wang , Rama Chellappa

To synthesize high-fidelity samples, diffusion models typically require auxiliary data to guide the generation process. However, it is impractical to procure the painstaking patch-level annotation effort required in specialized domains like…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Alexandros Graikos , Srikar Yellapragada , Minh-Quan Le , Saarthak Kapse , Prateek Prasanna , Joel Saltz , Dimitris Samaras

With the emergence of diffusion models as a frontline generative model, many researchers have proposed molecule generation techniques with conditional diffusion models. However, the unavoidable discreteness of a molecule makes it difficult…

Machine Learning · Computer Science 2025-06-05 Jinho Chang , Jong Chul Ye

Generative Adversarial Networks (GANs) and diffusion models have emerged as leading approaches for high-quality image synthesis. While both can be trained under differential privacy (DP) to protect sensitive data, their sensitivity to…

Machine Learning · Computer Science 2025-09-04 Ilana Sebag , Jean-Yves Franceschi , Alain Rakotomamonjy , Alexandre Allauzen , Jamal Atif

Generative text-to-image models enable us to synthesize unlimited amounts of images in a controllable manner, spurring many recent efforts to train vision models with synthetic data. However, every synthetic image ultimately originates from…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Scott Geng , Cheng-Yu Hsieh , Vivek Ramanujan , Matthew Wallingford , Chun-Liang Li , Pang Wei Koh , Ranjay Krishna

When developing text classification models for real world applications, one major challenge is the difficulty to collect sufficient data for all text classes. In this work, we address this challenge by utilizing large language models (LLMs)…

Computation and Language · Computer Science 2025-08-15 Chenhao Xue , Yuanzhe Jin , Adrian Carrasco-Revilla , Joyraj Chakraborty , Min Chen

Text-to-image generation has witnessed significant progress with the advent of diffusion models. Despite the ability to generate photorealistic images, current text-to-image diffusion models still often struggle to accurately interpret and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Tsung-Han Wu , Long Lian , Joseph E. Gonzalez , Boyi Li , Trevor Darrell

Recently, diffusion-based image generation methods are credited for their remarkable text-to-image generation capabilities, while still facing challenges in accurately generating multilingual scene text images. To tackle this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Lingjun Zhang , Xinyuan Chen , Yaohui Wang , Yue Lu , Yu Qiao

Diffusion-based text-to-image models have shown immense potential for various image-related tasks. However, despite their prominence and popularity, customizing these models using unauthorized data also brings serious privacy and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sen Peng , Jijia Yang , Mingyue Wang , Jianfei He , Xiaohua Jia

Generative AI has seen remarkable growth over the past few years, with diffusion models being state-of-the-art for image generation. This study investigates the use of diffusion models in generating artificial data generation for electronic…

Machine Learning · Computer Science 2023-10-18 Prasha Srivastava , Pawan Kumar , Zia Abbas

How can we release a massive volume of sensitive data while mitigating privacy risks? Privacy-preserving data synthesis enables the data holder to outsource analytical tasks to an untrusted third party. The state-of-the-art approach for…

Machine Learning · Computer Science 2022-03-08 Shun Takagi , Tsubasa Takahashi , Yang Cao , Masatoshi Yoshikawa

As sufficient data are not always publically accessible for model training, researchers exploit limited data with advanced learning algorithms or expand the dataset via data augmentation (DA). Conducting DA in private domain requires…

Computation and Language · Computer Science 2024-02-27 Yiping Song , Juhua Zhang , Zhiliang Tian , Yuxin Yang , Minlie Huang , Dongsheng Li

The widespread adoption of synthetic data raises new questions about how models generating the data can influence other large language models (LLMs) via distilled data. To start, our work exhaustively characterizes the impact of passive…

Computation and Language · Computer Science 2024-07-22 Luísa Shimabucoro , Sebastian Ruder , Julia Kreutzer , Marzieh Fadaee , Sara Hooker

Layer compositing is one of the most popular image editing workflows among both amateurs and professionals. Motivated by the success of diffusion models, we explore layer compositing from a layered image generation perspective. Instead of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Xinyang Zhang , Wentian Zhao , Xin Lu , Jeff Chien

Techniques to deliver privacy-preserving synthetic datasets take a sensitive dataset as input and produce a similar dataset as output while maintaining differential privacy. These approaches have the potential to improve data sharing and…

Databases · Computer Science 2018-08-24 Luke Rodriguez , Bill Howe