English
Related papers

Related papers: Navigating the Synthetic Realm: Harnessing Diffusi…

200 papers

While diffusion models have significantly advanced the quality of image generation their capability to accurately and coherently render text within these images remains a substantial challenge. Conventional diffusion-based methods for scene…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qilong Zhangli , Jindong Jiang , Di Liu , Licheng Yu , Xiaoliang Dai , Ankit Ramchandani , Guan Pang , Dimitris N. Metaxas , Praveen Krishnan

Text-to-image diffusion models produce impressive results but are frustrating tools for artists who desire fine-grained control. For example, a common use case is to create images of a specific instance in novel contexts, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Shengqu Cai , Eric Chan , Yunzhi Zhang , Leonidas Guibas , Jiajun Wu , Gordon Wetzstein

Language-guided image generation has achieved great success nowadays by using diffusion models. However, texts can be less detailed to describe highly-specific subjects such as a particular dog or a certain car, which makes pure…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Yiyang Ma , Huan Yang , Wenjing Wang , Jianlong Fu , Jiaying Liu

Large-scale text-to-image models have demonstrated amazing ability to synthesize diverse and high-fidelity images. However, these models are often violated by several limitations. Firstly, they require the user to provide precise and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yupei Lin , Sen Zhang , Xiaojun Yang , Xiao Wang , Yukai Shi

Current semantic segmentation models typically require a substantial amount of manually annotated data, a process that is both time-consuming and resource-intensive. Alternatively, leveraging advanced text-to-image models such as Midjourney…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Bo Gao , Jianhui Wang , Xinyuan Song , Yangfan He , Fangxu Xing , Tianyu Shi

Differentially private (DP) image synthesis aims to generate synthetic images from a sensitive dataset, alleviating the privacy leakage concerns of organizations sharing and utilizing synthetic images. Although previous methods have…

Cryptography and Security · Computer Science 2025-06-24 Kecen Li , Chen Gong , Xiaochen Li , Yuzhong Zhao , Xinwen Hou , Tianhao Wang

We present a one-shot text-to-image diffusion model that can generate high-resolution images from natural language descriptions. Our model employs a layered U-Net architecture that simultaneously synthesizes images at multiple resolution…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Emaad Khwaja , Abdullah Rashwan , Ting Chen , Oliver Wang , Suraj Kothawade , Yeqing Li

We propose an image synthesis mechanism for multi-sequence prostate MR images conditioned on text, to control lesion presence and sequence, as well as to generate paired bi-parametric images conditioned on images e.g. for generating…

Image and Video Processing · Electrical Eng. & Systems 2023-03-06 Shaheer U. Saeed , Tom Syer , Wen Yan , Qianye Yang , Mark Emberton , Shonit Punwani , Matthew J. Clarkson , Dean C. Barratt , Yipeng Hu

Text-to-image generation is a significant domain in modern computer vision and has achieved substantial improvements through the evolution of generative architectures. Among these, there are diffusion-based models that have demonstrated…

Text-to-Image models have introduced a remarkable leap in the evolution of machine learning, demonstrating high-quality synthesis of images from a given text-prompt. However, these powerful pretrained models still lack control handles that…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Andrey Voynov , Kfir Aberman , Daniel Cohen-Or

Deep learning approaches have become the standard solution to many problems in computer vision and robotics, but obtaining sufficient training data in high enough quality is challenging, as human labor is error prone, time consuming, and…

Machine Learning · Computer Science 2021-06-16 Jan Blumenkamp , Andreas Baude , Tim Laue

Over the past decade, there has been tremendous progress in creating synthetic media, mainly thanks to the development of powerful methods based on generative adversarial networks (GAN). Very recently, methods based on diffusion models (DM)…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Riccardo Corvi , Davide Cozzolino , Giada Zingarini , Giovanni Poggi , Koki Nagano , Luisa Verdoliva

With the rapid adoption of diffusion models, synthetic data generation has emerged as a promising approach for addressing the growing demand for large-scale image datasets. However, images generated purely by diffusion models often exhibit…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Thejas Venkatesh , Suguna Varshini Velury

Driven by rapid advances in large-scale generative models, synthetic data has emerged as a promising solution for visual understanding. While modern diffusion models achieve remarkable photorealistic image synthesis, their potential in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Jinjin Zhang , Xiefan Guo , Yizhou Jin , Nan Zhou , Di Huang

We present an overview and evaluation of a new, systematic approach for generation of highly realistic, annotated synthetic data for training of deep neural networks in computer vision tasks. The main contribution is a procedural world…

Computer Vision and Pattern Recognition · Computer Science 2017-10-19 Apostolia Tsirikoglou , Joel Kronander , Magnus Wrenninge , Jonas Unger

Medical Vision-Language Pre-training (VLP) learns representations jointly from medical images and paired radiology reports. It typically requires large-scale paired image-text datasets to achieve effective pre-training for both the image…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Che Liu , Anand Shah , Wenjia Bai , Rossella Arcucci

Diffusion models have shown impressive performance for generative modelling of images. In this paper, we present a novel semantic segmentation method based on diffusion models. By modifying the training and sampling scheme, we show that…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Julia Wolleb , Robin Sandkühler , Florentin Bieder , Philippe Valmaggia , Philippe C. Cattin

In this paper, we explore the feasibility of using generative models, specifically Progressive Growing GANs (PG-GANs) and Stable Diffusion fine-tuning, to generate synthetic chest X-ray images for medical diagnosis purposes. Due to ethical…

Image and Video Processing · Electrical Eng. & Systems 2023-05-31 Muhammad Danyal Malik , Danish Humair

Generative diffusion models offer a natural choice for data augmentation when training complex vision models. However, ensuring reliability of their generative content as augmentation samples remains an open challenge. Despite a number of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Khawar Islam , Naveed Akhtar

Text-to-image generation models have progressed considerably in recent years, which can now generate impressive realistic images from arbitrary text. Most of such models are trained on web-scale image-text paired datasets, which may not be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Yufan Zhou , Chunyuan Li , Changyou Chen , Jianfeng Gao , Jinhui Xu