English
Related papers

Related papers: Stable Diffusion for Data Augmentation in COCO and…

200 papers

Stable diffusion, a generative model used in text-to-image synthesis, frequently encounters resolution-induced composition problems when generating images of varying sizes. This issue primarily stems from the model being trained on pairs of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Qingping Zheng , Yuanfan Guo , Jiankang Deng , Jianhua Han , Ying Li , Songcen Xu , Hang Xu

Stable Diffusion has achieved remarkable success in the field of text-to-image generation, with its powerful generative capabilities and diverse generation results making a lasting impact. However, its iterative denoising introduces high…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Evelyn Zhang , Bang Xiao , Jiayi Tang , Qianli Ma , Chang Zou , Xuefei Ning , Xuming Hu , Linfeng Zhang

Variable selection for high-dimensional, highly correlated data has long been a challenging problem, often yielding unstable and unreliable models. We propose a resample-aggregate framework that exploits diffusion models' ability to…

Methodology · Statistics 2025-08-20 Minjie Wang , Xiaotong Shen , Wei Pan

Recent advancements in diffusion models have enabled the generation of realistic deepfakes from textual prompts in natural language. While these models have numerous benefits across various sectors, they have also raised concerns about the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Roberto Amoroso , Davide Morelli , Marcella Cornia , Lorenzo Baraldi , Alberto Del Bimbo , Rita Cucchiara

Stable Diffusion Models (SDMs) have shown remarkable proficiency in image synthesis. However, their broad application is impeded by their large model sizes and intensive computational requirements, which typically require expensive cloud…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Chenqian Yan , Songwei Liu , Hongjian Liu , Xurui Peng , Xiaojian Wang , Fangmin Chen , Lean Fu , Xing Mei

In digital advertising, the selection of the optimal item (recommendation) and its best creative presentation (creative optimization) have traditionally been considered separate disciplines. However, both contribute significantly to user…

Information Retrieval · Computer Science 2023-09-22 Veronika Shilova , Ludovic Dos Santos , Flavian Vasile , Gaëtan Racic , Ugo Tanielian

Diffusion models generate high-quality images but require dozens of forward passes. We introduce Distribution Matching Distillation (DMD), a procedure to transform a diffusion model into a one-step image generator with minimal impact on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Tianwei Yin , Michaël Gharbi , Richard Zhang , Eli Shechtman , Fredo Durand , William T. Freeman , Taesung Park

Data scarcity in medical imaging poses significant challenges due to privacy concerns. Diffusion models, a recent generative modeling technique, offer a potential solution by generating synthetic and realistic data. However, questions…

Image and Video Processing · Electrical Eng. & Systems 2024-12-24 Abdullah al Nomaan Nafi , Md. Alamgir Hossain , Rakib Hossain Rifat , Md Mahabub Uz Zaman , Md Manjurul Ahsan , Shivakumar Raman

As text-to-image models grow increasingly powerful and complex, their burgeoning size presents a significant obstacle to widespread adoption, especially on resource-constrained devices. This paper presents a pioneering study on…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Samarth N Ramesh , Zhixue Zhao

Modern diffusion models have set the state-of-the-art in AI image generation. Their success is due, in part, to training on Internet-scale data which often includes copyrighted work. This prompts questions about the extent to which these…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Stephen Casper , Zifan Guo , Shreya Mogulothu , Zachary Marinov , Chinmay Deshpande , Rui-Jie Yew , Zheng Dai , Dylan Hadfield-Menell

In this paper, we propose a novel diffusion-based approach to generate stereo images given a text prompt. Since stereo image datasets with large baselines are scarce, training a diffusion model from scratch is not feasible. Therefore, we…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Aakash Garg , Libing Zeng , Andrii Tsarov , Nima Khademi Kalantari

Generative foundation models like Stable Diffusion comprise a diverse spectrum of knowledge in computer vision with the potential for transfer learning, e.g., via generating data to train student models for downstream tasks. This could…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Leonhard Hennicke , Christian Medeiros Adriano , Holger Giese , Jan Mathias Koehler , Lukas Schott

Diffusion models have emerged as a powerful new family of deep generative models with record-breaking performance in many applications, including image synthesis, video generation, and molecule design. In this survey, we provide an overview…

Machine Learning · Computer Science 2025-09-30 Ling Yang , Zhilong Zhang , Yang Song , Shenda Hong , Runsheng Xu , Yue Zhao , Wentao Zhang , Bin Cui , Ming-Hsuan Yang

Deep generative models are becoming increasingly powerful, now generating diverse high fidelity photo-realistic samples given text prompts. Have they reached the point where models of natural images can be used for generative data…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Shekoofeh Azizi , Simon Kornblith , Chitwan Saharia , Mohammad Norouzi , David J. Fleet

The rapid advancement of generative models, such as Stable Diffusion, raises a key question: how can synthetic data from these models enhance predictive modeling? While they can generate vast amounts of datasets, only a subset meaningfully…

Machine Learning · Statistics 2025-05-09 Jialong Jiang , Wenkang Hu , Jian Huang , Yuling Jiao , Xu Liu

Diffusion models have demonstrated their effectiveness across various generative tasks. However, when applied to medical image segmentation, these models encounter several challenges, including significant resource and time requirements.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Tianyu Lin , Zhiguang Chen , Zhonghao Yan , Weijiang Yu , Fudan Zheng

Denoising diffusion models trained at web-scale have revolutionized image generation. The application of these tools to engineering design is an intriguing possibility, but is currently limited by their inability to parse and enforce…

Machine Learning · Computer Science 2023-06-19 Nikos Arechiga , Frank Permenter , Binyang Song , Chenyang Yuan

Preparing training data for deep vision models is a labor-intensive task. To address this, generative models have emerged as an effective solution for generating synthetic data. While current generative models produce image-level category…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Quang Nguyen , Truong Vu , Anh Tran , Khoi Nguyen

Recent advancements in text-to-image generation models have excelled in creating diverse and realistic images. This success extends to food imagery, where various conditional inputs like cooking styles, ingredients, and recipes are…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yuan Wang , Bin Zhu , Yanbin Hao , Chong-Wah Ngo , Yi Tan , Xiang Wang

Text-to-image diffusion models produce high quality images but do not offer control over individual instances in the image. We introduce InstanceDiffusion that adds precise instance-level control to text-to-image diffusion models.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Xudong Wang , Trevor Darrell , Sai Saketh Rambhatla , Rohit Girdhar , Ishan Misra