English
Related papers

Related papers: Diffusion Soup: Model Merging for Text-to-Image Di…

200 papers

Diffusion-based text-to-image generation models trained on extensive text-image pairs have demonstrated the ability to produce photorealistic images aligned with textual descriptions. However, a significant limitation of these models is…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Mingyuan Zhou , Zhendong Wang , Huangjie Zheng , Hai Huang

With the incorporation of the UNet architecture, diffusion probabilistic models have become a dominant force in image generation tasks. One key design in UNet is the skip connections between the encoder and decoder blocks. Although skip…

Machine Learning · Computer Science 2024-02-26 Jiajun Ma , Shuchen Xue , Tianyang Hu , Wenjia Wang , Zhaoqiang Liu , Zhenguo Li , Zhi-Ming Ma , Kenji Kawaguchi

Recent advancements in image synthesis are fueled by the advent of large-scale diffusion models. Yet, integrating realistic object visualizations seamlessly into new or existing backgrounds without extensive training remains a challenge.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Phillip Mueller , Jannik Wiese , Ioan Craciun , Lars Mikelsons

Diffusion models are extensively used for modeling image priors for inverse problems. We introduce \emph{Diff-Unfolding}, a principled framework for learning posterior score functions of \emph{conditional diffusion models} by explicitly…

Image and Video Processing · Electrical Eng. & Systems 2025-05-22 Yuanhao Wang , Shirin Shoushtari , Ulugbek S. Kamilov

The rapid advancement of text-to-image Diffusion Models has led to their widespread public accessibility. However these models, trained on large internet datasets, can sometimes generate undesirable outputs. To mitigate this, approximate…

Machine Learning · Computer Science 2024-11-05 Andrea Schioppa , Emiel Hoogeboom , Jonathan Heek

Producing quality segmentation masks for images is a fundamental problem in computer vision. Recent research has explored large-scale supervised training to enable zero-shot segmentation on virtually any image style and unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Junjiao Tian , Lavisha Aggarwal , Andrea Colaco , Zsolt Kira , Mar Gonzalez-Franco

Synthesizing high-quality tabular data is an important topic in many data science tasks, ranging from dataset augmentation to privacy protection. However, developing expressive generative models for tabular data is challenging due to its…

Machine Learning · Computer Science 2025-02-18 Juntong Shi , Minkai Xu , Harper Hua , Hengrui Zhang , Stefano Ermon , Jure Leskovec

In this study, we show that diffusion models can be used in industrial scenarios to improve the data augmentation procedure in the context of surface defect detection. In general, defect detection classifiers are trained on ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Luigi Capogrosso , Federico Girella , Francesco Taioli , Michele Dalla Chiara , Muhammad Aqeel , Franco Fummi , Francesco Setti , Marco Cristani

Personalized text-to-image generation has gained significant attention for its capability to generate high-fidelity portraits of specific identities conditioned on user-defined prompts. Existing methods typically involve test-time…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Yujia Wu , Yiming Shi , Jiwei Wei , Chengwei Sun , Yang Yang , Heng Tao Shen

Diffusion models are now the undisputed state-of-the-art for image generation and image restoration. However, they require large amounts of computational power for training and inference. In this paper, we propose lightweight diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Nicolas Cherel , Andrés Almansa , Yann Gousseau , Alasdair Newson

Text-to-Image models such as Stable Diffusion have shown impressive image generation synthesis, thanks to the utilization of large-scale datasets. However, these datasets may contain sexually explicit, copyrighted, or undesirable content,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Seunghoo Hong , Juhun Lee , Simon S. Woo

Diffusion models, known for their tremendous ability to generate novel and high-quality samples, have recently raised concerns due to their data memorization behavior, which poses privacy risks. Recent approaches for memory mitigation…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Xiao Liu , Xiaoliu Guan , Yu Wu , Jiaxu Miao

Recent advancements in large scale text-to-image models have opened new possibilities for guiding the creation of images through human-devised natural language. However, while prior literature has primarily focused on the generation of…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Hyeonho Jeong , Gihyun Kwon , Jong Chul Ye

Diffusion models achieve remarkable generation quality, yet face a fundamental challenge known as memorization, where generated samples can replicate training samples exactly. We develop a theoretical framework to explain this phenomenon by…

Machine Learning · Computer Science 2026-03-31 Xinyu Zhou , Jiawei Zhang , Stephen J. Wright

This paper presents the first exploration of text-to-image diffusion models for zero-shot sketch-based 3D shape retrieval (ZS-SBSR). Existing sketch-based 3D shape retrieval methods struggle in zero-shot settings due to the absence of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Hang Cheng , Fanhe Dong , Long Zeng

Text-to-image diffusion models enable high-quality image generation but are computationally expensive. While prior work optimizes per-inference efficiency, we explore an orthogonal approach: reducing redundancy across correlated prompts.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Dale Decatur , Thibault Groueix , Wang Yifan , Rana Hanocka , Vladimir Kim , Matheus Gadelha

Recent breakthroughs in text-to-image synthesis have been driven by diffusion models trained on billions of image-text pairs. Adapting this approach to 3D synthesis would require large-scale datasets of labeled 3D data and efficient…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Ben Poole , Ajay Jain , Jonathan T. Barron , Ben Mildenhall

With the growing interest in foundation models for brain signals, graph-based pretraining has emerged as a promising paradigm for learning transferable representations from connectome data. However, existing contrastive and masked…

Machine Learning · Computer Science 2026-03-10 Xinxu Wei , Rong Zhou , Lifang He , Yu Zhang

While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which addresses both families of tasks simultaneously. We…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Soumik Mukhopadhyay , Matthew Gwilliam , Yosuke Yamaguchi , Vatsal Agarwal , Namitha Padmanabhan , Archana Swaminathan , Tianyi Zhou , Jun Ohya , Abhinav Shrivastava

Text-to-3D generation has shown rapid progress in recent days with the advent of score distillation, a methodology of using pretrained text-to-2D diffusion models to optimize neural radiance field (NeRF) in the zero-shot setting. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Junyoung Seo , Wooseok Jang , Min-Seop Kwak , Hyeonsu Kim , Jaehoon Ko , Junho Kim , Jin-Hwa Kim , Jiyoung Lee , Seungryong Kim