English
Related papers

Related papers: Steer Away From Mode Collisions: Improving Composi…

200 papers

Editing images with diffusion models under strict training-free constraints remains a significant challenge. While recent optimisation-based methods achieve strong zero-shot edits from text, they struggle to preserve identity and capture…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Niki Foteinopoulou , Ignas Budvytis , Stephan Liwicki

Recent text-to-image (T2I) diffusion models show outstanding performance in generating high-quality images conditioned on textual prompts. However, they fail to semantically align the generated images with the prompts due to their limited…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Ruichen Wang , Zekang Chen , Chen Chen , Jian Ma , Haonan Lu , Xiaodong Lin

While there has been significant progress in customizing text-to-image generation models, generating images that combine multiple personalized concepts remains challenging. In this work, we introduce Concept Weaver, a method for composing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-08 Gihyun Kwon , Simon Jenni , Dingzeyu Li , Joon-Young Lee , Jong Chul Ye , Fabian Caba Heilbron

Despite recent advances in text-to-image (T2I) models, they often fail to faithfully render all elements of complex prompts, frequently omitting or misrepresenting specific objects and attributes. Test-time optimization has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Mohammad Hossein Sameti , Amir M. Mansourian , Arash Marioriyad , Soheil Fadaee Oshyani , Mohammad Hossein Rohban , Mahdieh Soleymani Baghshah

Diffusion models have demonstrated exceptional performances in various fields of generative modeling, but suffer from slow sampling speed due to their iterative nature. While this issue is being addressed in continuous domains, discrete…

Machine Learning · Computer Science 2025-05-12 Satoshi Hayakawa , Yuhta Takida , Masaaki Imaizumi , Hiromi Wakaki , Yuki Mitsufuji

Text-to-image diffusion models have achieved remarkable success in generating photorealistic images. However, the inclusion of sensitive information during pre-training poses significant risks. Machine Unlearning (MU) offers a promising…

Machine Learning · Computer Science 2025-03-19 Yongliang Wu , Shiji Zhou , Mingzhuo Yang , Lianzhe Wang , Heng Chang , Wenbo Zhu , Xinting Hu , Xiao Zhou , Xu Yang

Dataset Distillation aims to synthesize compact datasets that can approximate the training efficacy of large-scale real datasets, offering an efficient solution to the increasing computational demands of modern deep learning. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Chenru Wang , Yunyi Chen , Zijun Yang , Joey Tianyi Zhou , Chi Zhang

Diffusion models are a powerful class of generative models capable of producing high-quality images from pure noise using a simple text prompt. While most methods which introduce additional spatial constraints into the generated images…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Zakaria Patel , Kirill Serkh

Text-to-image diffusion models have an unprecedented ability to generate diverse and high-quality images. However, they often struggle to faithfully capture the intended semantics of complex input prompts that include multiple subjects.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Omer Dahary , Or Patashnik , Kfir Aberman , Daniel Cohen-Or

SAM3 advances open-vocabulary semantic segmentation by introducing a prompt-driven mask generation paradigm. However, in multi-class open-vocabulary scenarios, masks generated independently from different category prompts lack a unified and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Yanhui Chen , Baoyao Yang , Siqi Liu , Jingchao Wang

Text-to-3D is an emerging task that allows users to create 3D content with infinite possibilities. Existing works tackle the problem by optimizing a 3D representation with guidance from pre-trained diffusion models. An apparent drawback is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yiji Cheng , Fei Yin , Xiaoke Huang , Xintong Yu , Jiaxiang Liu , Shikun Feng , Yujiu Yang , Yansong Tang

Text-to-3D modelling has seen exciting progress by combining generative text-to-image models with image-to-3D methods like Neural Radiance Fields. DreamFusion recently achieved high-quality results but requires a lengthy, per-prompt…

Text-guided image generation has advanced rapidly with large-scale diffusion models, yet achieving precise stylization with visual exemplars remains difficult. Existing approaches often depend on task-specific retraining or expensive…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Yingying Deng , Xiangyu He , Fan Tang , Weiming Dong , Xucheng Yin

Prompt tuning, like CoOp, has recently shown promising vision recognizing and transfer learning ability on various downstream tasks with the emergence of large pre-trained vision-language models like CLIP. However, we identify that existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yongzhu Miao , Shasha Li , Jintao Tang , Ting Wang

Large generative diffusion models have revolutionized text-to-image generation and offer immense potential for conditional generation tasks such as image enhancement, restoration, editing, and compositing. However, their widespread adoption…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Kangfu Mei , Mauricio Delbracio , Hossein Talebi , Zhengzhong Tu , Vishal M. Patel , Peyman Milanfar

We present Diffusion Model Patching (DMP), a simple method to boost the performance of pre-trained diffusion models that have already reached convergence, with a negligible increase in parameters. DMP inserts a small, learnable set of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Seokil Ham , Sangmin Woo , Jin-Young Kim , Hyojun Go , Byeongjun Park , Changick Kim

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Advancements in text-to-image diffusion models have broadened extensive downstream practical applications, but such models often encounter misalignment issues between text and image. Taking the generation of a combination of two…

Artificial Intelligence · Computer Science 2024-08-06 Juntu Zhao , Junyu Deng , Yixin Ye , Chongxuan Li , Zhijie Deng , Dequan Wang

Diffusion models are generative models with impressive text-to-image synthesis capabilities and have spurred a new wave of creative methods for classical machine learning tasks. However, the best way to harness the perceptual knowledge of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Neehar Kondapaneni , Markus Marks , Manuel Knott , Rogerio Guimaraes , Pietro Perona

Single-image super-resolution (SISR) remains challenging due to the inherent difficulty of recovering fine-grained details and preserving perceptual quality from low-resolution inputs. Existing methods often rely on limited image priors,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Kangfu Mei , Hossein Talebi , Mojtaba Ardakani , Vishal M. Patel , Peyman Milanfar , Mauricio Delbracio