English
Related papers

Related papers: Rectified Diffusion Guidance for Conditional Gener…

200 papers

Discrete diffusion models (DDMs) are a powerful class of generative models for categorical data, but they typically require many function evaluations for a single sample, making inference expensive. Existing acceleration methods either rely…

Machine Learning · Computer Science 2025-12-16 Yansong Gao , Yu Sun

As Diffusion Models have shown promising performance, a lot of efforts have been made to improve the controllability of Diffusion Models. However, how to train Diffusion Models to have the disentangled latent spaces and how to naturally…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Wonwoong Cho , Hareesh Ravi , Midhun Harikumar , Vinh Khuc , Krishna Kumar Singh , Jingwan Lu , David I. Inouye , Ajinkya Kale

In recent years, multimodal recommendation has received significant attention and achieved remarkable success in GCN-based recommendation methods. However, there are two key challenges here: (1) There is a significant amount of redundant…

Information Retrieval · Computer Science 2026-04-07 Xiangchen Pan , Wei Wei

Multi-modality image fusion aims to combine different modalities to produce fused images that retain the complementary features of each modality, such as functional highlights and texture details. To leverage strong generative priors and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Zixiang Zhao , Haowen Bai , Yuanzhi Zhu , Jiangshe Zhang , Shuang Xu , Yulun Zhang , Kai Zhang , Deyu Meng , Radu Timofte , Luc Van Gool

Imperfect score-matching leads to a shift between the training and the sampling distribution of diffusion models. Due to the recursive nature of the generation process, errors in previous steps yield sampling iterates that drift away from…

Machine Learning · Computer Science 2023-02-20 Giannis Daras , Yuval Dagan , Alexandros G. Dimakis , Constantinos Daskalakis

Diffusion models for continuous data gained widespread adoption owing to their high quality generation and control mechanisms. However, controllable diffusion on discrete data faces challenges given that continuous guidance methods do not…

Diffusion models have become a new generative paradigm for text generation. Considering the discrete categorical nature of text, in this paper, we propose GlyphDiffusion, a novel diffusion approach for text generation via text-guided image…

Computation and Language · Computer Science 2023-05-09 Junyi Li , Wayne Xin Zhao , Jian-Yun Nie , Ji-Rong Wen

Current text recognition systems, including those for handwritten scripts and scene text, have relied heavily on image synthesis and augmentation, since it is difficult to realize real-world complexity and diversity through collecting and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Yuanzhi Zhu , Zhaohai Li , Tianwei Wang , Mengchao He , Cong Yao

Discrete Diffusion and Flow Matching models have significantly advanced generative modeling for discrete structures, including graphs. However, the dependencies between intermediate noisy states lead to error accumulation and propagation…

Machine Learning · Computer Science 2025-06-24 Yoann Boget

Diffusion Probabilistic Models (DPMs) have recently shown remarkable performance in image generation tasks, which are capable of generating highly realistic images. When adopting DPMs for image restoration tasks, the crucial aspect lies in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Yi Zhang , Xiaoyu Shi , Dasong Li , Xiaogang Wang , Jian Wang , Hongsheng Li

Layout generation aims to synthesize realistic graphic scenes consisting of elements with different attributes including category, size, position, and between-element relation. It is a crucial task for reducing the burden on heavy-duty…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Mude Hui , Zhizheng Zhang , Xiaoyi Zhang , Wenxuan Xie , Yuwang Wang , Yan Lu

Diffusion models have greatly improved visual generation but are hindered by slow generation speed due to the computationally intensive nature of solving generative ODEs. Rectified flow, a widely recognized solution, improves generation…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Fu-Yun Wang , Ling Yang , Zhaoyang Huang , Mengdi Wang , Hongsheng Li

Diffusion models excel in generating high-quality images. However, current diffusion models struggle to produce reliable images without guidance methods, such as classifier-free guidance (CFG). Are guidance methods truly necessary?…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Donghoon Ahn , Jiwon Kang , Sanghyun Lee , Jaewon Min , Minjae Kim , Wooseok Jang , Hyoungwon Cho , Sayak Paul , SeonHwa Kim , Eunju Cha , Kyong Hwan Jin , Seungryong Kim

Recent advancements in diffusion models have revolutionized generative modeling. However, the impressive and vivid outputs they produce often come at the cost of significant model scaling and increased computational demands. Consequently,…

Machine Learning · Computer Science 2025-04-03 Jincheng Zhong , Xiangcheng Zhang , Jianmin Wang , Mingsheng Long

Continuous Conditional Generative Modeling (CCGM) estimates high-dimensional data distributions, such as images, conditioned on scalar continuous variables (aka regression labels). While Continuous Conditional Generative Adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Xin Ding , Yongwei Wang , Kao Zhang , Z. Jane Wang

Generative models have the potential to accelerate key steps in the discovery of novel molecular therapeutics and materials. Diffusion models have recently emerged as a powerful approach, excelling at unconditional sample generation and,…

Biomolecules · Quantitative Biology 2024-07-17 Leo Klarner , Tim G. J. Rudner , Garrett M. Morris , Charlotte M. Deane , Yee Whye Teh

Text-to-image diffusion models have achieved remarkable performance in image synthesis, while the text interface does not always provide fine-grained control over certain image factors. For instance, changing a single token in the text can…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Chen Wu , Fernando De la Torre

While neural lossy compression techniques have markedly advanced the efficiency of Channel State Information (CSI) compression and reconstruction for feedback in MIMO communications, efficient algorithms for more challenging and practical…

Diffusion model distillation has emerged as a powerful technique for creating efficient few-step and single-step generators. Among these, Distribution Matching Distillation (DMD) and its variants stand out for their impressive performance,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Dongyang Liu , Peng Gao , David Liu , Ruoyi Du , Zhen Li , Qilong Wu , Xin Jin , Sihan Cao , Shifeng Zhang , Hongsheng Li , Steven Hoi

Diffusion models have achieved state-of-the-art performance in generative modeling tasks across various domains. Prior works on time series diffusion models have primarily focused on developing conditional models tailored to specific…

Machine Learning · Computer Science 2023-11-23 Marcel Kollovieh , Abdul Fatir Ansari , Michael Bohlke-Schneider , Jasper Zschiegner , Hao Wang , Yuyang Wang