English
Related papers

Related papers: One-Step Offline Distillation of Diffusion-based M…

200 papers

By decomposing the image formation process into a sequential application of denoising autoencoders, diffusion models (DMs) achieve state-of-the-art synthesis results on image data and beyond. Additionally, their formulation allows for a…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Robin Rombach , Andreas Blattmann , Dominik Lorenz , Patrick Esser , Björn Ommer

Image tokenization plays a central role in modern generative modeling by mapping visual inputs into compact representations that serve as an intermediate signal between pixels and generative models. Diffusion-based decoders have recently…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Chuhan Wang , Hao Chen

Distribution Matching Distillation (DMD) facilitates efficient inference by distilling multi-step diffusion models into few-step variants. Concurrently, Reinforcement Learning (RL) has emerged as a vital tool for aligning generative models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Dengyang Jiang , Dongyang Liu , Zanyi Wang , Qilong Wu , Liuzhuozheng Li , Hengzhuang Li , Xin Jin , David Liu , Changsheng Lu , Zhen Li , Bo Zhang , Mengmeng Wang , Steven Hoi , Peng Gao , Harry Yang

Diffusion models have shown strong performance in speech enhancement, but their real-time applicability has been limited by multi-step iterative sampling. Consistency distillation has recently emerged as a promising alternative by…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-19 Liang Xu , Longfei Felix Yan , W. Bastiaan Kleijn

Diffusion Language Models (DLMs) have recently emerged as a promising alternative to autoregressive language models, offering stronger global awareness and highly parallel generation. However, post-training DLMs with standard Negative…

Computation and Language · Computer Science 2026-05-19 Kecheng Chen , Ziru Liu , Xijia Tao , Hui Liu , Yibing Liu , Xinyu Fu , Shi Wu , Suiyun Zhang , Dandan Tu , Lingpeng Kong , Rui Liu , Haoliang Li

Sampling from pretrained diffusion and flow-matching models typically requires many forward passes to generate diverse and high-fidelity images. Existing distillation methods often rely on multiple auxiliary networks, carefully designed…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Yuan Zhang , Chenyi Li , Guoqing Ma , Jiajun Zha , Yuanming Yang , Bo Wang , Wei Tang , Wenbo Li , Haoyang Huang , Nan Duan

Recent advances in diffusion-based robot policies have demonstrated significant potential in imitating multi-modal behaviors. However, these approaches typically require large quantities of demonstration data paired with corresponding robot…

Robotics · Computer Science 2025-03-26 Jianxin Bi , Kelvin Lim , Kaiqi Chen , Yifei Huang , Harold Soh

Denoising diffusion probabilistic models (DDPMs) (Ho et al. 2020) have shown impressive results on image and waveform generation in continuous state spaces. Here, we introduce Discrete Denoising Diffusion Probabilistic Models (D3PMs),…

Machine Learning · Computer Science 2023-02-23 Jacob Austin , Daniel D. Johnson , Jonathan Ho , Daniel Tarlow , Rianne van den Berg

Reinforcement learning has emerged as a powerful tool for improving diffusion-based text-to-image models, but existing methods are largely limited to single-task optimization. Extending RL to multiple tasks is challenging: joint…

Machine Learning · Computer Science 2026-05-15 Quanhao Li , Junqiu Yu , Kaixun Jiang , Yujie Wei , Zhen Xing , Pandeng Li , Ruihang Chu , Shiwei Zhang , Yu Liu , Zuxuan Wu

Recently, a series of diffusion-aware distillation algorithms have emerged to alleviate the computational overhead associated with the multi-step inference process of Diffusion Models (DMs). Current distillation techniques often dichotomize…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Yuxi Ren , Xin Xia , Yanzuo Lu , Jiacheng Zhang , Jie Wu , Pan Xie , Xing Wang , Xuefeng Xiao

Diffusion model-based approaches recently achieved re-markable success in MRI reconstruction, but integration into clinical routine remains challenging due to its time-consuming convergence. This phenomenon is partic-ularly notable when…

Image and Video Processing · Electrical Eng. & Systems 2024-11-07 Yu Guan , Qinrong Cai , Wei Li , Qiuyun Fan , Dong Liang , Qiegen Liu

Masked discrete diffusion is a dominant paradigm for high-quality language modeling where tokens are iteratively corrupted to a mask state, yet its inference efficiency is bottlenecked by the lack of deterministic sampling tools. While…

Machine Learning · Computer Science 2026-02-03 Guinan Chen , Xunpeng Huang , Ying Sun , Shijin Wang , Yanyong Zhang , Chao Wang

Diffusion models have achieved remarkable success in generating high-resolution, realistic images across diverse natural distributions. However, their performance heavily relies on high-quality training data, making it challenging to learn…

Machine Learning · Computer Science 2025-05-22 Tianyu Chen , Yasi Zhang , Zhendong Wang , Ying Nian Wu , Oscar Leong , Mingyuan Zhou

Sampling from unnormalized target distributions is a fundamental yet challenging task in machine learning and statistics. Existing sampling algorithms typically require many iterative steps to produce high-quality samples, leading to high…

Machine Learning · Statistics 2026-02-27 Pascal Jutras-Dube , Jiaru Zhang , Ziran Wang , Ruqi Zhang

Diffusion models (DMs) excel in photo-realistic image synthesis, but their adaptation to LiDAR scene generation poses a substantial hurdle. This is primarily because DMs operating in the point space struggle to preserve the curve-like…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Haoxi Ran , Vitor Guizilini , Yue Wang

The Stable Diffusion Model (SDM) is a prevalent and effective model for text-to-image (T2I) and image-to-image (I2I) generation. Despite various attempts at sampler optimization, model distillation, and network quantification, these…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jinchao Zhu , Yuxuan Wang , Siyuan Pan , Pengfei Wan , Di Zhang , Gao Huang

In this paper, we provide an algorithm for online computation of Koopman operator in real-time using streaming data. In recent years, there has been an increased interest in data-driven analysis of dynamical systems, with operator theoretic…

Systems and Control · Electrical Eng. & Systems 2019-09-30 Subhrajit Sinha , Sai Pushpak Nandanoori , Enoch Yeung

A Koopman decomposition is a powerful method of analysis for fluid flows leading to an apparently linear description of nonlinear dynamics in which the flow is expressed as a superposition of fixed spatial structures with exponential time…

Fluid Dynamics · Physics 2019-09-25 Jacob Page , Rich R. Kerswell

Diffusion-based text-to-image generation models trained on extensive text-image pairs have demonstrated the ability to produce photorealistic images aligned with textual descriptions. However, a significant limitation of these models is…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Mingyuan Zhou , Zhendong Wang , Huangjie Zheng , Hai Huang

Diffusion-based generative models have achieved remarkable performance across various domains, yet their practical deployment is often limited by high sampling costs. While prior work focuses on training objectives or individual solvers,…

Machine Learning · Computer Science 2026-02-16 Sangwoo Jo , Sungjoon Choi