English
Related papers

Related papers: ETC: training-free diffusion models acceleration w…

200 papers

Guiding unconditional diffusion models typically requires either retraining with conditional inputs or per-step gradient computations (e.g., classifier-based guidance), both of which incur substantial computational overhead. We present a…

Machine Learning · Computer Science 2026-02-13 Qingsong Wang , Mikhail Belkin , Yusu Wang

Diffusion models have achieved outstanding image generation by reversing a forward noising process to approximate true data distributions. During training, these models predict diffusion scores from noised versions of true samples in a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Dazhong Shen , Guanglu Song , Yi Zhang , Bingqi Ma , Lujundong Li , Dongzhi Jiang , Zhuofan Zong , Yu Liu

Diffusion models have become popular for policy learning in robotics due to their ability to capture high-dimensional and multimodal distributions. However, diffusion policies are stochastic and typically trained offline, limiting their…

Robotics · Computer Science 2025-05-28 Ralf Römer , Alexander von Rohr , Angela P. Schoellig

Diffusion models for continuous data gained widespread adoption owing to their high quality generation and control mechanisms. However, controllable diffusion on discrete data faces challenges given that continuous guidance methods do not…

Classifier-guided diffusion models have emerged as a powerful approach for conditional image generation, but they suffer from overconfident predictions during early denoising steps, causing the guidance gradient to vanish. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Seyed Alireza Javid , Amirhossein Bagheri , Nuria González-Prelcic

Numerous valuable efforts have been devoted to achieving arbitrary style transfer since the seminal work of Gatys et al. However, existing state-of-the-art approaches often generate insufficiently stylized results under challenging cases.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 Chunjin Song , Zhijie Wu , Yang Zhou , Minglun Gong , Hui Huang

Diffusion models exhibit excellent sample quality, but existing guidance methods often require additional model training or are limited to specific tasks. We revisit guidance in diffusion models from the perspective of variational inference…

Machine Learning · Computer Science 2025-05-27 Kushagra Pandey , Farrin Marouf Sofian , Felix Draxler , Theofanis Karaletsos , Stephan Mandt

Motion prediction is a challenging problem in autonomous driving as it demands the system to comprehend stochastic dynamics and the multi-modal nature of real-world agent interactions. Diffusion models have recently risen to prominence, and…

Robotics · Computer Science 2024-05-03 Jiahui Li , Tianle Shen , Zekai Gu , Jiawei Sun , Chengran Yuan , Yuhang Han , Shuo Sun , Marcelo H. Ang

The diffusion model has shown success in generating high-quality and diverse solutions to trajectory optimization problems. However, diffusion models with neural networks inevitably make prediction errors, which leads to constraint…

Machine Learning · Computer Science 2024-06-04 Anjian Li , Zihan Ding , Adji Bousso Dieng , Ryne Beeson

While diffusion models have achieved great success in the field of video generation, this progress is accompanied by a rapidly escalating computational burden. Among the existing acceleration methods, Feature Caching is popular due to its…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chang Zou , Changlin Li , Yang Li , Patrol Li , Jianbing Wu , Xiao He , Songtao Liu , Zhao Zhong , Kailin Huang , Linfeng Zhang

Diffusion Transformers (DiTs) achieve superior image generation quality but suffer from quadratic computational complexity relative to token count. While various token reduction (TR) methods have been proposed to mitigate this cost, they…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Hangyeol Lee , Hyojeong Lee , Joo-Young Kim

Diffusion Language Models (DLMs) have recently achieved significant success due to their any-order generation capabilities. However, existing inference methods typically rely on local, immediate-step metrics such as confidence or entropy…

Computation and Language · Computer Science 2025-12-03 Kecheng Chen , Ziru Liu , Xijia Tao , Hui Liu , Xinyu Fu , Suiyun Zhang , Dandan Tu , Lingpeng Kong , Rui Liu , Haoliang Li

Real-time video analytics systems typically deploy lightweight models on edge devices to reduce latency. However, the distribution of data features may change over time due to various factors such as changing lighting and weather…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Runchu Donga , Peng Zhao , Guiqin Wang , Nan Qi , Jie Lin

Consistency models are a new family of generative models capable of producing high-quality samples in either a single step or multiple steps. Recently, consistency models have demonstrated impressive performance, achieving results on par…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Quan Dao , Khanh Doan , Di Liu , Trung Le , Dimitris Metaxas

Recent advancements in Diffusion Transformers (DiTs) have established them as the state-of-the-art method for video generation. However, their inherently sequential denoising process results in inevitable latency, limiting real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Hanshuai Cui , Zhiqing Tang , Zhifei Xu , Zhi Yao , Wenyi Zeng , Weijia Jia

This paper presents Diffusion Forcing, a new training paradigm where a diffusion model is trained to denoise a set of tokens with independent per-token noise levels. We apply Diffusion Forcing to sequence generative modeling by training a…

Machine Learning · Computer Science 2024-12-11 Boyuan Chen , Diego Marti Monso , Yilun Du , Max Simchowitz , Russ Tedrake , Vincent Sitzmann

The ensemble of deep neural networks has been shown, both theoretically and empirically, to improve generalization accuracy on the unseen test set. However, the high training cost hinders its efficiency since we need a sufficient number of…

Machine Learning · Computer Science 2021-12-28 Wentao Zhang , Jiawei Jiang , Yingxia Shao , Bin Cui

Diffusion models and flow matching have demonstrated remarkable success in text-to-image generation. While many existing alignment methods primarily focus on fine-tuning pre-trained generative models to maximize a given reward function,…

Machine Learning · Statistics 2026-02-03 Yidong Ouyang , Liyan Xie , Hongyuan Zha , Guang Cheng

Imitation learning, e.g., diffusion policy, has been proven effective in various robotic manipulation tasks. However, extensive demonstrations are required for policy robustness and generalization. To reduce the demonstration reliance, we…

Robotics · Computer Science 2025-03-04 Chenrui Tie , Yue Chen , Ruihai Wu , Boxuan Dong , Zeyi Li , Chongkai Gao , Hao Dong

Diffusion models have emerged as a promising approach for text generation, with recent works falling into two main categories: discrete and continuous diffusion models. Discrete diffusion models apply token corruption independently using…

Computation and Language · Computer Science 2025-05-29 Bocheng Li , Zhujin Gao , Linli Xu