English
Related papers

Related papers: InvarDiff: Cross-Scale Invariance Caching for Acce…

200 papers

The emergence of diffusion models has significantly advanced generative AI, improving the quality, realism, and creativity of image and video generation. Among them, Stable Diffusion (StableDiff) stands out as a key model for text-to-image…

Hardware Architecture · Computer Science 2025-07-03 Zhican Wang , Guanghui He , Hongxiang Fan

The development of video diffusion models unveils a significant challenge: the substantial computational demands. To mitigate this challenge, we note that the reverse process of diffusion exhibits an inherent entropy-reducing nature. Given…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Lingmin Ran , Mike Zheng Shou

Training-free acceleration has emerged as an advanced research area in video generation based on diffusion models. The redundancy of latents in diffusion model inference provides a natural entry point for acceleration. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Yang Xiao , Gen Li , Kaiyuan Deng , Yushu Wu , Zheng Zhan , Yanzhi Wang , Xiaolong Ma , Bo Hui

The Stable Diffusion Model (SDM) is a prevalent and effective model for text-to-image (T2I) and image-to-image (I2I) generation. Despite various attempts at sampler optimization, model distillation, and network quantification, these…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Jinchao Zhu , Yuxuan Wang , Siyuan Pan , Pengfei Wan , Di Zhang , Gao Huang

We reinterpret Visual Autoregressive (VAR) models as iterative refinement models to identify which design choices drive their quality-efficiency trade-off. Instead of treating VAR only as next-scale autoregression, we formalise it as a…

Machine Learning · Computer Science 2026-02-17 Steve Hong , Samuel Belkadi

Generative diffusion models have achieved remarkable success in producing high-quality images. However, these models typically operate in continuous intensity spaces, diffusing independently across pixels and color channels. As a result,…

Graphics · Computer Science 2025-05-20 Javier E. Santos , Agnese Marcato , Roman Colman , Nicholas Lubbers , Yen Ting Lin

Infrared imagery enables temperature-based scene understanding using passive sensors, particularly under conditions of low visibility where traditional RGB imaging fails. Yet, developing downstream vision models for infrared applications is…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Kai A. Horstmann , Maxim Clouser , Kia Khezeli

Visuomotor imitation learning policies enable robots to efficiently acquire manipulation skills from visual demonstrations. However, as scene complexity and visual distractions increase, policies that perform well in simple settings often…

Artificial Intelligence · Computer Science 2025-11-11 Yuhang Dong , Haizhou Ge , Yupei Zeng , Jiangning Zhang , Beiwen Tian , Hongrui Zhu , Yufei Jia , Ruixiang Wang , Zhucun Xue , Guyue Zhou , Longhua Ma , Guanzhong Tian

Distilled diffusion models generate images in far fewer timesteps but suffer from reduced sample diversity when generating multiple outputs from the same prompt. To understand this phenomenon, we first investigate whether distillation…

Graphics · Computer Science 2025-11-11 Rohit Gandikota , David Bau

Diffusion-based generative models (DBGMs) perturb data to a target noise distribution and reverse this process to generate samples. The choice of noising process, or inference diffusion process, affects both likelihoods and sample quality.…

Machine Learning · Computer Science 2023-03-06 Raghav Singhal , Mark Goldstein , Rajesh Ranganath

Flow Matching models achieve state-of-the-art image generation quality but incur substantial inference cost due to iterative denoising through large Transformer networks. We observe that different layer groups within a Transformer exhibit…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Guandong Li

Diffusion models have demonstrated remarkable success in generative tasks, yet their iterative denoising process results in slow inference, limiting their practicality. While existing acceleration methods exploit the well-known U-shaped…

Machine Learning · Statistics 2025-04-16 Zichao Yu , Zhen Zou , Guojiang Shao , Chengwei Zhang , Shengze Xu , Jie Huang , Feng Zhao , Xiaodong Cun , Wenyi Zhang

The Cambrian explosion of easily accessible pre-trained diffusion models suggests a demand for methods that combine multiple different pre-trained diffusion models without incurring the significant computational burden of re-training a…

Machine Learning · Computer Science 2025-03-04 Marta Skreta , Lazar Atanackovic , Avishek Joey Bose , Alexander Tong , Kirill Neklyudov

We present DiffInfinite, a hierarchical diffusion model that generates arbitrarily large histological images while preserving long-range correlation structural information. Our approach first generates synthetic segmentation masks,…

Recently, diffusion models (DMs) have made significant strides in high-quality image generation. However, the multi-step denoising process often results in considerable computational overhead, impeding deployment on resource-constrained…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Yu-Shan Tai , An-Yeu , Wu

Diffusion models are a powerful class of generative models that iteratively denoise samples to produce data. While many works have focused on the number of iterations in this sampling procedure, few have focused on the cost of each…

Machine Learning · Computer Science 2022-07-12 Troy Luhman , Eric Luhman

Diffusion Transformers (DiT) have emerged as powerful generative models for various tasks, including image, video, and speech synthesis. However, their inference process remains computationally expensive due to the repeated evaluation of…

Machine Learning · Computer Science 2025-05-23 Joseph Liu , Joshua Geddes , Ziyu Guo , Haomiao Jiang , Mahesh Kumar Nandwana

Diffusion models have gained attention for their ability to represent complex distributions and incorporate uncertainty, making them ideal for robust predictions in the presence of noisy or incomplete data. In this study, we develop and…

Machine Learning · Computer Science 2024-11-05 Yilin Zhuang , Sibo Cheng , Karthik Duraisamy

Diffusion and rectified flow (RF) models generate high-fidelity images and videos, but their iterative velocity-field evaluations are computationally expensive. Existing caching methods accelerate sampling by skipping timesteps, yet their…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xiao Liu , Kai Liu , Naiyang Guan , Hongliang Lu , Zhixin Wang , Zhikai Chen , Renjing Pei , Yulun Zhang

Cameras and LiDAR are essential sensors for autonomous vehicles. Camera-LiDAR data fusion compensate for deficiencies of stand-alone sensors but relies on precise extrinsic calibration. Many learning-based calibration methods predict…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Ni Ou , Zhuo Chen , Xinru Zhang , Junzheng Wang