English
Related papers

Related papers: Accelerating Image Generation with Sub-path Linear…

200 papers

Diffusion Transformers have demonstrated remarkable performance in video generation. However, their long input sequences incur substantial latency due to the quadratic complexity of full attention. Various sparse attention mechanisms have…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Tongcheng Fang , Hanling Zhang , Ruiqi Xie , Zhuo Han , Xin Tao , Tianchen Zhao , Pengfei Wan , Wenbo Ding , Wanli Ouyang , Xuefei Ning , Yu Wang

Diffusion models have achieved remarkable success in image generation, yet their deployment remains constrained by the heavy computational cost and the need for numerous inference steps. Previous efforts on fewer-step distillation attempt…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Zhuobai Dong , Rui Zhao , Songjie Wu , Junchao Yi , Linjie Li , Zhengyuan Yang , Lijuan Wang , Alex Jinpeng Wang

Enhancing the efficiency of high-quality image generation using Diffusion Models (DMs) is a significant challenge due to the iterative nature of the process. Flow Matching (FM) is emerging as a powerful generative modeling paradigm based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Pascal Zwick , Nils Friederich , Maximilian Beichter , Lennart Hilbert , Ralf Mikut , Oliver Bringmann

Diffusion models have achieved remarkable success in generative tasks but suffer from high computational costs due to their iterative sampling process and quadratic attention costs. Existing training-free acceleration strategies that reduce…

Machine Learning · Computer Science 2025-07-24 Ting Jiang , Yixiao Wang , Hancheng Ye , Zishan Shao , Jingwei Sun , Jingyang Zhang , Zekai Chen , Jianyi Zhang , Yiran Chen , Hai Li

Diffusion-based generative models have demonstrated their powerful performance across various tasks, but this comes at a cost of the slow sampling speed. To achieve both efficient and high-quality synthesis, various distillation-based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Zhenyu Zhou , Defang Chen , Can Wang , Chun Chen , Siwei Lyu

While burst Low-Resolution (LR) images are useful for improving their Super Resolution (SR) image compared to a single LR image, prior burst SR methods are trained in a deterministic manner, which produces a blurry SR image. Since such…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Kento Kawai , Takeru Oba , Kyotaro Tokoro , Kazutoshi Akita , Norimichi Ukita

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. However, a fundamental limitation is that their inference is very slow due to a need for many (e.g., 2000) iterations of sequential…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Hengyuan Ma , Li Zhang , Xiatian Zhu , Jianfeng Feng

Denoising Diffusion Probabilistic Models (DDPMs) can generate high-quality samples such as image and audio samples. However, DDPMs require hundreds to thousands of iterations to produce final samples. Several prior works have successfully…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Luping Liu , Yi Ren , Zhijie Lin , Zhou Zhao

Simultaneous Localization and Mapping (SLAM) has wide robotic applications such as autonomous driving and unmanned aerial vehicles. Both computational efficiency and localization accuracy are of great importance towards a good SLAM system.…

Robotics · Computer Science 2022-01-10 Han Wang , Chen Wang , Chun-Lin Chen , Lihua Xie

Latent Diffusion Models (LDMs) are generally trained at fixed resolutions, limiting their capability when scaling up to high-resolution images. While training-based approaches address this limitation by training on high-resolution datasets,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Sangmin Han , Jinho Jeong , Jinwoo Kim , Seon Joo Kim

Diffusion Models have emerged as a leading class of generative models, yet their iterative sampling process remains computationally expensive. Timestep distillation is a promising technique to accelerate generation, but it often requires…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Guanjie Chen , Shirui Huang , Kai Liu , Jianchen Zhu , Xiaoye Qu , Peng Chen , Yu Cheng , Yifu Sun

Diffusion models have become a leading method for generative modeling of both image and scientific data. As these models are costly to train and \emph{evaluate}, reducing the inference cost for diffusion models remains a major goal.…

Machine Learning · Computer Science 2025-12-01 Haoxuan Chen , Yinuo Ren , Lexing Ying , Grant M. Rotskoff

Diffusion models have achieved remarkable success in image generation but their practical application is often hindered by the slow sampling speed. Prior efforts of improving efficiency primarily focus on compressing models or reducing the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Jiuyi Xu , Qing Jin , Meida Chen , Andrew Feng , Yang Sui , Yangming Shi

Diffusion models have recently shown great promise for generative modeling, outperforming GANs on perceptual quality and autoregressive models at density estimation. A remaining downside is their slow sampling time: generating high quality…

Machine Learning · Computer Science 2022-06-08 Tim Salimans , Jonathan Ho

Diffusion-based or flow-based models have achieved significant progress in video synthesis but require multiple iterative sampling steps, which incurs substantial computational overhead. While many distillation methods that are solely based…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yanxiao Sun , Jiafu Wu , Yun Cao , Chengming Xu , Yabiao Wang , Weijian Cao , Donghao Luo , Chengjie Wang , Yanwei Fu

The class-conditional image generation based on diffusion models is renowned for generating high-quality and diverse images. However, most prior efforts focus on generating images for general categories, e.g., 1000 classes in ImageNet-1k. A…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Ziying Pan , Kun Wang , Gang Li , Feihong He , Yongxuan Lai

Diffusion models have found widespread adoption in various areas. However, their sampling process is slow because it requires hundreds to thousands of network evaluations to emulate a continuous process defined by differential equations. In…

Machine Learning · Computer Science 2023-07-25 Hongkai Zheng , Weili Nie , Arash Vahdat , Kamyar Azizzadenesheli , Anima Anandkumar

We introduce the Fixed Point Diffusion Model (FPDM), a novel approach to image generation that integrates the concept of fixed point solving into the framework of diffusion-based generative modeling. Our approach embeds an implicit fixed…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Xingjian Bai , Luke Melas-Kyriazi

Flow-matching models deliver state-of-the-art fidelity in image and video generation, but the inherent sequential denoising process renders them slower. Existing acceleration methods like distillation, trajectory truncation, and consistency…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Divya Jyoti Bajpai , Dhruv Bhardwaj , Soumya Roy , Tejas Duseja , Harsh Agarwal , Aashay Sandansing , Manjesh Kumar Hanawal

Diffusion-based image super-resolution (SR) has recently attracted significant attention by leveraging the expressive power of large pre-trained text-to-image diffusion models (DMs). A central practical challenge is resolving the trade-off…

Image and Video Processing · Electrical Eng. & Systems 2026-01-26 Maxence Noble , Gonzalo Iñaki Quintana , Benjamin Aubin , Clément Chadebec