English
Related papers

Related papers: Presto! Distilling Steps and Layers for Accelerati…

200 papers

Score Distillation Sampling (SDS) has emerged as a prevalent technique for text-to-3D generation, enabling 3D content creation by distilling view-dependent information from text-to-2D guidance. However, they frequently exhibit shortcomings…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Zeyu Cai , Duotun Wang , Yixun Liang , Zhijing Shao , Ying-Cong Chen , Xiaohang Zhan , Zeyu Wang

By leveraging the text-to-image diffusion priors, score distillation can synthesize 3D contents without paired text-3D training data. Instead of spending hours of online optimization per text prompt, recent studies have been focused on…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Zhiyuan Ma , Yuxiang Wei , Yabin Zhang , Xiangyu Zhu , Zhen Lei , Lei Zhang

Diffusion Language Models (DLMs) have recently achieved strong results in text generation. However, their multi-step sampling leads to slow inference, limiting practical use. To address this, we extend Inverse Distillation, a technique…

Machine Learning · Computer Science 2026-02-24 David Li , Nikita Gushchin , Dmitry Abulkhanov , Eric Moulines , Ivan Oseledets , Maxim Panov , Alexander Korotin

Diffusion models have emerged as a powerful tool for point cloud generation. A key component that drives the impressive performance for generating high-quality samples from noise is iteratively denoise for thousands of steps. While…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Lemeng Wu , Dilin Wang , Chengyue Gong , Xingchao Liu , Yunyang Xiong , Rakesh Ranjan , Raghuraman Krishnamoorthi , Vikas Chandra , Qiang Liu

Recent advancements in latent diffusion models (LDMs) have markedly enhanced text-to-audio generation, yet their iterative sampling processes impose substantial computational demands, limiting practical deployment. While recent methods…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-04 Huadai Liu , Jialei Wang , Rongjie Huang , Yang Liu , Heng Lu , Zhou Zhao , Wei Xue

Efficient text-to-image generation remains a challenging task due to the high computational costs associated with the multi-step sampling in diffusion models. Although distillation of pre-trained diffusion models has been successful in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jeeyung Kim , Ze Wang , Qiang Qiu

Diffusion- and flow-based generative models have recently demonstrated strong performance in protein backbone generation tasks, offering unprecedented capabilities for de novo protein design. However, while achieving notable performance in…

Machine Learning · Computer Science 2025-10-29 Liyang Xie , Haoran Zhang , Zhendong Wang , Wesley Tansey , Mingyuan Zhou

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. However, a fundamental limitation is that their sampling process is slow due to a need for many (e.g., 2000) iterations of sequential…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Hengyuan Ma , Xiatian Zhu , Jianfeng Feng , Li Zhang

The extensive amounts of data required for training deep neural networks pose significant challenges on storage and transmission fronts. Dataset distillation has emerged as a promising technique to condense the information of massive…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Ali Abbasi , Ashkan Shahbazi , Hamed Pirsiavash , Soheil Kolouri

Diffusion models (DMs) have achieved state-of-the-art generative performance but suffer from high sampling latency due to their sequential denoising nature. Existing solver-based acceleration methods often face image quality degradation…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Beier Zhu , Ruoyu Wang , Tong Zhao , Hanwang Zhang , Chi Zhang

Diffusion models deliver high-fidelity generation but remain slow at inference time due to many sequential network evaluations. We find that standard timestep conditioning becomes a key bottleneck for few-step sampling. Motivated by…

Machine Learning · Computer Science 2026-03-25 Yuren Cai , Guangyi Wang , Zongqing Li , Li Li , Zhihui Liu , Songzhi Su

Generating high-quality 3D assets from textual descriptions remains a pivotal challenge in computer graphics and vision research. Due to the scarcity of 3D data, state-of-the-art approaches utilize pre-trained 2D diffusion priors, optimized…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Ling Yang , Zixiang Zhang , Junlin Han , Bohan Zeng , Runjia Li , Philip Torr , Wentao Zhang

Recently, open-source video diffusion models (VDMs), such as WanX, Magic141 and HunyuanVideo, have been scaled to over 10 billion parameters. These large-scale VDMs have demonstrated significant improvements over smaller-scale VDMs across…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Shitong Shao , Hongwei Yi , Hanzhong Guo , Tian Ye , Daquan Zhou , Michael Lingelbach , Zhiqiang Xu , Zeke Xie

Diffusion Transformers (DiTs) with billions of model parameters form the backbone of popular image and video generation models like DALL.E, Stable-Diffusion and SORA. Though these models are necessary in many low-latency applications like…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Vignesh Sundaresha

Diffusion models have demonstrated exceptional capabilities in generating high-fidelity images but typically suffer from inefficient sampling. Many solver designs and noise scheduling strategies have been proposed to dramatically improve…

Machine Learning · Statistics 2025-10-01 Tianrong Chen , Huangjie Zheng , David Berthelot , Jiatao Gu , Josh Susskind , Shuangfei Zhai

Latent Diffusion models (LDMs) have achieved remarkable results in synthesizing high-resolution images. However, the iterative sampling process is computationally intensive and leads to slow generation. Inspired by Consistency Models (song…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Simian Luo , Yiqin Tan , Longbo Huang , Jian Li , Hang Zhao

While generative diffusion models excel in producing high-quality images, they can also be misused to mimic authorized images, posing a significant threat to AI systems. Efforts have been made to add calibrated perturbations to protect…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Haotian Xue , Chumeng Liang , Xiaoyu Wu , Yongxin Chen

Score distillation of 2D diffusion models has proven to be a powerful mechanism to guide 3D optimization, for example enabling text-based 3D generation or single-view reconstruction. A common limitation of existing score distillation…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Yanbo Xu , Jayanth Srinivasa , Gaowen Liu , Shubham Tulsiani

Modeling physical systems in a generative manner offers several advantages, including the ability to handle partial observations, generate diverse solutions, and address both forward and inverse problems. Recently, diffusion models have…

Machine Learning · Computer Science 2025-05-29 Yi Zhang , Difan Zou

Diffusion models (DMs) have been adopted across diverse fields with its remarkable abilities in capturing intricate data distributions. In this paper, we propose a Fast Diffusion Model (FDM) to significantly speed up DMs from a stochastic…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Zike Wu , Pan Zhou , Kenji Kawaguchi , Hanwang Zhang