English
Related papers

Related papers: Inference-Time Diffusion Model Distillation

200 papers

In this paper, we propose difficulty-guided sampling (DGS) to bridge the target gap between the distillation objective and the downstream task, therefore improving the performance of dataset distillation. Deep neural networks achieve…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Mingzhuo Li , Guang Li , Linfeng Ye , Jiafeng Mao , Takahiro Ogawa , Konstantinos N. Plataniotis , Miki Haseyama

Knowledge distillation is the procedure of transferring "knowledge" from a large model (the teacher) to a more compact one (the student), often being used in the context of model compression. When both models have the same architecture,…

Machine Learning · Computer Science 2022-06-20 Minh Pham , Minsu Cho , Ameya Joshi , Chinmay Hegde

Recent diffusion distillation methods have achieved remarkable progress, enabling high-quality ${\sim}4$-step sampling for large-scale text-conditional image and video diffusion models. However, further reducing the number of sampling steps…

Computer Vision and Pattern Recognition · Computer Science 2026-03-04 Nikita Starodubcev , Ilya Drobyshevskiy , Denis Kuznedelev , Artem Babenko , Dmitry Baranchuk

Knowledge distillation has emerged as an effective strategy for compressing large language models' (LLMs) knowledge into smaller, more efficient student models. However, standard one-shot distillation methods often produce suboptimal…

Computation and Language · Computer Science 2025-04-04 Kushal Jain , Piyushi Goyal , Kumar Shridhar

One of the main drawback of diffusion models is the slow inference time for image generation. Among the most successful approaches to addressing this problem are distillation methods. However, these methods require considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Senmao Li , Taihang Hu , Joost van de Weijer , Fahad Shahbaz Khan , Tao Liu , Linxuan Li , Shiqi Yang , Yaxing Wang , Ming-Ming Cheng , Jian Yang

Distilling state-of-the-art transformer models into lightweight student models is an effective way to reduce computation cost at inference time. The student models are typically compact transformers with fewer parameters, while expensive…

Computation and Language · Computer Science 2022-07-26 Qinyuan Ye , Madian Khabsa , Mike Lewis , Sinong Wang , Xiang Ren , Aaron Jaech

Sampling from diffusion models involves a slow iterative process that hinders their practical deployment, especially for interactive applications. To accelerate generation speed, recent approaches distill a multi-step diffusion model into a…

Machine Learning · Computer Science 2025-03-11 Yilun Xu , Weili Nie , Arash Vahdat

Flow-matching models have enabled high-quality text-to-speech synthesis, but their iterative sampling process during inference incurs substantial computational cost. Although distillation is widely used to reduce the number of inference…

Sound · Computer Science 2026-02-11 Bin Lin , Peng Yang , Chao Yan , Xiaochen Liu , Wei Wang , Boyong Wu , Pengfei Tan , Xuerui Yang

Few-shot learning deals with problems such as image classification using very few training examples. Recent vision foundation models show excellent few-shot transfer abilities, but are large and slow at inference. Using knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Erik Landolsi , Fredrik Kahl

Scaling neural networks to "large" sizes, with billions of parameters, has been shown to yield impressive results on many challenging problems. However, the inference cost incurred by such large models often prevents their application in…

Machine Learning · Computer Science 2021-10-22 Ankit Singh Rawat , Manzil Zaheer , Aditya Krishna Menon , Amr Ahmed , Sanjiv Kumar

Diffusion models achieve state-of-the-art generative performance but are fundamentally bottlenecked by their slow, iterative sampling process. While diffusion distillation techniques enable high-fidelity, few-step generation, traditional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Linqian Fan , Peiqin Sun , Tiancheng Wen , Shun Lu , Chengru Song

Diffusion models with transformer architectures have demonstrated promising capabilities in generating high-fidelity images and scalability for high resolution. However, iterative sampling process required for synthesis is very…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Yeongmin Kim , Sotiris Anagnostidis , Yuming Du , Edgar Schönfeld , Jonas Kohler , Markos Georgopoulos , Albert Pumarola , Ali Thabet , Artsiom Sanakoyeu

Learning based on multimodal data has attracted increasing interest recently. While a variety of sensory modalities can be collected for training, not all of them are always available in development scenarios, which raises the challenge to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Shicai Wei , Yang Luo , Chunbo Luo

Adapter-Tuning (AT) method involves freezing a pre-trained model and introducing trainable adapter modules to acquire downstream knowledge, thereby calibrating the model for better adaptation to downstream tasks. This paper proposes a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Jiacheng Ruan , Jingsheng Gao , Mingye Xie , Daize Dong , Suncheng Xiang , Ting Liu , Yuzhuo Fu

Knowledge distillation, which involves extracting the "dark knowledge" from a teacher network to guide the learning of a student network, has emerged as an important technique for model compression and transfer learning. Unlike previous…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Guodong Xu , Ziwei Liu , Xiaoxiao Li , Chen Change Loy

Sampling from unnormalized target distributions is a fundamental yet challenging task in machine learning and statistics. Existing sampling algorithms typically require many iterative steps to produce high-quality samples, leading to high…

Machine Learning · Computer Science 2025-02-17 Pascal Jutras-Dubé , Patrick Pynadath , Ruqi Zhang

Knowledge distillation is a technique for improving the performance of a simple "student" model by replacing its one-hot training labels with a distribution over labels obtained from a complex "teacher" model. While this simple approach has…

Machine Learning · Computer Science 2020-05-22 Aditya Krishna Menon , Ankit Singh Rawat , Sashank J. Reddi , Seungyeon Kim , Sanjiv Kumar

While deep learning techniques have proven successful in image-related tasks, the exponentially increased data storage and computation costs become a significant challenge. Dataset distillation addresses these challenges by synthesizing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Zhe Li , Weitong Zhang , Sarah Cechnicka , Bernhard Kainz

Abstract Diffusion models have recently gained prominence as a novel category of generative models. Despite their success, these models face a notable drawback in terms of slow sampling speeds, requiring a high number of function…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Sanghwan Kim , Hao Tang , Fisher Yu

Video style transfer techniques inspire many exciting applications on mobile devices. However, their efficiency and stability are still far from satisfactory. To boost the transfer stability across frames, optical flow is widely adopted,…

Computer Vision and Pattern Recognition · Computer Science 2021-07-09 Xinghao Chen , Yiman Zhang , Yunhe Wang , Han Shu , Chunjing Xu , Chang Xu