English
Related papers

Related papers: Beyond Single Tokens: Distilling Discrete Diffusio…

200 papers

Diffusion Models (DMs), also referred to as score-based diffusion models, utilize neural networks to specify score functions. Unlike most other probabilistic models, DMs directly model the score functions, which makes them more flexible to…

Machine Learning · Computer Science 2023-04-11 Weijian Luo

Training machine learning models on massive datasets is expensive and time-consuming. Dataset distillation addresses this by creating a small synthetic dataset that achieves the same performance as the full dataset. Recent methods use…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Jeffrey A. Chan-Santiago , Mubarak Shah

Diffusion Models have emerged as a leading class of generative models, yet their iterative sampling process remains computationally expensive. Timestep distillation is a promising technique to accelerate generation, but it often requires…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Guanjie Chen , Shirui Huang , Kai Liu , Jianchen Zhu , Xiaoye Qu , Peng Chen , Yu Cheng , Yifu Sun

This work introduces Variational Diffusion Distillation (VDD), a novel method that distills denoising diffusion policies into Mixtures of Experts (MoE) through variational inference. Diffusion Models are the current state-of-the-art in…

Machine Learning · Computer Science 2024-10-22 Hongyi Zhou , Denis Blessing , Ge Li , Onur Celik , Xiaogang Jia , Gerhard Neumann , Rudolf Lioutikov

Deep ensembles excel in large-scale image classification tasks both in terms of prediction accuracy and calibration. Despite being simple to train, the computation and memory cost of deep ensembles limits their practicability. While some…

Machine Learning · Computer Science 2021-10-28 Giung Nam , Jongmin Yoon , Yoonho Lee , Juho Lee

In this paper, we present the Directly Denoising Diffusion Model (DDDM): a simple and generic approach for generating realistic images with few-step sampling, while multistep sampling is still preserved for better performance. DDDMs require…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Dan Zhang , Jingjing Wang , Feng Luo

Training diffusion models on limited datasets poses challenges in terms of limited generation capacity and expressiveness, leading to unsatisfactory results in various downstream tasks utilizing pretrained diffusion models, such as domain…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Jiwan Hur , Jaehyun Choi , Gyojin Han , Dong-Jae Lee , Junmo Kim

Diffusion Models (DMs) have achieved great success in image generation and other fields. By fine sampling through the trajectory defined by the SDE/ODE solver based on a well-trained score model, DMs can generate remarkable high-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Bowen Zheng , Tianming Yang

Denoising Diffusion Models (DDMs) have become a popular tool for generating high-quality samples from complex data distributions. These models are able to capture sophisticated patterns and structures in the data, and can generate samples…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Emanuele Aiello , Diego Valsesia , Enrico Magli

Model distillation aims to distill the knowledge of a complex model into a simpler one. In this paper, we consider an alternative formulation called dataset distillation: we keep the model fixed and instead attempt to distill the knowledge…

Machine Learning · Computer Science 2020-02-26 Tongzhou Wang , Jun-Yan Zhu , Antonio Torralba , Alexei A. Efros

Diffusion models have recently shown great promise for generative modeling, outperforming GANs on perceptual quality and autoregressive models at density estimation. A remaining downside is their slow sampling time: generating high quality…

Machine Learning · Computer Science 2022-06-08 Tim Salimans , Jonathan Ho

Masked Diffusion Models (MDMs) have emerged as a powerful generative modeling technique. Despite their remarkable results, they typically suffer from slow inference with several steps. In this paper, we propose Di$\mathtt{[M]}$O, a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yuanzhi Zhu , Xi Wang , Stéphane Lathuilière , Vicky Kalogeiton

Discrete diffusion models have emerged as powerful tools for high-quality data generation. Despite their success in discrete spaces, such as text generation tasks, the acceleration of discrete diffusion models remains under-explored. In…

Machine Learning · Computer Science 2024-12-09 Zixiang Chen , Huizhuo Yuan , Yongqian Li , Yiwen Kou , Junkai Zhang , Quanquan Gu

Dataset distillation compresses large training sets into compact synthetic datasets while preserving downstream performance. As modern systems increasingly operate on paired vision-language inputs, multimodal distillation must preserve…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Jongoh Jeong , Hoyong Kwon , Minseok Kim , Kuk-Jin Yoon

Diffusion models have achieved remarkable success in generating high-resolution, realistic images across diverse natural distributions. However, their performance heavily relies on high-quality training data, making it challenging to learn…

Machine Learning · Computer Science 2025-05-22 Tianyu Chen , Yasi Zhang , Zhendong Wang , Ying Nian Wu , Oscar Leong , Mingyuan Zhou

Conditional diffusion models have demonstrated impressive performance in image manipulation tasks. The general pipeline involves adding noise to the image and then denoising it. However, this method faces a trade-off problem: adding too…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Luozhou Wang , Shuai Yang , Shu Liu , Ying-cong Chen

Dataset distillation enables efficient training by distilling the information of large-scale datasets into significantly smaller synthetic datasets. Diffusion based paradigms have emerged in recent years, offering novel perspectives for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Qichao Wang , Yunhong Lu , Hengyuan Cao , Junyi Zhang , Min Zhang

The success of text-to-image (T2I) generation models has spurred a proliferation of numerous model checkpoints fine-tuned from the same base model on various specialized datasets. This overwhelming specialized model production introduces…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Tianhui Song , Weixin Feng , Shuai Wang , Xubin Li , Tiezheng Ge , Bo Zheng , Limin Wang

Generative models, particularly diffusion models, have made significant success in data synthesis across various modalities, including images, videos, and 3D assets. However, current diffusion models are computationally intensive, often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Yuanzhi Zhu , Hanshu Yan , Huan Yang , Kai Zhang , Junnan Li

Diffusion models achieve high-quality image generation but are limited by slow iterative sampling. Distillation methods alleviate this by enabling one- or few-step generation. Flow matching, originally introduced as a distinct framework,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Mingyuan Zhou , Yi Gu , Huangjie Zheng , Liangchen Song , Guande He , Yizhe Zhang , Wenze Hu , Yinfei Yang