English
Related papers

Related papers: Tuning Timestep-Distilled Diffusion Model Using Pa…

200 papers

Model merging offers an effective way to integrate the capabilities of multiple fine-tuned models. However, the performance degradation of the merged model remains a challenge, particularly when none or few data are available. This paper…

Machine Learning · Computer Science 2025-05-28 Jing Xu , Jiazheng Li , Jingzhao Zhang

We present an inference-time diffusion sampling method to perform multi-view consistent image editing using pre-trained 2D image editing models. These models can independently produce high-quality edits for each image in a set of multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Hadi Alzayer , Yunzhi Zhang , Chen Geng , Jia-Bin Huang , Jiajun Wu

Sampling from unnormalized target distributions is a fundamental yet challenging task in machine learning and statistics. Existing sampling algorithms typically require many iterative steps to produce high-quality samples, leading to high…

Machine Learning · Statistics 2026-02-27 Pascal Jutras-Dube , Jiaru Zhang , Ziran Wang , Ruqi Zhang

Diffusion models achieve high-quality sample generation at the cost of a lengthy multistep inference procedure. To overcome this, diffusion distillation techniques produce student generators capable of matching or surpassing the teacher in…

Machine Learning · Computer Science 2024-12-04 Yanke Song , Jonathan Lorraine , Weili Nie , Karsten Kreis , James Lucas

Diffusion models have made substantial advances in image generation, yet models trained on large, unfiltered datasets often yield outputs misaligned with human preferences. Numerous methods have been proposed to fine-tune pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Fu-Yun Wang , Yunhao Shui , Jingtan Piao , Keqiang Sun , Hongsheng Li

Distillation addresses the slow sampling problem in diffusion models by creating models with smaller size or fewer steps that approximate the behavior of high-step teachers. In this work, we propose a reinforcement learning based…

Machine Learning · Computer Science 2025-12-30 Amirhossein Tighkhorshid , Zahra Dehghanian , Gholamali Aminian , Chengchun Shi , Hamid R. Rabiee

While super-resolution (SR) methods based on diffusion models exhibit promising results, their practical application is hindered by the substantial number of required inference steps. Recent methods utilize degraded images in the initial…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Yufei Wang , Wenhan Yang , Xinyuan Chen , Yaohui Wang , Lanqing Guo , Lap-Pui Chau , Ziwei Liu , Yu Qiao , Alex C. Kot , Bihan Wen

Diffusion models for super-resolution (SR) produce high-quality visual results but require expensive computational costs. Despite the development of several methods to accelerate diffusion-based SR models, some (e.g., SinSR) fail to produce…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Daniil Selikhanovych , David Li , Aleksei Leonov , Nikita Gushchin , Sergei Kushneriuk , Alexander Filippov , Evgeny Burnaev , Iaroslav Koshelev , Alexander Korotin

The high cost and accessibility problem associated with large datasets hinder the development of large-scale visual recognition systems. Dataset Distillation addresses these problems by synthesizing compact surrogate datasets for efficient…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Tongfei Liu , Yufan Liu , Bing Li , Weiming Hu

Diffusion models have achieved remarkable success in generating high-resolution, realistic images across diverse natural distributions. However, their performance heavily relies on high-quality training data, making it challenging to learn…

Machine Learning · Computer Science 2025-05-22 Tianyu Chen , Yasi Zhang , Zhendong Wang , Ying Nian Wu , Oscar Leong , Mingyuan Zhou

Dataset distillation aims to learn a small synthetic dataset that preserves most of the information from the original dataset. Dataset distillation can be formulated as a bi-level meta-learning problem where the outer loop optimizes the…

Machine Learning · Computer Science 2022-10-25 Yongchao Zhou , Ehsan Nezhadarya , Jimmy Ba

Diffusion models (DMs) have emerged as powerful image priors in Bayesian computational imaging. Two primary strategies have been proposed for leveraging DMs in this context: Plug-and-Play methods, which are zero-shot and highly flexible but…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Charlesquin Kemajou Mbakam , Jonathan Spence , Marcelo Pereyra

This study presents a novel approach to enhance the cost-to-quality ratio of image generation with diffusion models. We hypothesize that differences between distilled (e.g. FLUX.1-schnell) and baseline (e.g. FLUX.1-dev) models are…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Jakub Wasala , Bartlomiej Wrzalski , Kornelia Noculak , Yuliia Tarasenko , Oliwer Krupa , Jan Kocon , Grzegorz Chodak

Diffusion models generate high-quality images but require dozens of forward passes. We introduce Distribution Matching Distillation (DMD), a procedure to transform a diffusion model into a one-step image generator with minimal impact on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Tianwei Yin , Michaël Gharbi , Richard Zhang , Eli Shechtman , Fredo Durand , William T. Freeman , Taesung Park

In recent years, pre-trained multimodal large models have attracted widespread attention due to their outstanding performance in various multimodal applications. Nonetheless, the extensive computational resources and vast datasets required…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Zhengyang Liang , Meiyu Liang , Wei Huang , Yawen Li , Zhe Xue

Recent progress in accelerating text-to-image diffusion models enables high-fidelity synthesis within a single denoising step. However, customizing the fast one-step models remains challenging, as existing methods consistently fail to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Yixiong Yang , Tao Wu , Senmao Li , Shiqi Yang , Yaxing Wang , Joost van de Weijer , Kai Wang

Aligning Diffusion models has achieved remarkable breakthroughs in generating high-quality, human preference-aligned images. Existing techniques, such as supervised fine-tuning (SFT) and DPO-style preference optimization, have become…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Zening Sun , Zhengpeng Xie , Lichen Bai , Shitong Shao , Shuo Yang , Zeke Xie

Diffusion Probabilistic Models (DPM) have shown remarkable efficacy in the synthesis of high-quality images. However, their inference process characteristically requires numerous, potentially hundreds, of iterative steps, which could…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Mingxiao Li , Tingyu Qu , Ruicong Yao , Wei Sun , Marie-Francine Moens

Recent studies have demonstrated the effectiveness of directly aligning diffusion models with human preferences using differentiable reward. However, they exhibit two primary challenges: (1) they rely on multistep denoising with gradient…

Artificial Intelligence · Computer Science 2025-09-12 Xiangwei Shen , Zhimin Li , Zhantao Yang , Shiyi Zhang , Yingfang Zhang , Donghao Li , Chunyu Wang , Qinglin Lu , Yansong Tang

We address the problem of fine-tuning diffusion models for reward-guided generation in biomolecular design. While diffusion models have proven highly effective in modeling complex, high-dimensional data distributions, real-world…