中文
相关论文

相关论文: Differentiable Solver Search for Fast Diffusion Sa…

200 篇论文

Diffusion modeling (DM) has high-quality generative performance, and the sampling problem is an important part of the DM performance. Thanks to efficient differential equation solvers, the sampling speed can be reduced while higher sampling…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Zitong Cheng

Diffusion models (DMs) have made significant progress in the fields of image, audio, and video generation. One downside of DMs is their slow iterative process. Recent algorithms for fast sampling are designed from the perspective of…

机器学习 · 统计学 2023-09-12 Shigui Li , Wei Chen , Delu Zeng

Diffusion or flow-based models are powerful generative paradigms that are notoriously hard to sample as samples are defined as solutions to high-dimensional Ordinary or Stochastic Differential Equations (ODEs/SDEs) which require a large…

机器学习 · 计算机科学 2023-10-31 Neta Shaul , Juan Perez , Ricky T. Q. Chen , Ali Thabet , Albert Pumarola , Yaron Lipman

Discrete diffusion models (DDMs) have shown powerful generation ability for discrete data modalities like text and molecules. However, their practical application is hindered by inefficient sampling, requiring a large number of sampling…

机器学习 · 计算机科学 2025-09-25 Feiyang Fu , Tongxian Guo , Zhaoqiang Liu

Diffusion models have demonstrated exceptional capabilities in generating high-fidelity images but typically suffer from inefficient sampling. Many solver designs and noise scheduling strategies have been proposed to dramatically improve…

机器学习 · 统计学 2025-10-01 Tianrong Chen , Huangjie Zheng , David Berthelot , Jiatao Gu , Josh Susskind , Shuangfei Zhai

Diffusion-based generative processes, formulated as differential equation solving, frequently balance computational speed with sample quality. Our theoretical investigation of ODE- and SDE-based solvers reveals complementary weaknesses: ODE…

计算机视觉与模式识别 · 计算机科学 2025-11-03 Ruoyu Wang , Beier Zhu , Junzhi Li , Liangyu Yuan , Chi Zhang

A potent class of generative models known as Diffusion Probabilistic Models (DPMs) has become prominent. A forward diffusion process adds gradually noise to data, while a model learns to gradually denoise. Sampling from pre-trained DPMs is…

机器学习 · 计算机科学 2023-10-27 Martin Gonzalez , Nelson Fernandez , Thuy Tran , Elies Gherbi , Hatem Hajri , Nader Masmoudi

Diffusion models have achieved remarkable progress in universal image restoration. While existing methods speed up inference by reducing sampling steps, substantial step intervals often introduce cumulative errors. Moreover, they struggle…

计算机视觉与模式识别 · 计算机科学 2025-05-09 Hebaixu Wang , Jing Zhang , Haonan Guo , Di Wang , Jiayi Ma , Bo Du

Diffusion probabilistic models (DPMs) have shown remarkable performance in visual synthesis but are computationally expensive due to the need for multiple evaluations during the sampling. Recent predictor-corrector diffusion samplers have…

计算机视觉与模式识别 · 计算机科学 2024-09-06 Wenliang Zhao , Haolin Wang , Jie Zhou , Jiwen Lu

Diffusion probabilistic models (DPMs) have shown remarkable performance in high-resolution image synthesis, but their sampling efficiency is still to be desired due to the typically large number of sampling steps. Recent advancements in…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Shuchen Xue , Zhaoqiang Liu , Fei Chen , Shifeng Zhang , Tianyang Hu , Enze Xie , Zhenguo Li

The optimization of the latents and parameters of diffusion models with respect to some differentiable metric defined on the output of the model is a challenging and complex problem. The sampling for diffusion models is done by solving…

计算机视觉与模式识别 · 计算机科学 2025-02-13 Zander W. Blasingame , Chen Liu

Constructing fast samplers for unconditional diffusion and flow-matching models has received much attention recently; however, existing methods for solving inverse problems, such as super-resolution, inpainting, or deblurring, still require…

计算机视觉与模式识别 · 计算机科学 2024-11-04 Kushagra Pandey , Ruihan Yang , Stephan Mandt

Diffusion models achieve state-of-the-art image quality. However, sampling is costly at inference time because it requires a large number of function evaluations (NFEs). To reduce NFEs, classical ODE numerical methods have been adopted.…

机器学习 · 计算机科学 2026-03-05 Soochul Park , Yeon Ju Lee

Continuous normalizing flows (CNFs) and diffusion models (DMs) generate high-quality data from a noise distribution. However, their sampling process demands multiple iterations to solve an ordinary differential equation (ODE) with high…

机器学习 · 计算机科学 2025-11-19 Denis Gudovskiy , Wenzhao Zheng , Tomoyuki Okuno , Yohei Nakata , Kurt Keutzer

Diffusion models achieve high-quality image generation but are limited by slow iterative sampling. Distillation methods alleviate this by enabling one- or few-step generation. Flow matching, originally introduced as a distinct framework,…

计算机视觉与模式识别 · 计算机科学 2025-12-04 Mingyuan Zhou , Yi Gu , Huangjie Zheng , Liangchen Song , Guande He , Yizhe Zhang , Wenze Hu , Yinfei Yang

Diffusion Probabilistic Models (DPMs) are a well-established class of diffusion models for unconditional image generation, while SGMSE+ is a well-established conditional diffusion model for speech enhancement. One of the downsides of…

音频与语音处理 · 电气工程与系统科学 2026-03-11 Bunlong Lay , Timo Gerkmann

Diffusion transformers have demonstrated remarkable generation quality, albeit requiring longer training iterations and numerous inference steps. In each denoising step, diffusion transformers encode the noisy inputs to extract the…

计算机视觉与模式识别 · 计算机科学 2025-04-10 Shuai Wang , Zhi Tian , Weilin Huang , Limin Wang

Diffusion Models (DMs) have achieved state-of-the-art generative performance across multiple modalities, yet their sampling process remains prohibitively slow due to the need for hundreds of function evaluations. Recent progress in…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Tong Zhao , Mingkun Lei , Liangyu Yuan , Yanming Yang , Chenxi Song , Yang Wang , Beier Zhu , Chi Zhang

Sampling from Diffusion Models can alternatively be seen as solving differential equations, where there is a challenge in balancing speed and image visual quality. ODE-based samplers offer rapid sampling time but reach a performance limit,…

机器学习 · 计算机科学 2025-02-28 Qinpeng Cui , Xinyi Zhang , Qiqi Bao , Qingmin Liao

Diffusion models have recently achieved remarkable performance in image super-resolution (SR), but their high computational cost limits practical deployment in remote sensing applications. To address this issue, we propose SlimDiffSR, a…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Ce Wang , Zhenyu Hu , Wanjie Sun