中文
相关论文

相关论文: S4S: Solving for a Diffusion Model Solver

200 篇论文

Diffusion models have recently demonstrated notable success in solving inverse problems. However, current diffusion model-based solutions typically require a large number of function evaluations (NFEs) to generate high-quality images…

计算机视觉与模式识别 · 计算机科学 2024-12-06 Tianyu Chen , Zhendong Wang , Mingyuan Zhou

Diffusion models have emerged as powerful generative tools, rivaling GANs in sample quality and mirroring the likelihood scores of autoregressive models. A subset of these models, exemplified by DDIMs, exhibit an inherent asymmetry: they…

计算机视觉与模式识别 · 计算机科学 2024-01-24 Yixuan Wang , Shuangyin Li

Generative models can be categorized into two types: explicit generative models that define explicit density forms and allow exact likelihood inference, such as score-based diffusion models (SDMs) and normalizing flows; implicit generative…

机器学习 · 统计学 2023-07-06 Jingwei Zhang , Han Shi , Jincheng Yu , Enze Xie , Zhenguo Li

Diffusion (score-based) generative models have been widely used for modeling various types of complex data, including images, audios, and point clouds. Recently, the deep connection between forward-backward stochastic differential equations…

机器学习 · 计算机科学 2022-06-22 Weitao Du , Tao Yang , He Zhang , Yuanqi Du

Diffusion Probabilistic Models (DPMs) have shown remarkable potential in image generation, but their sampling efficiency is hindered by the need for numerous denoising steps. Most existing solutions accelerate the sampling process by…

计算机视觉与模式识别 · 计算机科学 2025-02-21 Guangyi Wang , Yuren Cai , Lijiang Li , Wei Peng , Songzhi Su

Inverse problems describe the process of estimating the causal factors from a set of measurements or data. Mapping of often incomplete or degraded data to parameters is ill-posed, thus data-driven iterative solutions are required, for…

人工智能 · 计算机科学 2024-06-21 Weitong Zhang , Chengqi Zang , Liu Li , Sarah Cechnicka , Cheng Ouyang , Bernhard Kainz

We introduce a general framework for solving partial differential equations (PDEs) using generative diffusion models. In particular, we focus on the scenarios where we do not have the full knowledge of the scene necessary to apply classical…

机器学习 · 计算机科学 2024-11-04 Jiahe Huang , Guandao Yang , Zichen Wang , Jeong Joon Park

Diffusion models are a new class of generative models that have shown outstanding performance in image generation literature. As a consequence, studies have attempted to apply diffusion models to other tasks, such as speech enhancement. A…

音频与语音处理 · 电气工程与系统科学 2024-10-10 Philippe Gonzalez , Zheng-Hua Tan , Jan Østergaard , Jesper Jensen , Tommy Sonne Alstrøm , Tobias May

Bayesian flow networks (BFNs) iteratively refine the parameters, instead of the samples in diffusion models (DMs), of distributions at various noise levels through Bayesian inference. Owing to its differentiable nature, BFNs are promising…

机器学习 · 计算机科学 2024-06-04 Kaiwen Xue , Yuhao Zhou , Shen Nie , Xu Min , Xiaolu Zhang , Jun Zhou , Chongxuan Li

Diffusion or score-based models recently showed high performance in image generation. They rely on a forward and a backward stochastic differential equations (SDE). The sampling of a data distribution is achieved by numerically solving the…

机器学习 · 计算机科学 2025-06-04 Emile Pierret , Bruno Galerne

Recently, Zhang et al. have proposed the Diffusion Exponential Integrator Sampler (DEIS) for fast generation of samples from Diffusion Models. It leverages the semi-linear nature of the probability flow ordinary differential equation (ODE)…

Efficient differential equation solvers have significantly reduced the sampling time of diffusion models (DMs) while retaining high sampling quality. Among these solvers, exponential integrators (EI) have gained prominence by demonstrating…

机器学习 · 计算机科学 2023-08-07 Qinsheng Zhang , Jiaming Song , Yongxin Chen

In recent years, diffusion models have become the most popular and powerful methods in the field of image synthesis, even rivaling human artists in artistic creativity. However, the key issue currently limiting the application of diffusion…

计算机视觉与模式识别 · 计算机科学 2023-08-14 Zhongjie Duan , Chengyu Wang , Cen Chen , Jun Huang , Weining Qian

Diffusion generative models have emerged as a new challenger to popular deep neural generative models such as GANs, but have the drawback that they often require a huge number of neural function evaluations (NFEs) during synthesis unless…

机器学习 · 统计学 2022-10-12 Hideyuki Tachibana , Mocho Go , Muneyoshi Inahara , Yotaro Katayama , Yotaro Watanabe

This paper introduces Bespoke Non-Stationary (BNS) Solvers, a solver distillation approach to improve sample efficiency of Diffusion and Flow models. BNS solvers are based on a family of non-stationary solvers that provably subsumes…

机器学习 · 计算机科学 2024-03-05 Neta Shaul , Uriel Singer , Ricky T. Q. Chen , Matthew Le , Ali Thabet , Albert Pumarola , Yaron Lipman

Diffusion models learn to denoise data and the trained denoiser is then used to generate new samples from the data distribution. In this paper, we revisit the diffusion sampling process and identify a fundamental cause of sample quality…

机器学习 · 计算机科学 2024-11-05 Yunshu Wu , Yingtao Luo , Xianghao Kong , Evangelos E. Papalexakis , Greg Ver Steeg

We propose a novel framework for adaptively learning the time-evolving solutions of stochastic partial differential equations (SPDEs) using score-based diffusion models within a recursive Bayesian inference setting. SPDEs play a central…

统计计算 · 统计学 2025-08-12 Toan Huynh , Ruth Lopez Fajardo , Guannan Zhang , Lili Ju , Feng Bao

Diffusion models with continuous stochastic differential equations (SDEs) have shown superior performances in image generation. It can serve as a deep generative prior to solving the inverse problem in magnetic resonance (MR)…

图像与视频处理 · 电气工程与系统科学 2024-01-23 Chentao Cao , Zhuo-Xu Cui , Yue Wang , Shaonan Liu , Taijin Chen , Hairong Zheng , Dong Liang , Yanjie Zhu

Diffusion models have demonstrated exceptional capabilities in generating high-fidelity images but typically suffer from inefficient sampling. Many solver designs and noise scheduling strategies have been proposed to dramatically improve…

机器学习 · 统计学 2025-10-01 Tianrong Chen , Huangjie Zheng , David Berthelot , Jiatao Gu , Josh Susskind , Shuangfei Zhai

Diffusion models generate samples by reversing a fixed forward diffusion process. Despite already providing impressive empirical results, these diffusion models algorithms can be further improved by reducing the variance of the training…

机器学习 · 计算机科学 2023-02-20 Yilun Xu , Shangyuan Tong , Tommi Jaakkola