中文
相关论文

相关论文: Gaussian Mixture Solvers for Diffusion Models

200 篇论文

Diffusion models have achieved state-of-the-art results in generative modelling but remain computationally intensive at inference time, often requiring thousands of discretization steps. To this end, we propose Sig-DEG (Signature-based…

Autoregressive next-step prediction models have become the de-facto standard for building data-driven neural solvers to forecast time-dependent partial differential equations (PDEs). Denoise training that is closely related to diffusion…

机器学习 · 计算机科学 2025-03-31 Zijie Li , Anthony Zhou , Amir Barati Farimani

Denoising diffusion models (DDMs) have emerged as a powerful class of generative models. A forward diffusion process slowly perturbs the data, while a deep model learns to gradually denoise. Synthesis amounts to solving a differential…

机器学习 · 统计学 2022-10-12 Tim Dockhorn , Arash Vahdat , Karsten Kreis

In recent years we have witnessed a growth in mathematics for deep learning, which has been used to solve inverse problems of partial differential equations (PDEs). However, most deep learning-based inversion methods either require paired…

数值分析 · 数学 2024-04-23 Enze Jiang , Jishen Peng , Zheng Ma , Xiong-Bin Yan

Diffusion models have become a standard approach for generative modeling in continuous domains, yet their application to discrete data remains challenging. We investigate why Gaussian diffusion models with the DDPM solver struggle to sample…

计算与语言 · 计算机科学 2026-05-28 Alexander Shabalin , Simon Elistratov , Viacheslav Meshchaninov , Ildus Sadrtdinov , Dmitry Vetrov

There is a growing literature adopting a stochastic optimal control (SOC) perspective to fine-tune diffusion models and related generative policies. A prominent class of methods, known as iterative diffusion optimization, solves the SOC…

最优化与控制 · 数学 2026-03-24 Yuhang Mei , Amirhossein Taghvaei

Denoising diffusion models have driven significant progress in the field of Bayesian inverse problems. Recent approaches use pre-trained diffusion models as priors to solve a wide range of such problems, only leveraging inference-time…

机器学习 · 统计学 2025-02-06 Yazid Janati , Badr Moufad , Mehdi Abou El Qassime , Alain Durmus , Eric Moulines , Jimmy Olsson

Score-based generative models have demonstrated significant practical success in data-generating tasks. The models establish a diffusion process that perturbs the ground truth data to Gaussian noise and then learn the reverse process to…

机器学习 · 计算机科学 2024-05-24 Ziqing Wen , Xiaoge Deng , Ping Luo , Tao Sun , Dongsheng Li

Diffusion models have recently shown remarkable results in magnetic resonance imaging reconstruction. However, the employed networks typically are black-box estimators of the (smoothed) prior score with tens of millions of parameters,…

图像与视频处理 · 电气工程与系统科学 2025-01-16 Laurenz Nagler , Martin Zach , Thomas Pock

Schrodinger Bridges (SBs) are diffusion processes that steer, in finite time, a given initial distribution to another final one while minimizing a suitable cost functional. Although various methods for computing SBs have recently been…

机器学习 · 计算机科学 2025-10-15 George Rapakoulias , Ali Reza Pedram , Fengjiao Liu , Lingjiong Zhu , Panagiotis Tsiotras

Score-based generative models (SGMs) have recently emerged as a promising class of generative models. However, a fundamental limitation is that their inference is very slow due to a need for many (e.g., 2000) iterations of sequential…

计算机视觉与模式识别 · 计算机科学 2022-12-06 Hengyuan Ma , Li Zhang , Xiatian Zhu , Jianfeng Feng

In the field of inverse estimation for systems modeled by partial differential equations (PDEs), challenges arise when estimating high- (or even infinite-) dimensional parameters. Typically, the ill-posed nature of such problems…

计算工程、金融与科学 · 计算机科学 2024-08-30 Yankun Hong , Harshit Bansal , Karen Veroy

The performance of flow matching and diffusion models can be greatly improved at inference time using reward alignment algorithms, yet efficiency remains a major limitation. While several algorithms were proposed, we demonstrate that a…

机器学习 · 计算机科学 2026-02-12 Peter Holderrieth , Uriel Singer , Tommi Jaakkola , Ricky T. Q. Chen , Yaron Lipman , Brian Karrer

While diffusion models achieve state-of-the-art generation quality, they still suffer from computationally expensive sampling. Recent works address this issue with gradient-based optimization methods that distill a few-step ODE diffusion…

Solving inverse problems with the reverse process of a diffusion model represents an appealing avenue to produce highly realistic, yet diverse solutions from incomplete and possibly noisy measurements, ultimately enabling uncertainty…

地球物理 · 物理学 2025-01-10 Matteo Ravasi

Deep generative models such as GANs, normalizing flows, and diffusion models are powerful regularizers for inverse problems. They exhibit great potential for helping reduce ill-posedness and attain high-quality results. However, the latent…

计算机视觉与模式识别 · 计算机科学 2024-07-30 Dongzhuo Li

Diffusion models (DMs) are a type of generative model that has a huge impact on image synthesis and beyond. They achieve state-of-the-art generation results in various generative tasks. A great diversity of conditioning inputs, such as text…

机器学习 · 计算机科学 2024-02-02 Weiguo Lu , Xuan Wu , Deng Ding , Jinqiao Duan , Jirong Zhuang , Gangnan Yuan

Diffusion models have recently attained significant interest within the community owing to their strong performance as generative models. Furthermore, its application to inverse problems have demonstrated state-of-the-art performance.…

图像与视频处理 · 电气工程与系统科学 2022-03-22 Hyungjin Chung , Byeongsu Sim , Jong Chul Ye

Diffusion-based generative models employ stochastic differential equations (SDEs) and their equivalent probability flow ordinary differential equations (ODEs) to establish a smooth transformation between complex high-dimensional data…

机器学习 · 计算机科学 2025-12-12 Defang Chen , Zhenyu Zhou , Can Wang , Siwei Lyu

Diffusion models (DMs) have been adopted across diverse fields with its remarkable abilities in capturing intricate data distributions. In this paper, we propose a Fast Diffusion Model (FDM) to significantly speed up DMs from a stochastic…

计算机视觉与模式识别 · 计算机科学 2023-10-05 Zike Wu , Pan Zhou , Kenji Kawaguchi , Hanwang Zhang