中文
相关论文

相关论文: Closing the ODE-SDE gap in score-based diffusion m…

200 篇论文

Score-based generative modeling with probability flow ordinary differential equations (ODEs) has achieved remarkable success in a variety of applications. While various fast ODE-based samplers have been proposed in the literature and…

机器学习 · 统计学 2025-08-12 Xuefeng Gao , Lingjiong Zhu

A potent class of generative models known as Diffusion Probabilistic Models (DPMs) has become prominent. A forward diffusion process adds gradually noise to data, while a model learns to gradually denoise. Sampling from pre-trained DPMs is…

机器学习 · 计算机科学 2023-10-27 Martin Gonzalez , Nelson Fernandez , Thuy Tran , Elies Gherbi , Hatem Hajri , Nader Masmoudi

Stochastic differential equations (SDEs) describe dynamical systems where deterministic flows, governed by a drift function, are superimposed with random fluctuations, dictated by a diffusion function. The accurate estimation (or discovery)…

机器学习 · 计算机科学 2025-10-22 Patrick Seifner , Kostadin Cvejoski , David Berghaus , Cesar Ojeda , Ramses J. Sanchez

We present a unified probabilistic formulation for diffusion-based image editing, where a latent variable is edited in a task-specific manner and generally deviates from the corresponding marginal distribution induced by the original…

计算机视觉与模式识别 · 计算机科学 2024-03-01 Shen Nie , Hanzhong Allan Guo , Cheng Lu , Yuhao Zhou , Chenyu Zheng , Chongxuan Li

Score-based (denoising diffusion) generative models have recently gained a lot of success in generating realistic and diverse data. These approaches define a forward diffusion process for transforming data to noise and generate data by…

机器学习 · 计算机科学 2021-06-01 Alexia Jolicoeur-Martineau , Ke Li , Rémi Piché-Taillefer , Tal Kachman , Ioannis Mitliagkas

This paper approaches the unsupervised learning problem by gradient descent in the space of probability density functions. A main result shows that along the gradient flow induced by a distribution-dependent ordinary differential equation…

机器学习 · 计算机科学 2024-01-09 Yu-Jui Huang , Yuchong Zhang

In this paper, we explore provable acceleration of diffusion models without any additional retraining. Focusing on the task of approximating a target data distribution in $\mathbb{R}^d$ to within $\varepsilon$ total-variation distance, we…

机器学习 · 计算机科学 2025-08-14 Gen Li , Yuchen Zhou , Yuting Wei , Yuxin Chen

Score-based Generative Models (SGMs) approximate a data distribution by perturbing it with Gaussian noise and subsequently denoising it via a learned reverse diffusion process. These models excel at modeling complex data distributions and…

机器学习 · 计算机科学 2025-09-23 Stefano Bruno , Sotirios Sabanis

Diffusion models have become the de facto framework for generating new datasets. The core of these models lies in the ability to reverse a diffusion process in time. The goal of this manuscript is to explain, from a PDE perspective, how…

概率论 · 数学 2025-01-29 Fei Cao , Kimball Johnston , Thomas Laurent , Justin Le , Sébastien Motsch

Modelling partial differential equations (PDEs) is of crucial importance in science and engineering, and it includes tasks ranging from forecasting to inverse problems, such as data assimilation. However, most previous numerical and machine…

In the field of inverse estimation for systems modeled by partial differential equations (PDEs), challenges arise when estimating high- (or even infinite-) dimensional parameters. Typically, the ill-posed nature of such problems…

计算工程、金融与科学 · 计算机科学 2024-08-30 Yankun Hong , Harshit Bansal , Karen Veroy

Score-based generative models (SGMs) have revolutionized the field of generative modeling, achieving unprecedented success in generating realistic and diverse content. Despite empirical advances, the theoretical basis for why optimizing the…

机器学习 · 计算机科学 2024-08-30 Gen Li , Yuling Yan

Stochastic differential equations (SDEs) provide a flexible framework for modeling temporal dynamics in partially observed systems. A central task is to calibrate such models from data, which requires inferring latent trajectories and…

机器学习 · 统计学 2026-05-08 Yu Wang , Arnab Ganguly

Predicting counterfactual distributions in complex dynamical systems is essential for scientific modeling and decision-making in domains such as public health and medicine. However, existing methods often rely on point estimates or purely…

机器学习 · 计算机科学 2025-09-15 Wenhao Mu , Zhi Cao , Mehmed Uludag , Alexander Rodríguez

We provide the first polynomial-time convergence guarantees for the probability flow ODE implementation (together with a corrector step) of score-based generative modeling. Our analysis is carried out in the wake of recent results obtaining…

机器学习 · 计算机科学 2023-05-22 Sitan Chen , Sinho Chewi , Holden Lee , Yuanzhi Li , Jianfeng Lu , Adil Salim

Score distillation of 2D diffusion models has proven to be a powerful mechanism to guide 3D optimization, for example enabling text-based 3D generation or single-view reconstruction. A common limitation of existing score distillation…

计算机视觉与模式识别 · 计算机科学 2025-04-17 Yanbo Xu , Jayanth Srinivasa , Gaowen Liu , Shubham Tulsiani

Diffusion models, which convert noise into new data instances by learning to reverse a diffusion process, have become a cornerstone in contemporary generative modeling. In this work, we develop non-asymptotic convergence theory for a…

机器学习 · 计算机科学 2024-08-06 Gen Li , Yuting Wei , Yuejie Chi , Yuxin Chen

Score-based diffusion models have demonstrated remarkable empirical success in learning high-dimensional distributions, particularly those exhibiting low-dimensional and multi-modal structures. However, theoretical understanding of their…

机器学习 · 统计学 2026-05-29 Jingda Wu , Changxiao Cai

Recent score-based diffusion models (SBDMs) show promising results in unpaired image-to-image translation (I2I). However, existing methods, either energy-based or statistically-based, provide no explicit form of the interfered intermediate…

计算机视觉与模式识别 · 计算机科学 2023-08-07 Shikun Sun , Longhui Wei , Junliang Xing , Jia Jia , Qi Tian

There is a growing literature adopting a stochastic optimal control (SOC) perspective to fine-tune diffusion models and related generative policies. A prominent class of methods, known as iterative diffusion optimization, solves the SOC…

最优化与控制 · 数学 2026-03-24 Yuhang Mei , Amirhossein Taghvaei