中文
相关论文

相关论文: Convergence of Deterministic and Stochastic Diffus…

200 篇论文

Score-based generative models (SGMs) is a recent class of deep generative models with state-of-the-art performance in many applications. In this paper, we establish convergence guarantees for a general class of SGMs in 2-Wasserstein…

机器学习 · 计算机科学 2025-02-18 Xuefeng Gao , Hoang M. Nguyen , Lingjiong Zhu

This paper provides an elementary, self-contained analysis of diffusion-based sampling methods for generative modeling. In contrast to existing approaches that rely on continuous-time processes and then discretize, our treatment works…

机器学习 · 统计学 2025-06-25 Galen Reeves , Henry D. Pfister

Denoising diffusion models are a popular class of generative models providing state-of-the-art results in many domains. One adds gradually noise to data using a diffusion to transform the data distribution into a Gaussian distribution.…

机器学习 · 计算机科学 2023-08-21 Francisco Vargas , Will Grathwohl , Arnaud Doucet

Flow matching has recently emerged as a promising alternative to diffusion-based generative models, offering faster sampling and simpler training by learning continuous flows governed by ordinary differential equations. Despite growing…

机器学习 · 计算机科学 2025-12-02 Mudit Gaur , Prashant Trivedi , Shuchin Aeron , Amrit Singh Bedi , George K. Atia , Vaneet Aggarwal

We provide a general framework for learning diffusion bridges that transport prior to target distributions. It includes existing diffusion models for generative modeling, but also underdamped versions with degenerate diffusion matrices,…

机器学习 · 计算机科学 2025-08-14 Denis Blessing , Julius Berner , Lorenz Richter , Gerhard Neumann

Diffusion and flow matching models generate high-fidelity data by simulating paths defined by Ordinary or Stochastic Differential Equations (ODEs/SDEs), starting from a tractable prior distribution. The probability flow ODE formulation…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Liangyu Yuan , Ruoyu Wang , Tong Zhao , Dingwen Fu , Mingkun Lei , Beier Zhu , Chi Zhang

Non-convex sampling is a key challenge in machine learning, central to non-convex optimization in deep learning as well as to approximate probabilistic inference. Despite its significance, theoretically there remain many important…

机器学习 · 计算机科学 2024-09-18 Mohammad Reza Karimi , Ya-Ping Hsieh , Andreas Krause

This paper considers the problem of regression over distributions, which is becoming increasingly important in machine learning. Existing approaches often ignore the geometry of the probability space or are computationally expensive. To…

机器学习 · 计算机科学 2025-10-31 Maksim Maslov , Alexander Kugaevskikh , Matthew Ivanov

We study the quantitative convergence of drift-diffusion PDEs that arise as Wasserstein gradient flows of linearly convex functions over the space of probability measures on ${\mathbb R}^d$. In this setting, the objective is in general not…

最优化与控制 · 数学 2025-07-17 Lénaïc Chizat , Maria Colombo , Xavier Fernández-Real

Discrete diffusion models (DDMs) are a powerful class of generative models for categorical data, but they typically require many function evaluations for a single sample, making inference expensive. Existing acceleration methods either rely…

机器学习 · 计算机科学 2025-12-16 Yansong Gao , Yu Sun

We study the reknown deconvolution problem of recovering a distribution function from independent replicates (signal) additively contaminated with random errors (noise), whose distribution is known. We investigate whether a Bayesian…

统计理论 · 数学 2021-11-15 Judith Rousseau , Catia Scricciolo

Discrete time analogues of ergodic stochastic differential equations (SDEs) are one of the most popular and flexible tools for sampling high-dimensional probability measures. Non-asymptotic analysis in the $L^2$ Wasserstein distance of…

概率论 · 数学 2019-10-11 Mateusz B. Majka , Aleksandar Mijatović , Lukasz Szpruch

Given $n$ independent samples from a $d$-dimensional probability distribution, our aim is to generate diffusion-based samples from a distribution obtained by tilting the original, where the degree of tilt is parametrized by $\theta \in…

The Wasserstein distance is a metric on a space of probability measures that has seen a surge of applications in statistics, machine learning, and applied mathematics. However, statistical aspects of Wasserstein distances are bottlenecked…

概率论 · 数学 2022-03-02 Ziv Goldfeld , Kengo Kato , Sloan Nietert , Gabriel Rioux

This paper proposes a new theoretical lens to view Wasserstein generative adversarial networks (WGANs). To minimize the Wasserstein-1 distance between the true data distribution and our estimate of it, we derive a distribution-dependent…

机器学习 · 统计学 2025-02-05 Zachariah Malik , Yu-Jui Huang

Recent years have witnessed significant progress in developing effective training and fast sampling techniques for diffusion models. A remarkable advancement is the use of stochastic differential equations (SDEs) and their…

计算机视觉与模式识别 · 计算机科学 2024-08-26 Defang Chen , Zhenyu Zhou , Jian-Ping Mei , Chunhua Shen , Chun Chen , Can Wang

The Wasserstein distance is an attractive tool for data analysis but statistical inference is hindered by the lack of distributional limits. To overcome this obstacle, for probability measures supported on finitely many points, we derive…

统计方法学 · 统计学 2017-04-27 Max Sommerfeld , Axel Munk

Generative models can be categorized into two types: explicit generative models that define explicit density forms and allow exact likelihood inference, such as score-based diffusion models (SDMs) and normalizing flows; implicit generative…

机器学习 · 统计学 2023-07-06 Jingwei Zhang , Han Shi , Jincheng Yu , Enze Xie , Zhenguo Li

We establish exact rates of convergence in the $p$-Wasserstein distance for the empirical measure of a class of non-symmetric jump processes, which are subordinated to a diffusion process on a compact Riemannian manifold. For the quadratic…

概率论 · 数学 2025-10-01 René L. Schilling , Bingyao Wu

Diffusion models achieve state-of-the-art performance in various generation tasks. However, their theoretical foundations fall far behind. This paper studies score approximation, estimation, and distribution recovery of diffusion models,…

机器学习 · 计算机科学 2023-02-15 Minshuo Chen , Kaixuan Huang , Tuo Zhao , Mengdi Wang