English
Related papers

Related papers: Score Shocks: The Burgers Equation Structure of Di…

200 papers

In this work, we look at Score-based generative models (also called diffusion generative models) from a geometric perspective. From a new view point, we prove that both the forward and backward process of adding noise and generating from…

Machine Learning · Computer Science 2023-02-10 Sandesh Ghimire , Jinyang Liu , Armand Comas , Davin Hill , Aria Masoomi , Octavia Camps , Jennifer Dy

How diffusion models generalize beyond their training set is not known, and is somewhat mysterious given two facts: the optimum of the denoising score matching (DSM) objective usually used to train diffusion models is the score function of…

Machine Learning · Computer Science 2025-04-18 John J. Vastola

We study the asymptotic error of score-based diffusion model sampling in large-sample scenarios from a non-parametric statistics perspective. We show that a kernel-based score estimator achieves an optimal mean square error of…

Statistics Theory · Mathematics 2024-07-25 Kaihong Zhang , Caitlyn H. Yin , Feng Liang , Jingbo Liu

We analyze the unforced and deterministically forced Burgers equation in the framework of the (diffusive) interpolating dynamics that solves the so-called Schr\"{o}dinger boundary data problem for the random matter transport. This entails…

Condensed Matter · Physics 2009-10-31 P. Garbaczewski , G. Kondrat , R. Olkiewicz

Score-based models have achieved remarkable results in the generative modeling of many domains. By learning the gradient of smoothed data distribution, they can iteratively generate samples from complex distribution e.g. natural images.…

Artificial Intelligence · Computer Science 2024-03-27 Binxu Wang , John J. Vastola

We study convergence of a generative modeling method that first estimates the score function of the distribution using Denoising Auto-Encoders (DAE) or Denoising Score Matching (DSM) and then employs Langevin diffusion for sampling. We show…

Machine Learning · Statistics 2022-10-12 Adam Block , Youssef Mroueh , Alexander Rakhlin

Diffusion models now set the benchmark in high-fidelity generative sampling, yet they can, in principle, be prone to memorization. In this case, their learned score overfits the finite dataset so that the reverse-time SDE samples are mostly…

Machine Learning · Computer Science 2025-05-30 Franck Gabriel , François Ged , Maria Han Veiga , Emmanuel Schertzer

Score-based Generative Models (SGMs) have demonstrated exceptional synthesis outcomes across various tasks. However, the current design landscape of the forward diffusion process remains largely untapped and often relies on physical…

Machine Learning · Computer Science 2023-10-13 Kushagra Pandey , Stephan Mandt

The Stochastic Burgers Equation (SBE) is a singular, non-linear Stochastic Partial Differential Equation (SPDE) that describes, on mesoscopic scales, the fluctuations of stochastic driven diffusive systems with a conserved scalar quantity.…

Probability · Mathematics 2025-01-10 Giuseppe Cannizzaro , Quentin Moulard , Fabio Toninelli

By learning the gradient of smoothed data distributions, diffusion models can iteratively generate samples from complex distributions. The learned score function enables their generalization capabilities, but how the learned score relates…

Machine Learning · Computer Science 2024-12-16 Binxu Wang , John J. Vastola

We propose DiffSep, a new single channel source separation method based on score-matching of a stochastic differential equation (SDE). We craft a tailored continuous time diffusion-mixing process starting from the separated sources and…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-03 Robin Scheibler , Youna Ji , Soo-Whan Chung , Jaeuk Byun , Soyeon Choe , Min-Seok Choi

Discrete diffusion models have achieved strong empirical performance in text and other symbolic domains, but, especially for uniform-rate models, they often require many steps to generate a single sample. Existing acceleration methods…

Machine Learning · Computer Science 2026-05-27 Yuchen Liang , Ness Shroff , Yingbin Liang

Recently, Zhang et al. have proposed the Diffusion Exponential Integrator Sampler (DEIS) for fast generation of samples from Diffusion Models. It leverages the semi-linear nature of the probability flow ordinary differential equation (ODE)…

Machine Learning · Computer Science 2023-11-13 Guoxuan Xia , Duolikun Danier , Ayan Das , Stathi Fotiadis , Farhang Nabiei , Ushnish Sengupta , Alberto Bernacchia

This paper studies the original discrete-time denoising diffusion probabilistic model (DDPM) from a probabilistic point of view. We present three main theoretical results. First, we show that the time-dependent score function associated…

Probability · Mathematics 2026-01-13 Yumiharu Nakano

This paper explores the use of score-based diffusion models for Bayesian image reconstruction. Diffusion models are an efficient tool for generative modeling. Diffusion models can also be used for solving image reconstruction problems. We…

Image and Video Processing · Electrical Eng. & Systems 2025-10-06 Michael T. McCann , Hyungjin Chung , Jong Chul Ye , Marc L. Klasky

This work explores the theoretical and practical foundations of denoising diffusion probabilistic models (DDPMs) and score-based generative models, which leverage stochastic processes and Brownian motion to model complex data distributions.…

Machine Learning · Computer Science 2024-12-30 Jathin Korrapati , Tanish Baranwal , Rahul Shah

Diffusion models have emerged as a powerful framework in generative modeling, typically relying on optimizing neural networks to estimate the score function via forward SDE simulations. In this work, we propose an alternative method that is…

Numerical Analysis · Mathematics 2025-06-17 Yuehaw Khoo , Mathias Oster , Yifan Peng

Diffusion models have emerged as the principal paradigm for generative modeling across various domains. During training, they learn the score function, which in turn is used to generate samples at inference. They raise a basic yet unsolved…

Machine Learning · Computer Science 2025-10-03 Kiwhan Song , Jaeyeon Kim , Sitan Chen , Yilun Du , Sham Kakade , Vincent Sitzmann

We consider an evolution equation generalising the viscous Burgers equation supplemented by an initial condition which is a homogeneous random field. We develop a non-linear framework enabling us to show the existence and regularity of…

Analysis of PDEs · Mathematics 2018-10-29 Miłosz Krupski

In this article we deal with one-dimensional inverse problems concerning the Burgers equation and some related nonlinear systems (involving heat effects and/or variable density). In these problems, the goal is to find the size of the…

Analysis of PDEs · Mathematics 2022-01-05 J. Apraiz , A. Doubova , E. Fernández-Cara , M. Yamamoto