English
Related papers

Related papers: Malliavin Calculus for Score-based Diffusion Model…

200 papers

We provide full theoretical guarantees for the convergence behaviour of diffusion-based generative models under the assumption of strongly log-concave data distributions while our approximating class of functions used for score estimation…

Machine Learning · Computer Science 2025-02-18 Stefano Bruno , Ying Zhang , Dong-Young Lim , Ömer Deniz Akyildiz , Sotirios Sabanis

This study investigates the dynamics of Score-based Generative Models (SGMs) by treating the score estimation error as a stochastic source driving the Fokker-Planck equation. Departing from particle-centric SDE analyses, we employ an SPDE…

Machine Learning · Computer Science 2026-02-10 Junsu Seo

We derive a general change of variables formula for score functions, showing that for a smooth, invertible transformation $\mathbf{y} = \phi(\mathbf{x})$, the transformed score function $\nabla_{\mathbf{y}} \log q(\mathbf{y})$ can be…

Machine Learning · Computer Science 2025-02-25 Stephen Robbins

We propose a deterministic sampling framework using Score-Based Transport Modeling for sampling an unnormalized target density $\pi$ given only its score $\nabla \log \pi$. Our method approximates the Wasserstein gradient flow on…

Machine Learning · Computer Science 2025-10-21 Vasily Ilin , Peter Sushko , Jingwei Hu

This paper gives direct derivations of the differential equations and likelihood formulas of diffusion models assuming only knowledge of Gaussian distributions. A VAE analysis derives both forward and backward stochastic differential…

Machine Learning · Computer Science 2023-03-07 David McAllester

Graph structures offer a versatile framework for representing diverse patterns in nature and complex systems, applicable across domains like molecular chemistry, social networks, and transportation systems. While diffusion models have…

Machine Learning · Computer Science 2024-06-10 Adrien Carrel

Simulating parameter-dependent stochastic differential equations (SDEs) presents significant computational challenges, as separate high-fidelity simulations are typically required for each parameter value of interest. Despite the success of…

Machine Learning · Statistics 2026-02-03 Minglei Yang , Sicheng He

Score-based generative models (SGMs) have revolutionized the field of generative modeling, achieving unprecedented success in generating realistic and diverse content. Despite empirical advances, the theoretical basis for why optimizing the…

Machine Learning · Computer Science 2024-08-30 Gen Li , Yuling Yan

By using the mirror coupling for solutions of SDEs driven by pure jump L\'evy processes, we extend some transportation and concentration inequalities, which were previously known only in the case where the coefficients in the equation…

Probability · Mathematics 2019-11-12 Mateusz B. Majka

This paper presents a novel framework to accelerate score-based diffusion models. It first converts the standard stable diffusion model into the Fokker-Planck formulation which results in solving large linear systems for each image. For…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Kaikwan Lau , Andrew S. Na , Justin W. L. Wan

We propose an unbiased Monte-Carlo estimator for $\mathbb{E}[g(X_{t_1}, \cdots, X_{t_n})]$, where $X$ is a diffusion process defined by a multi-dimensional stochastic differential equation (SDE). The main idea is to start instead from a…

Probability · Mathematics 2016-03-08 Pierre Henry-Labordere , Xiaolu Tan , Nizar Touzi

Sampling based on score diffusions has led to striking empirical results, and has attracted considerable attention from various research communities. It depends on availability of (approximate) Stein score functions for various levels of…

Statistics Theory · Mathematics 2026-01-01 M. J. Wainwright

Solving inverse problems without the use of derivatives or adjoints of the forward model is highly desirable in many applications arising in science and engineering. In this paper, we propose a new version of such a methodology, a framework…

Dynamical Systems · Mathematics 2019-10-17 Alfredo Garbuno-Inigo , Franca Hoffmann , Wuchen Li , Andrew M. Stuart

Sampling in score-based diffusion models can be performed by solving either a reverse-time stochastic differential equation (SDE) parameterized by an arbitrary time-dependent stochasticity parameter or a probability flow ODE, corresponding…

Machine Learning · Computer Science 2025-07-31 Bernardo P. Schaeffer , Ricardo M. S. Rosa , Glauco Valle

The optimization of the latents and parameters of diffusion models with respect to some differentiable metric defined on the output of the model is a challenging and complex problem. The sampling for diffusion models is done by solving…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Zander W. Blasingame , Chen Liu

There is a long history, as well as a recent explosion of interest, in statistical and generative modeling approaches based on score functions -- derivatives of the log-likelihood of a distribution. In seminal works, Hyv\"arinen proposed…

Machine Learning · Computer Science 2023-10-04 Frederic Koehler , Thuy-Duong Vuong

We study fluctuations of small noise multiscale diffusions around their homogenized deterministic limit. We derive quantitative rates of convergence of the fluctuation processes to their Gaussian limits in the appropriate Wasserstein metric…

Probability · Mathematics 2024-11-05 Solesne Bourguin , Konstantinos Spiliopoulos

We study counterfactual gradient estimation of conditional loss functionals of diffusion processes. In quantitative finance, these gradients are known as conditional Greeks: the sensitivity of expected market values, conditioned on some…

Computational Engineering, Finance, and Science · Computer Science 2026-02-04 Vikram Krishnamurthy , Luke Snow

In the field of inverse estimation for systems modeled by partial differential equations (PDEs), challenges arise when estimating high- (or even infinite-) dimensional parameters. Typically, the ill-posed nature of such problems…

Computational Engineering, Finance, and Science · Computer Science 2024-08-30 Yankun Hong , Harshit Bansal , Karen Veroy

Using Malliavin calculus techniques, we derive an analytical formula for the price of European options, for any model including local volatility and Poisson jump process. We show that the accuracy of the formula depends on the smoothness of…

Pricing of Securities · Quantitative Finance 2009-06-15 Eric Benhamou , Emmanuel Gobet , Mohammed Miri