English
Related papers

Related papers: Malliavin Calculus for Score-based Diffusion Model…

200 papers

Diffusion models achieve high-quality image generation but are limited by slow iterative sampling. Distillation methods alleviate this by enabling one- or few-step generation. Flow matching, originally introduced as a distinct framework,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Mingyuan Zhou , Yi Gu , Huangjie Zheng , Liangchen Song , Guande He , Yizhe Zhang , Wenze Hu , Yinfei Yang

This work introduces a sampling method capable of solving Bayesian inverse problems in function space. It does not assume the log-concavity of the likelihood, meaning that it is compatible with nonlinear inverse problems. The method…

Machine Learning · Statistics 2024-05-27 Lorenzo Baldassari , Ali Siahkoohi , Josselin Garnier , Knut Solna , Maarten V. de Hoop

We introduce a novel framework for efficient sampling from complex, unnormalised target distributions by exploiting multiscale dynamics. Traditional score-based sampling methods either rely on learned approximations of the score function or…

Computation · Statistics 2025-11-04 Paula Cordero-Encinar , Andrew B. Duncan , Sebastian Reich , O. Deniz Akyildiz

Basic derivative formulas are presented for hypoelliptic heat semigroups and harmonic functions extending earlier work in the elliptic case. Emphasis is placed on developing integration by parts formulas at the level of local martingales.…

Probability · Mathematics 2010-05-02 Marc Arnaudon , Anton Thalmaier

This work explores the theoretical and practical foundations of denoising diffusion probabilistic models (DDPMs) and score-based generative models, which leverage stochastic processes and Brownian motion to model complex data distributions.…

Machine Learning · Computer Science 2024-12-30 Jathin Korrapati , Tanish Baranwal , Rahul Shah

Stochastic reduced-order models are widely used to represent the effective dynamics of complex systems, but estimating their drift and diffusion coefficients from data remains challenging. Standard approaches often rely on short-time…

Machine Learning · Statistics 2026-04-28 Ludovico T. Giorgini

Score-based diffusion models have emerged as one of the most promising frameworks for deep generative modelling, due to their state-of-the art performance in many generation tasks while relying on mathematical foundations such as stochastic…

Machine Learning · Computer Science 2023-11-28 Teo Deveney , Jan Stanczuk , Lisa Maria Kreusser , Chris Budd , Carola-Bibiane Schönlieb

In this paper, we provide a multiscale perspective on the problem of maximum marginal likelihood estimation. We consider and analyse a diffusion-based maximum marginal likelihood estimation scheme using ideas from multiscale dynamics. Our…

Computation · Statistics 2024-06-11 O. Deniz Akyildiz , Michela Ottobre , Iain Souttar

Malliavin calculus provides a characterization of the centered model in regularity structures that is stable under removing the small-scale cut-off. In conjunction with a spectral gap inequality, it yields the stochastic estimates of the…

Probability · Mathematics 2025-10-08 Lucas Broux , Felix Otto , Markus Tempelmayr

In this work we study the diffusion annealed Langevin dynamics, a score-based diffusion process recently introduced in the theory of generative models and which is an alternative to the classical overdamped Langevin diffusion. Our goal is…

Probability · Mathematics 2025-11-14 Patrick Cattiaux , Paula Cordero-Encinar , Arnaud Guillin

Diffusion models are powerful generative models that simulate the reverse of diffusion processes using score functions to synthesize data from noise. The sampling process of diffusion models can be interpreted as solving the reverse…

Machine Learning · Computer Science 2022-09-30 Beomsu Kim , Jong Chul Ye

Discrete-time diffusion-based generative models and score matching methods have shown promising results in modeling high-dimensional image data. Recently, Song et al. (2021) show that diffusion processes that transform data into noise can…

Machine Learning · Computer Science 2021-10-01 Chin-Wei Huang , Jae Hyun Lim , Aaron Courville

We introduce a new method for analyzing midpoint discretizations of stochastic differential equations (SDEs), which are frequently used in Markov chain Monte Carlo (MCMC) methods for sampling from a target measure $\pi \propto \exp(-V)$.…

Numerical Analysis · Mathematics 2025-07-18 Matthew S. Zhang

In this work, by using the Malliavin calculus, under H\"ormander's condition, we prove the existence of distributional densities for the solutions of stochastic differential equations driven by degenerate subordinated Brownian motions.…

Probability · Mathematics 2014-09-04 Xicheng Zhang

Aim of this note is to analyse branching Brownian motion within the class of models introduced in the recent paper [4] and called chemical diffusion master equations. These models provide a description for the probabilistic evolution of…

Probability · Mathematics 2024-01-23 Alberto Lanconelli , Berk Tan Perçin

Consider stochastic functional differential equations, whose coefficients depend on past histories. The solution determines a non-Markov process. In the present paper, we shall obtain the existence of smooth densities for joint…

Probability · Mathematics 2016-01-07 Atsushi Takeuchi

Diffusion models generate high-dimensional data with remarkable quality, yet how their training efficiently learns the score function, bypassing the curse of dimensionality when data is supported on low-dimensional manifolds, remains…

Machine Learning · Computer Science 2026-05-21 Wei Huang , Andi Han , Mingyuan Bai , Huanjian Zhou , Qixin Zhang , Taiji Suzuki , Kenji Fukumizu

We study Malliavin differentiability of solutions to sub-critical singular parabolic stochastic partial differential equations (SPDEs) and we prove the existence of densities for a class of singular SPDEs. Both of these results are…

Probability · Mathematics 2018-09-12 Philipp Schönbauer

This paper is devoted to a study on SDEs with a bounded Borel drift b. We first remark that the original integration by parts formula due to P. Malliavin can be used to deal with derivatives with respect to space variables, then we obtain a…

Probability · Mathematics 2025-07-21 Shizan Fang , Rongrong Tian

Drawing from the theory of stochastic differential equations, we introduce a novel sampling method for known distributions and a new algorithm for diffusion generative models with unknown distributions. Our approach is inspired by the…

Statistics Theory · Mathematics 2024-07-12 Xicheng Zhang