English
Related papers

Related papers: Unbiased Estimation using a Class of Diffusion Pro…

200 papers

We consider the problem of estimating the arithmetic average of a finite collection of real vectors stored in a distributed fashion across several compute nodes subject to a communication budget constraint. Our analysis does not rely on any…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-24 Jakub Konečný , Peter Richtárik

Score-based diffusion models have emerged as powerful techniques for generating samples from high-dimensional data distributions. These models involve a two-phase process: first, injecting noise to transform the data distribution into a…

Machine Learning · Computer Science 2024-10-21 Runjia Li , Qiwei Di , Quanquan Gu

In this paper, we focus on non-asymptotic bounds related to the Euler scheme of an ergodic diffusion with a possibly multiplicative diffusion term (non-constant diffusion coefficient). More precisely, the objective of this paper is to…

Probability · Mathematics 2022-09-23 Gilles Pages , Fabien Panloup

We introduce a simple method for nearly simultaneous computation of all moments needed for quasi maximum likelihood estimation of parameters in discretely observed stochastic differential equations commonly seen in finance. The method…

Computation · Statistics 2015-09-28 Lars Josef Höök , Erik Lindström

Diffusion models are recent state-of-the-art methods for image generation and likelihood estimation. In this work, we generalize continuous-time diffusion models to arbitrary Riemannian manifolds and derive a variational framework for…

Machine Learning · Computer Science 2022-08-18 Chin-Wei Huang , Milad Aghajohari , Avishek Joey Bose , Prakash Panangaden , Aaron Courville

Denoising is intuitively related to projection. Indeed, under the manifold hypothesis, adding random noise is approximately equivalent to orthogonal perturbation. Hence, learning to denoise is approximately learning to project. In this…

Machine Learning · Computer Science 2024-06-04 Frank Permenter , Chenyang Yuan

For a fixed flow-based generative model under a small inference budget, sample quality can depend strongly on where the sampler spends its few function evaluations. Flow matching and Schr\"odinger bridges define probability paths, yet their…

Machine Learning · Computer Science 2026-05-18 Bruno Trentini , Dejan Stancevic , Michael M. Bronstein , Alexander Tong , Luca Ambrogioni

Drift diffusion models (DDMs) have found widespread use in computational neuroscience and other fields. They model evidence accumulation in simple decision tasks as a stochastic process drifting towards a decision barrier. In models where…

Methodology · Statistics 2025-12-12 Sicheng Liu , Alexander Fengler , Michael J. Frank , Matthew T. Harrison

We revisit the work of Mitter and Newton on an information-theoretic interpretation of Bayes' formula through the Gibbs variational principle. This formulation allowed them to pose nonlinear estimation for diffusion processes as a problem…

Optimization and Control · Mathematics 2024-05-02 Maxim Raginsky

This paper aims to conduct a comprehensive theoretical analysis of current diffusion models. We introduce a novel generative learning methodology utilizing the Schr{\"o}dinger bridge diffusion model in latent space as the framework for…

Machine Learning · Statistics 2024-12-24 Yuling Jiao , Lican Kang , Huazhen Lin , Jin Liu , Heng Zuo

Diffusion models have achieved remarkable success in generating samples from unknown data distributions. Most popular stochastic differential equation-based diffusion models perturb the target distribution by adding Gaussian noise,…

Machine Learning · Statistics 2026-05-20 Wenpin Tang , Nizar Touzi , Zikun Zhang , Xun Yu Zhou

Diffusion models have become a leading method for generative modeling of both image and scientific data. As these models are costly to train and \emph{evaluate}, reducing the inference cost for diffusion models remains a major goal.…

Machine Learning · Computer Science 2025-12-01 Haoxuan Chen , Yinuo Ren , Lexing Ying , Grant M. Rotskoff

Diffusions are a fundamental class of models in many fields, including finance, engineering, and biology. Simulating diffusions is challenging as their sample paths are infinite-dimensional and their transition functions are typically…

Methodology · Statistics 2021-06-11 Paul A. Jenkins , Murray Pollock , Gareth O. Roberts , Michael Sørensen

In this article we consider a Monte Carlo-based method to filter partially observed diffusions observed at regular and discrete times. Given access only to Euler discretizations of the diffusion process, we present a new procedure which can…

Numerical Analysis · Mathematics 2020-02-12 Ajay Jasra , Kody Law , Fangyuan Yu

We extend beyond the Euler scales the hydrodynamic theory for quantum and classical integrable models developed in recent years, accounting for diffusive dynamics and local entropy production. We review how the diffusive scale can be…

Statistical Mechanics · Physics 2019-04-24 Jacopo De Nardis , Denis Bernard , Benjamin Doyon

We present a concise, self-contained derivation of diffusion-based generative models. Starting from basic properties of Gaussian distributions (densities, quadratic expectations, re-parameterisation, products, and KL divergences), we…

Machine Learning · Computer Science 2025-11-18 Sepehr Maleki , Negar Pourmoazemi

Denoising diffusion models are a popular class of generative models providing state-of-the-art results in many domains. One adds gradually noise to data using a diffusion to transform the data distribution into a Gaussian distribution.…

Machine Learning · Computer Science 2023-08-21 Francisco Vargas , Will Grathwohl , Arnaud Doucet

This paper studies an approximation method for the log-likelihood function of a nonlinear diffusion process using the bridge of the diffusion. The main result (Theorem \refthm:approx) shows that this approximation converges uniformly to the…

Statistics Theory · Mathematics 2010-01-11 Aleksandar Mijatović , Paul Schneider

The purpose of the present work is to construct estimators for the random effects in a fractional diffusion model using a hybrid estimation method where we combine parametric and nonparametric thechniques. We precisely consider $n$…

Statistics Theory · Mathematics 2025-06-13 Nesrine Chebli , Hamdi Fathallah , Yousri Slaoui

In this paper, we consider the robust adaptive non parametric estimation problem for the drift coefficient in diffusion processes. An adaptive model selection procedure, based on the improved weighted least square estimates, is proposed.…

Statistics Theory · Mathematics 2019-09-24 Evgeny Pchelintsev , Svyatoslav Perelevskiy , Irina Makarova