English
Related papers

Related papers: Computational bottlenecks for denoising diffusions

200 papers

A new method is proposed to numerically extract the diffusivity of a (typically nonlinear) diffusion equation from underlying stochastic particle systems. The proposed strategy requires the system to be in local equilibrium and have…

Statistical Mechanics · Physics 2018-05-09 Peter Embacher , Nicolas Dirr , Johannes Zimmer , Celia Reina

Reversing a diffusion process by learning its score forms the heart of diffusion-based generative modeling and for estimating properties of scientific systems. The diffusion processes that are tractable center on linear processes with a…

Machine Learning · Computer Science 2024-07-12 Raghav Singhal , Mark Goldstein , Rajesh Ranganath

We study a diffusion approximation for a model of stochastic motion of a particle in one spatial dimension. The velocity of the particle is constant but the direction of the motion undergoes random changes with a Poisson clock. Moreover,…

Functional Analysis · Mathematics 2022-04-21 Adam Bobrowski , Tomasz Komorowski

We consider a design problem where experimental conditions (design points $X_i$) are presented in the form of a sequence of i.i.d.\ random variables, generated with an unknown probability measure $\mu$, and only a given proportion…

Methodology · Statistics 2020-08-05 Luc Pronzato , HaiYing Wang

We consider the problem of making nonparametric inference in a class of multi-dimensional diffusions in divergence form, from low-frequency data. Statistical analysis in this setting is notoriously challenging due to the intractability of…

Methodology · Statistics 2025-01-23 Matteo Giordano , Sven Wang

Denoising Diffusion Probabilistic Models (DDPMs) provide the foundation for the recent breakthroughs in generative modeling. Their Markovian structure makes it difficult to define DDPMs with distributions other than Gaussian or discrete. In…

The problem of reconstructing the drift of a diffusion in $\erre^d$, $d\geq 2$, from the transition probability density observed outside a domain is considered. The solution of this problem also solves a new inverse problem for a class of…

Probability · Mathematics 2007-06-13 Sergio Albeverio , Carlo Marinelli

In distributionally robust optimization the probability distribution of the uncertain problem parameters is itself uncertain, and a fictitious adversary, e.g., nature, chooses the worst distribution from within a known ambiguity set. A…

Optimization and Control · Mathematics 2018-05-10 Etienne de Klerk , Daniel Kuhn , Krzysztof Postek

The global estimation problem of the drift function is considered for a large class of ergodic diffusion processes. The unknown drift $S(\cdot)$ is supposed to belong to a nonparametric class of smooth functions of order $k\geq1$, but the…

Statistics Theory · Mathematics 2007-06-13 Arnak Dalalyan

In this paper, we introduce a denoising diffusion algorithm to discover microstructures with nonlinear fine-tuned properties. Denoising diffusion probabilistic models are generative models that use diffusion-based dynamics to gradually…

Machine Learning · Computer Science 2023-06-14 Nikolaos N. Vlassis , WaiChing Sun

The particle-in-cell numerical method of plasma physics balances a trade-off between computational cost and intrinsic noise. Inference on data produced by these simulations generally consists of binning the data to recover the particle…

Plasma Physics · Physics 2022-02-03 John Donaghy , Kai Germaschewski

A discrete-time stochastic process derived from a model of basketball is used to generalize any discrete distribution. The generalized distributions can have one or two more parameters than the parent distribution. Those derived from…

Applications · Statistics 2020-06-25 Rose Baker

In this paper, we introduce a new method of sampling from transition densities of diffusion processes including those unknown in closed forms by solving a partial differential equation satisfied by the quotient of transition densities. We…

Probability · Mathematics 2020-12-04 Yasin Kikabi , Juma Kasozi

We show how any PAC learning algorithm that works under the uniform distribution can be transformed, in a blackbox fashion, into one that works under an arbitrary and unknown distribution $\mathcal{D}$. The efficiency of our transformation…

Machine Learning · Statistics 2023-03-31 Guy Blanc , Jane Lange , Ali Malik , Li-Yang Tan

Modality translation is inherently under-constrained, as multiple cross-modal mappings may yield the same marginals. Recent work has shown that diffusion bridges are effective for this task. However, most existing approaches rely on fully…

Machine Learning · Computer Science 2026-05-13 Eitan Kosman , Gabriele Serussi , Chaim Baskin

We consider the problem of hypothesis testing for discrete distributions. In the standard model, where we have sample access to an underlying distribution $p$, extensive research has established optimal bounds for uniformity testing,…

Machine Learning · Computer Science 2024-12-03 Maryam Aliakbarpour , Piotr Indyk , Ronitt Rubinfeld , Sandeep Silwal

Diffusion-based generative models (DBGMs) perturb data to a target noise distribution and reverse this process to generate samples. The choice of noising process, or inference diffusion process, affects both likelihoods and sample quality.…

Machine Learning · Computer Science 2023-03-06 Raghav Singhal , Mark Goldstein , Rajesh Ranganath

Diffusion models are well known for their ability to generate a high-fidelity image for an input prompt through an iterative denoising process. Unfortunately, the high fidelity also comes at a high computational cost due the inherently…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Qinchan Li , Kenneth Chen , Changyue Su , Wittawat Jitkrittum , Qi Sun , Patsorn Sangkloy

We consider stochastic control with discretionary stopping for the drift of a diffusion process over an infinite time horizon. The objective is to choose a control process and a stopping time to minimize the expectation of a convex terminal…

Optimization and Control · Mathematics 2025-06-24 Václav E. Beneš , Georgy Gaitsgori , Ioannis Karatzas

Recently, progress has been made in the theory of turbulence, which provides a framework on how a deterministic process changes to a stochastic one owing to the change in thermodynamic states. It is well known that, in the framework of…

Chaotic Dynamics · Physics 2025-10-27 Liteng Yang , Yuliang Liu , Jing Liu , Hongxuan Li , Wei Chen