English
Related papers

Related papers: Variational Optimality of F\"ollmer Processes in G…

200 papers

Diffusion models typically generate data through a fixed denoising trajectory that is shared across all samples. However, generation targets can differ in complexity, suggesting that a single pre-defined diffusion process may not be optimal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yucheng Xing , Xiaodong Liu , Xin Wang

Diffusion models have emerged as a powerful framework for generative tasks in deep learning. They decompose generative modeling into two computational primitives: deterministic neural-network evaluation and stochastic sampling. Current…

Machine Learning · Computer Science 2026-03-31 Nihal Sanjay Singh , Mazdak Mohseni-Rajaee , Shaila Niazi , Kerem Y. Camsari

We consider the problem of simulating diffusion bridges, which are diffusion processes that are conditioned to initialize and terminate at two given states. The simulation of diffusion bridges has applications in diverse scientific fields…

Computation · Statistics 2025-06-19 Jeremy Heng , Valentin De Bortoli , Arnaud Doucet , James Thornton

We develop a principled framework for analyzing and designing noise schedules in diffusion models. We show that one can recast this design problem as an optimal control problem, whose state is the Fisher information of the diffusion process…

Machine Learning · Computer Science 2026-05-22 Seo Taek Kong , Weina Wang , R. Srikant

We develop an analytically tractable single-step diffusion model based on a linear denoiser and present an explicit formula for the Kullback-Leibler divergence between the generated and sampling distribution, taken to be isotropic Gaussian,…

Machine Learning · Computer Science 2025-08-08 Indranil Halder

This paper uses dynamical invariants to describe the evolution of collisionless systems subject to time-dependent gravitational forces without resorting to maximum-entropy probabilities. We show that collisionless relaxation can be viewed…

Astrophysics of Galaxies · Physics 2015-06-03 Jorge Peñarrubia

We consider a class of time-homogeneous diffusion processes on $\mathbb{R}^{n}$ with common invariant measure but varying volatility matrices. In Euclidean space, we show via stochastic control of the diffusion coefficient that the…

Probability · Mathematics 2023-10-31 Bertram Tschiderer

One-step generative modeling has emerged as a leading approach to amortize the inference cost of diffusion and flow-matching models. Among distillation-free methods, MeanFlow training is notoriously unstable, with non-decreasing loss and…

Machine Learning · Computer Science 2026-05-12 Juanwu Lu , Ziran Wang

We show that deliberately breaking detailed balance in generative diffusion processes can accelerate the reverse process without changing the stationary distribution. Considering the Ornstein--Uhlenbeck process, we decompose the dynamics…

Statistical Mechanics · Physics 2026-02-19 Haiqi Lu , Ying Tang

We propose an inference-time scaling approach for pretrained flow models. Recently, inference-time scaling has gained significant attention in LLMs and diffusion models, improving sample quality or better aligning outputs with user…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Jaihoon Kim , Taehoon Yoon , Jisung Hwang , Minhyuk Sung

This work collects some methodological insights for numerical solution of a "minimum-dispersion" control problem for nonlinear stochastic differential equations, a particular relaxation of the covariance steering task. The main ingredient…

Optimization and Control · Mathematics 2025-10-16 Roman Chertovskih , Nikolay Pogodaev , Maxim Staritsyn , A. Pedro Aguiar

Schrodinger Bridges (SBs) are diffusion processes that steer, in finite time, a given initial distribution to another final one while minimizing a suitable cost functional. Although various methods for computing SBs have recently been…

Machine Learning · Computer Science 2025-10-15 George Rapakoulias , Ali Reza Pedram , Fengjiao Liu , Lingjiong Zhu , Panagiotis Tsiotras

We introduce a simple stochastic system able to generate anomalous diffusion both for position and velocity. The model represents a viable description of the Fermi's acceleration mechanism and it is amenable to analytical treatment through…

Statistical Mechanics · Physics 2009-11-10 Freddy Bouchet , Fabio Cecconi , Angelo Vulpiani

We develop a novel approach for the construction of quantile processes governing the stochastic dynamics of quantiles in continuous time. Two classes of quantile diffusions are identified: the first, which we largely focus on, features a…

Probability · Mathematics 2021-09-14 Holly Brannelly , Andrea Macrina , Gareth W. Peters

The nonequilibrium Fokker-Planck dynamics with a non-conservative drift field, in dimension $N\geq 2$, can be related with the non-Hermitian quantum mechanics in a real scalar potential $V$ and in a purely imaginary vector potential -$iA$…

Statistical Mechanics · Physics 2024-05-31 P. Garbaczewski , M. Żaba

We show that the principle of maximum entropy, a variational method appearing in statistical inference, statistical physics, and the analysis of stochastic dynamical systems, admits a geometric description from gauge theory. Using the…

Mathematical Physics · Physics 2023-01-05 Dalton A R Sakthivadivel

Variational approximations are increasingly based on gradient-based optimization of expectations estimated by sampling. Handling discrete latent variables is then challenging because the sampling process is not differentiable. Continuous…

Machine Learning · Computer Science 2021-02-09 Tomasz Kuśmierczyk , Arto Klami

Diffusion based generative models have achieved unprecedented fidelity in synthesizing high dimensional data, yet the theoretical mechanisms governing multimodal generation remain poorly understood. Here, we present a theoretical framework…

Machine Learning · Computer Science 2026-02-10 Emil Albrychiewicz , Andrés Franco Valiente , Li-Ching Chen

We build a new class of generative algorithms capable of efficiently learning an arbitrary target distribution from possibly scarce, high-dimensional data and subsequently generate new samples. These generative algorithms are particle-based…

Machine Learning · Statistics 2024-08-29 Hyemin Gu , Panagiota Birmpa , Yannis Pantazis , Luc Rey-Bellet , Markos A. Katsoulakis

We consider the problem of function approximation by two-layer neural nets with random weights that are "nearly Gaussian" in the sense of Kullback-Leibler divergence. Our setting is the mean-field limit, where the finite population of…

Machine Learning · Computer Science 2024-06-25 Belinda Tzen , Maxim Raginsky