English
Related papers

Related papers: Speed-accuracy relations for diffusion models: Wis…

200 papers

Diffusion models (DMs) have been adopted across diverse fields with its remarkable abilities in capturing intricate data distributions. In this paper, we propose a Fast Diffusion Model (FDM) to significantly speed up DMs from a stochastic…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Zike Wu , Pan Zhou , Kenji Kawaguchi , Hanwang Zhang

A theoretical framework is developed for the phenomenon of non-Gaussian normal diffusion that has experimentally been observed in several heterogeneous systems. From the Fokker-Planck equation with the dynamical structure with largely…

Statistical Mechanics · Physics 2020-11-04 Sumiyoshi Abe

In this work, the primary goal is to establish rigorous connection between the Fokker-Planck equation of neural networks with its microscopic model: the diffusion-jump stochastic process that captures the mean field behavior of collections…

Analysis of PDEs · Mathematics 2021-11-01 Jian-guo Liu , Ziheng Wang , Yuan Zhang , Zhennan Zhou

We obtain new transport-entropy inequalities and, as a by-product, new deviation estimates for the laws of two kinds of discrete stochastic approximation schemes. The first one refers to the law of an Euler like discretization scheme of a…

Probability · Mathematics 2013-02-01 Max Fathi , Noufel Frikha

Diffusive transport of a particle in spatially correlated random energy landscape having exponential density of states has been considered. We exactly calculate the diffusivity in the nondispersive quasi-equilibrium transport regime and…

Disordered Systems and Neural Networks · Physics 2018-02-14 S. V. Novikov

Generative diffusion models have achieved spectacular performance in many areas of machine learning and generative modeling. While the fundamental ideas behind these models come from non-equilibrium physics, variational inference and…

Machine Learning · Statistics 2024-06-21 Luca Ambrogioni

We investigate nonequilibrium steady-state dynamics in both continuous- and discrete-state stochastic processes. Our analysis focuses on planar diffusion dynamics and their coarse-grained approximations by discrete-state Markov chains.…

Statistical Mechanics · Physics 2026-05-12 Ramón Nartallo-Kaluarachchi , Renaud Lambiotte , Alain Goriely

Diffusion models have been successfully adapted to text generation tasks by mapping the discrete text into the continuous space. However, there exist nonnegligible gaps between training and inference, owing to the absence of the forward…

Computation and Language · Computer Science 2023-05-09 Zecheng Tang , Pinzheng Wang , Keyan Zhou , Juntao Li , Ziqiang Cao , Min Zhang

We survey continuous-time generative modeling methods based on transporting a simple reference distribution to a data distribution via stochastic or deterministic dynamics. We present a unified framework in which diffusion models,…

Machine Learning · Computer Science 2026-05-11 Aditya Ranganath , Mukesh Singhal

We present a formulation of an optimal control problem for a two-dimensional diffusion process governed by a Fokker-Planck equation to achieve a nonequilibrium steady state with a desired circulation while accelerating convergence toward…

Systems and Control · Electrical Eng. & Systems 2026-03-26 Norihisa Namura , Hiroya Nakao

We derive the hydrodynamic limit of a kinetic equation where the interactions in velocity are modelled by a linear operator (Fokker-Planck or Linear Boltzmann) and the force in the Vlasov term is a stochastic process with high amplitude and…

Analysis of PDEs · Mathematics 2020-03-23 Arnaud Debussche , Julien Vovelle

Many approaches to modelling reaction-diffusion systems with anomalous transport rely on deterministic equations and ignore fluctuations arising due to finite particle numbers. Starting from an individual-based model we use a…

Statistical Mechanics · Physics 2019-05-29 Joseph W. Baron , Tobias Galla

Using the scheme of mesoscopic nonequilibrium thermodynamics, we construct the one- and two- particle Fokker-Planck equations for a system of interacting Brownian particles. By means of these equations we derive the corresponding balance…

Soft Condensed Matter · Physics 2009-11-07 M. Mayorga , L. Romero-Salazar , J. M. Rubi

Although an intimate relation between entropy and diffusion has been advocated for many years and even seems to have been verified in theory and experiments, a quantitatively reliable study, and any derivation of an algebraic relation…

Statistical Mechanics · Physics 2020-07-22 Subhajit Acharya , Biman Bagchi

Identification of nonlinear dynamical systems is crucial across various fields, facilitating tasks such as control, prediction, optimization, and fault detection. Many applications require methods capable of handling complex systems while…

Machine Learning · Statistics 2024-11-05 Luc Brogat-Motte , Riccardo Bonalli , Alessandro Rudi

Optimal processes in stochastic thermodynamics are a frontier for understanding the control and design of non-equilibrium systems, with broad practical applications in biology, chemistry, and nanoscale/mesoscale systems. Optimal mass…

Statistical Mechanics · Physics 2026-01-15 Atul Tanaji Mohite , Heiko Rieger

We compare two approaches to nonequilibrium thermodynamics, the two-generator bracket formulation of time-evolution equations for averages and the macroscopic fluctuation theory, for an isothermal driven diffusive system under steady state…

Statistical Mechanics · Physics 2010-11-10 Hans Christian Ottinger

When a chaotic, ergodic Hamiltonian system with $N$ degrees of freedom is subject to sufficiently rapid periodic driving, its energy evolves diffusively. We derive a Fokker-Planck equation that governs the evolution of the system's…

Statistical Mechanics · Physics 2021-03-01 Wade Hodson , Christopher Jarzynski

Complex behaviour in many systems arises from the stochastic interactions of spatially distributed particles or agents. Stochastic reaction-diffusion processes are widely used to model such behaviour in disciplines ranging from biology to…

Statistical Mechanics · Physics 2016-08-23 David Schnoerr , Ramon Grima , Guido Sanguinetti

Computing the stochastic entropy production associated with the evolution of a stochastic dynamical system is a well-established problem. In a small number of cases such as the Ornstein-Uhlenbeck process, of which we give a complete…

Statistical Mechanics · Physics 2020-08-26 Richard J Martin , Ian J Ford