English
Related papers

Related papers: Speed-accuracy relations for diffusion models: Wis…

200 papers

Inferring a diffusion equation from discretely-observed measurements is a statistical challenge of significant importance in a variety of fields, from single-molecule tracking in biophysical systems to modeling financial instruments.…

Machine Learning · Statistics 2023-12-12 Yinuo Ren , Yiping Lu , Lexing Ying , Grant M. Rotskoff

Learning dynamical systems from incomplete or noisy data is inherently ill-posed, as a single observation may correspond to multiple plausible futures. While physics-based ensemble forecasting relies on perturbing initial states to capture…

Machine Learning · Computer Science 2026-02-27 Siddharth Rout , Eldad Haber , Stephane Gaudreault

A recently introduced particle-based model for fluid dynamics with continuous velocities is generalized to model fluids with excluded volume effects. This is achieved through the use of biased stochastic multi-particle collisions which…

Soft Condensed Matter · Physics 2007-05-23 Erkan Tuzel , Thomas Ihle , Daniel M. Kroll

A positive rate of entropy production at steady state is a distinctive feature of truly non-equilibrium processes. Exact results, while being often limited to simple models, offer a unique opportunity to explore the thermodynamic features…

Statistical Mechanics · Physics 2022-06-29 Henry Alston , Luca Cocconi , Thibault Bertrand

High-quality spatiotemporal traffic data is crucial for intelligent transportation systems (ITS) and their data-driven applications. Inevitably, the issue of missing data caused by various disturbances threatens the reliability of data…

Machine Learning · Computer Science 2024-10-22 Shaokang Cheng , Nada Osman , Shiru Qu , Lamberto Ballan

We derive the exact evolution equation for the probability density function of particle displacements generated by arbitrary Gaussian velocity processes, when neither Markovianity and nor stationarity are assumed. Starting from the…

Statistical Mechanics · Physics 2026-05-19 Alessandro Taloni , Gianni Pagnini , Aleksei Chechkin

The stochastic motion in a nonhomogeneous medium with traps is studied and diffusion properties of that system are discussed. The particle is subjected to a stochastic stimulation obeying a general L\'evy stable statistics and experiences…

Statistical Mechanics · Physics 2015-06-11 Tomasz Srokowski

Diffusion-based generative models learn to iteratively transfer unstructured noise to a complex target distribution as opposed to Generative Adversarial Networks (GANs) or the decoder of Variational Autoencoders (VAEs) which produce samples…

Machine Learning · Computer Science 2022-10-26 Sarthak Mittal , Guillaume Lajoie , Stefan Bauer , Arash Mehrjou

We introduce the Fixed Point Diffusion Model (FPDM), a novel approach to image generation that integrates the concept of fixed point solving into the framework of diffusion-based generative modeling. Our approach embeds an implicit fixed…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Xingjian Bai , Luke Melas-Kyriazi

Virtually every organism gathers information about its noisy environment and builds models from that data, mostly using neural networks. Here, we use stochastic thermodynamics to analyse the learning of a classification rule by a neural…

Statistical Mechanics · Physics 2017-01-31 Sebastian Goldt , Udo Seifert

In this work we present a two-dimensional kinetic traffic model which takes into account speed changes both when vehicles interact along the road lanes and when they change lane. Assuming that lane changes are less frequent than…

Numerical Analysis · Mathematics 2018-10-18 Michael Herty , Andrea Tosin , Giuseppe Visconti , Mattia Zanella

The diffusion model has demonstrated promising results in image generation, recently becoming mainstream and representing a notable advancement for many generative modeling tasks. Prior applications of the diffusion model for both fast…

Instrumentation and Detectors · Physics 2025-06-18 Cheng Jiang , Sitian Qian , Huilin Qu

In this paper, we study the diffusion approximation for singularly perturbed stochastic reaction-diffusion equation with a fast oscillating term. The asymptotic limit for the original system is obtained, where an extra Gaussian term…

Probability · Mathematics 2021-06-08 Longjie Xie , Li Yang

We present a numerical investigation of stochastic transport in ideal fluids. According to Holm (Proc Roy Soc, 2015) and Cotter et al. (2017), the principles of transformation theory and multi-time homogenisation, respectively, imply a…

Fluid Dynamics · Physics 2018-09-28 Colin J. Cotter , Dan Crisan , Darryl D. Holm , Wei Pan , Igor Shevchenko

These lecture notes introduce the statistical analysis of continuous-time generative models built from Markov dynamics. We begin with the stochastic-calculus foundations of score-based diffusion models, including time reversal, score…

Statistics Theory · Mathematics 2026-04-27 Eddie Aamari , Arthur Stéphanovitch

We investigate the Cauchy problem and the diffusion asymptotics for a spatially inhomogeneous kinetic model associated to a nonlinear Fokker-Planck operator. We derive the global well-posedness result with instantaneous smoothness effect,…

Analysis of PDEs · Mathematics 2024-03-13 Francesca Anceschi , Yuzhe Zhu

Using the recently developed ``Maximum Entropy'' (or ``least biased'') distribution function to truncate the moment hierarchy arising from kinetic theory, we formulate a far-from-equilibrium macroscopic theory that provides the possibility…

High Energy Physics - Phenomenology · Physics 2023-08-03 Chandrodoy Chattopadhyay , Ulrich Heinz , Thomas Schaefer

Parametric estimation for diffusion processes is considered for high frequency observations over a fixed time interval. The processes solve stochastic differential equations with an unknown parameter in the diffusion coefficient. We find…

Methodology · Statistics 2017-04-03 Nina Munkholt Jakobsen , Michael Sørensen

State-of-the-art neural networks require extreme computational power to train. It is therefore natural to wonder whether they are optimally trained. Here we apply a recent advancement in stochastic thermodynamics which allows bounding the…

Machine Learning · Statistics 2023-07-28 Inbar Seroussi , Alexander A. Alemi , Moritz Helias , Zohar Ringel

We apply the stochastic thermodynamics formalism to describe the dynamics of systems of complex Langevin and Fokker-Planck equations. We provide in particular a simple and general recipe to calculate thermodynamical currents, dissipated and…

Statistical Mechanics · Physics 2019-01-30 Simone Borlenghi , Anna Delin