English
Related papers

Related papers: Cross-fluctuation phase transitions reveal samplin…

200 papers

Diffusion models, which convert noise into new data instances by learning to reverse a diffusion process, have become a cornerstone in contemporary generative modeling. In this work, we develop non-asymptotic convergence theory for a…

Machine Learning · Computer Science 2024-08-06 Gen Li , Yuting Wei , Yuejie Chi , Yuxin Chen

Switching dynamical systems provide a powerful, interpretable modeling framework for inference in time-series data in, e.g., the natural sciences or engineering applications. Since many areas, such as biology or discrete-event systems, are…

Machine Learning · Computer Science 2021-09-30 Lukas Köhs , Bastian Alt , Heinz Koeppl

Generative diffusion models have achieved spectacular performance in many areas of machine learning and generative modeling. While the fundamental ideas behind these models come from non-equilibrium physics, variational inference and…

Machine Learning · Statistics 2024-06-21 Luca Ambrogioni

We study the nonequilibrium phase transition in a model of aggregation of masses allowing for diffusion, aggregation on contact and fragmentation. The model undergoes a dynamical phase transition in all dimensions. The steady state mass…

Statistical Mechanics · Physics 2015-06-25 Satya N. Majumdar , Supriya Krishnamurthy , Mustansir Barma

Motivated by networked systems in random environment and controlled hybrid stochastic dynamic systems, this work focuses on modeling and analysis of a class of switching diffusions consisting of continuous and discrete components. Novel…

Probability · Mathematics 2017-06-19 Dang H. Nguyen , George Yin

Diffusion models have recently attained significant interest within the community owing to their strong performance as generative models. Furthermore, its application to inverse problems have demonstrated state-of-the-art performance.…

Image and Video Processing · Electrical Eng. & Systems 2022-03-22 Hyungjin Chung , Byeongsu Sim , Jong Chul Ye

Low-dimensional dynamical systems are fruitful models for mixing in fluid and granular flows. We study a one-dimensional discontinuous dynamical system (termed "cutting and shuffling" of a line segment), and we present a comprehensive…

Dynamical Systems · Mathematics 2018-08-24 Mengying Wang , Ivan C. Christov

This work explores the theoretical and practical foundations of denoising diffusion probabilistic models (DDPMs) and score-based generative models, which leverage stochastic processes and Brownian motion to model complex data distributions.…

Machine Learning · Computer Science 2024-12-30 Jathin Korrapati , Tanish Baranwal , Rahul Shah

Products between phase-type distributed random variables and any independent, positive and continuous random variable are studied. Their asymptotic properties are established, and an expectation-maximization algorithm for their effective…

Probability · Mathematics 2021-11-25 Hansjoerg Albrecher , Martin Bladt , Mogens Bladt , Jorge Yslas

The performance of flow matching and diffusion models can be greatly improved at inference time using reward alignment algorithms, yet efficiency remains a major limitation. While several algorithms were proposed, we demonstrate that a…

Machine Learning · Computer Science 2026-02-12 Peter Holderrieth , Uriel Singer , Tommi Jaakkola , Ricky T. Q. Chen , Yaron Lipman , Brian Karrer

Discrete flow models offer a powerful framework for learning distributions over discrete state spaces and have demonstrated superior performance compared to the discrete diffusion models. However, their convergence properties and error…

Statistics Theory · Mathematics 2026-05-27 Zhengyan Wan , Yidong Ouyang , Qiang Yao , Liyan Xie , Fang Fang , Hongyuan Zha , Guang Cheng

We consider fluctuations of the time-averaged current in the one-dimensional weakly-asymmetric exclusion process on a ring. The optimal density profile which sustains a given fluctuation exhibits an instability for low enough currents,…

Statistical Mechanics · Physics 2013-10-29 Carlos P. Espigares , Pedro L. Garrido , Pablo I. Hurtado

We survey continuous-time generative modeling methods based on transporting a simple reference distribution to a data distribution via stochastic or deterministic dynamics. We present a unified framework in which diffusion models,…

Machine Learning · Computer Science 2026-05-11 Aditya Ranganath , Mukesh Singhal

Diffusion models are loosely modelled based on non-equilibrium thermodynamics, where \textit{diffusion} refers to particles flowing from high-concentration regions towards low-concentration regions. In statistics, the meaning is quite…

Machine Learning · Computer Science 2023-12-19 Inga Strümke , Helge Langseth

Score-based diffusion models have emerged as powerful techniques for generating samples from high-dimensional data distributions. These models involve a two-phase process: first, injecting noise to transform the data distribution into a…

Machine Learning · Computer Science 2024-10-21 Runjia Li , Qiwei Di , Quanquan Gu

Diffusion-based generative models learn to iteratively transfer unstructured noise to a complex target distribution as opposed to Generative Adversarial Networks (GANs) or the decoder of Variational Autoencoders (VAEs) which produce samples…

Machine Learning · Computer Science 2022-10-26 Sarthak Mittal , Guillaume Lajoie , Stefan Bauer , Arash Mehrjou

Diffusion models (DMs) are a class of generative machine learning methods that sample a target distribution by transforming samples of a trivial (often Gaussian) distribution using a learned stochastic differential equation. In standard…

Statistical Mechanics · Physics 2024-08-15 Luke Causer , Grant M. Rotskoff , Juan P. Garrahan

Denoising diffusion models are a popular class of generative models providing state-of-the-art results in many domains. One adds gradually noise to data using a diffusion to transform the data distribution into a Gaussian distribution.…

Machine Learning · Computer Science 2023-08-21 Francisco Vargas , Will Grathwohl , Arnaud Doucet

Generative diffusion models have recently emerged as a leading approach for generating high-dimensional data. In this paper, we show that the dynamics of these models exhibit a spontaneous symmetry breaking that divides the generative…

Machine Learning · Computer Science 2023-10-27 Gabriel Raya , Luca Ambrogioni

Stochastic differential equations (SDEs) or diffusions are continuous-valued continuous-time stochastic processes widely used in the applied and mathematical sciences. Simulating paths from these processes is usually an intractable problem,…

Computation · Statistics 2020-05-27 Qi Wang , Vinayak Rao , Yee Whye Teh