English
Related papers

Related papers: Thermodynamic Performance Limits for Score-Based D…

200 papers

Score-based modeling through stochastic differential equations (SDEs) has provided a new perspective on diffusion models, and demonstrated superior performance on continuous data. However, the gradient of the log-likelihood function, i.e.,…

Machine Learning · Computer Science 2023-03-07 Haoran Sun , Lijun Yu , Bo Dai , Dale Schuurmans , Hanjun Dai

We derive a universal thermodynamic bound constraining directional transport in both discrete and continuous nonequilibrium systems. For continuous-time Markov jump processes and overdamped diffusions governed by Fokker--Planck equations,…

Statistical Mechanics · Physics 2025-08-26 Mesfin Taye

Score-based diffusion models are a class of generative models whose dynamics is described by stochastic differential equations that map noise into data. While recent works have started to lay down a theoretical foundation for these models,…

For sensory networks, we determine the rate with which they acquire information about the changing external conditions. Comparing this rate with the thermodynamic entropy production that quantifies the cost of maintaining the network, we…

Statistical Mechanics · Physics 2013-04-08 A. C. Barato , D Hartich , U. Seifert

Fluctuations in biochemical networks, e.g., in a living cell, have a complex origin that precludes a description of such systems in terms of bipartite or multipartite processes, as is usually done in the framework of stochastic and/or…

Statistical Mechanics · Physics 2020-01-29 R. Chétrite , M. L. Rosinberg , T. Sagawa , G. Tarjus

Diffusion models achieve state-of-the-art performance in various generation tasks. However, their theoretical foundations fall far behind. This paper studies score approximation, estimation, and distribution recovery of diffusion models,…

Machine Learning · Computer Science 2023-02-15 Minshuo Chen , Kaixuan Huang , Tuo Zhao , Mengdi Wang

Seifert derived an exact fluctuation relation for diffusion processes using the concept of "stochastic system entropy". In this note we extend his formalism to entropic transport. We introduce the notion of relative stochastic entropy, or…

Statistical Mechanics · Physics 2012-11-30 Matteo Smerlak

The second law of thermodynamics states that entropy production cannot be negative. Recent developments concerning uncertainty relations in stochastic thermodynamics, such as thermodynamic uncertainty relations and speed limits, have…

Statistical Mechanics · Physics 2023-10-09 Tomohiro Nishiyama , Yoshihiko Hasegawa

One of the key objectives in investigating small stochastic systems is the development of micrometer-sized engines and the understanding of their thermodynamics. However, the primary mathematical tool used for this purpose, the overdamped…

Statistical Mechanics · Physics 2025-03-31 Shakul Awasthi , Hyunggyu Park , Jae Sung Lee

Bounding and estimating entropy production has long been an important goal of nonequilibrium thermodynamics. We recently derived a lower bound on the total and subsystem entropy production rates of continuous stochastic systems. This…

Statistical Mechanics · Physics 2024-02-29 Matthew P. Leighton , David A. Sivak

I give a quick overview of some of the theoretical background necessary for using modern non-equilibrium statistical physics to investigate the thermodynamics of computation. I first present some of the necessary concepts from information…

Statistical Mechanics · Physics 2019-06-20 David H. Wolpert

In the previous papers (Kui\'{c} et al. in Found Phys 42:319-339, 2012; Kui\'{c} in arXiv:1506.02622, 2015), it was demonstrated that applying the principle of maximum information entropy by maximizing the conditional information entropy,…

Statistical Mechanics · Physics 2016-06-14 Domagoj Kuic

We present a new outlook on the climate system thermodynamics, studying some of its macroscopic properties in terms of the 1st and 2nd laws of thermodynamics. We review and clarify the notion of efficiency of the climate system by…

Atmospheric and Oceanic Physics · Physics 2011-10-11 Valerio Lucarini

In this work, we investigate the relation between the concept of ``information rate'', an information geometric method for measuring the speed of the time evolution of the statistical states of a stochastic process, and stochastic…

Statistical Mechanics · Physics 2023-03-29 Adrian-Josue Guel-Cortez , Eun-jin Kim

We consider a general discrete state-space system with both unidirectional and bidirectional links. In contrast to bidirectional links, there is no reverse transition along the unidirectional links. Herein, we first compute the statistical…

Statistical Mechanics · Physics 2021-01-04 Deepak Gupta , Daniel M. Busiello

This thesis investigates the interactions of different degrees of freedom of one joint system within the theory of stochastic thermodynamics. First, a comprehensive introduction to the subjects of stochastic processes, information theory…

Statistical Mechanics · Physics 2020-07-31 Jannik Ehrich

With the help of a general expression of the entropies in extensive and nonextensive systems, some important relations between thermodynamics and statistical mechanics are revealed through the views of thermodynamics and statistic physics.…

Statistical Mechanics · Physics 2009-11-13 Zhifu Huang , Congjie Ou , A. Le Mehaute , Qiuping A. Wang , Jincan Chen

We propose thermodynamically consistent models for viscoelastic fluids with a stress diffusion term. In particular, we derive variants of compressible/incompressible Maxwell/Oldroyd-B models with a stress diffusion term in the evolution…

Fluid Dynamics · Physics 2018-03-14 Josef Málek , Vít Průša , Tomáš Skřivan , Endre Süli

By considering general Markov stochastic dynamics and its coarse-graining, we study the framework of stochastic thermodynamics for the original and reduced descriptions corresponding to different scales. We are especially concerned with the…

Statistical Mechanics · Physics 2015-01-29 Yohei Nakayama , Kyogo Kawaguchi

In systems described by the scattering theory, there is an upper bound, lower than Carnot, on the efficiency of steady-state heat to work conversion at a given output power. We show that interacting systems can overcome such bound and…

Statistical Mechanics · Physics 2018-08-27 Rongxiang Luo , Giuliano Benenti , Giulio Casati , Jiao Wang