Related papers: Thermodynamic Performance Limits for Score-Based D…
Score-based modeling through stochastic differential equations (SDEs) has provided a new perspective on diffusion models, and demonstrated superior performance on continuous data. However, the gradient of the log-likelihood function, i.e.,…
We derive a universal thermodynamic bound constraining directional transport in both discrete and continuous nonequilibrium systems. For continuous-time Markov jump processes and overdamped diffusions governed by Fokker--Planck equations,…
Score-based diffusion models are a class of generative models whose dynamics is described by stochastic differential equations that map noise into data. While recent works have started to lay down a theoretical foundation for these models,…
For sensory networks, we determine the rate with which they acquire information about the changing external conditions. Comparing this rate with the thermodynamic entropy production that quantifies the cost of maintaining the network, we…
Fluctuations in biochemical networks, e.g., in a living cell, have a complex origin that precludes a description of such systems in terms of bipartite or multipartite processes, as is usually done in the framework of stochastic and/or…
Diffusion models achieve state-of-the-art performance in various generation tasks. However, their theoretical foundations fall far behind. This paper studies score approximation, estimation, and distribution recovery of diffusion models,…
Seifert derived an exact fluctuation relation for diffusion processes using the concept of "stochastic system entropy". In this note we extend his formalism to entropic transport. We introduce the notion of relative stochastic entropy, or…
The second law of thermodynamics states that entropy production cannot be negative. Recent developments concerning uncertainty relations in stochastic thermodynamics, such as thermodynamic uncertainty relations and speed limits, have…
One of the key objectives in investigating small stochastic systems is the development of micrometer-sized engines and the understanding of their thermodynamics. However, the primary mathematical tool used for this purpose, the overdamped…
Bounding and estimating entropy production has long been an important goal of nonequilibrium thermodynamics. We recently derived a lower bound on the total and subsystem entropy production rates of continuous stochastic systems. This…
I give a quick overview of some of the theoretical background necessary for using modern non-equilibrium statistical physics to investigate the thermodynamics of computation. I first present some of the necessary concepts from information…
In the previous papers (Kui\'{c} et al. in Found Phys 42:319-339, 2012; Kui\'{c} in arXiv:1506.02622, 2015), it was demonstrated that applying the principle of maximum information entropy by maximizing the conditional information entropy,…
We present a new outlook on the climate system thermodynamics, studying some of its macroscopic properties in terms of the 1st and 2nd laws of thermodynamics. We review and clarify the notion of efficiency of the climate system by…
In this work, we investigate the relation between the concept of ``information rate'', an information geometric method for measuring the speed of the time evolution of the statistical states of a stochastic process, and stochastic…
We consider a general discrete state-space system with both unidirectional and bidirectional links. In contrast to bidirectional links, there is no reverse transition along the unidirectional links. Herein, we first compute the statistical…
This thesis investigates the interactions of different degrees of freedom of one joint system within the theory of stochastic thermodynamics. First, a comprehensive introduction to the subjects of stochastic processes, information theory…
With the help of a general expression of the entropies in extensive and nonextensive systems, some important relations between thermodynamics and statistical mechanics are revealed through the views of thermodynamics and statistic physics.…
We propose thermodynamically consistent models for viscoelastic fluids with a stress diffusion term. In particular, we derive variants of compressible/incompressible Maxwell/Oldroyd-B models with a stress diffusion term in the evolution…
By considering general Markov stochastic dynamics and its coarse-graining, we study the framework of stochastic thermodynamics for the original and reduced descriptions corresponding to different scales. We are especially concerned with the…
In systems described by the scattering theory, there is an upper bound, lower than Carnot, on the efficiency of steady-state heat to work conversion at a given output power. We show that interacting systems can overcome such bound and…