English
Related papers

Related papers: Relations between entropy rate, entropy production…

200 papers

We establish a fundamental connection between score-based diffusion models and non-equilibrium thermodynamics by deriving performance limits based on entropy rates. Our main theoretical contribution is a lower bound on the negative…

Machine Learning · Computer Science 2025-10-08 Nathan X. Kodama , Michael Hinczewski

Systems with interacting degrees of freedom play a prominent role in stochastic thermodynamics. Our aim is to use the concept of detached path probabilities and detached entropy production for bipartite Markov processes and elaborate on a…

Statistical Mechanics · Physics 2017-10-17 Jannik Ehrich , Andreas Engel

We discuss a relationship between information geometry and the Glansdorff-Prigogine criterion for stability. For the linear master equation, we found a relation between the line element and the excess entropy production rate. This relation…

Statistical Mechanics · Physics 2021-12-14 Sosuke Ito

Physical systems that power motion and create structure in a fixed amount of time dissipate energy and produce entropy. Whether living or synthetic, systems performing these dynamic functions must balance dissipation and speed. Here, we…

Statistical Mechanics · Physics 2020-12-18 Schuyler B. Nicholson , Luis Pedro Garcia-Pintos , Adolfo del Campo , Jason R. Green

Semi-Markov processes play an important role in the effective description of partially accessible systems in stochastic thermodynamics. They occur, for instance, in coarse-graining procedures such as state lumping and when analyzing waiting…

Statistical Mechanics · Physics 2026-01-19 Alexander M. Maier , Jonas H. Fritz , Udo Seifert

Computing the stochastic entropy production associated with the evolution of a stochastic dynamical system is a well-established problem. In a small number of cases such as the Ornstein-Uhlenbeck process, of which we give a complete…

Statistical Mechanics · Physics 2020-08-26 Richard J Martin , Ian J Ford

Statistical divergences are important tools in data analysis, information theory, and statistical physics, and there exist well known inequalities on their bounds. However, in many circumstances involving temporal evolution, one needs…

Data Analysis, Statistics and Probability · Physics 2025-03-25 Jan Karbowski

There are three ways to conceptualize entropy: entropy as an extensive thermodynamic quantity of physical systems (Clausius, Boltzmann, Gibbs), entropy as a measure for information production of ergodic sources (Shannon), and entropy as a…

Statistical Mechanics · Physics 2018-11-05 Stefan Thurner , Bernat Corominas-Murtra , Rudolf Hanel

In the previous papers (Kui\'{c} et al. in Found Phys 42:319-339, 2012; Kui\'{c} in arXiv:1506.02622, 2015), it was demonstrated that applying the principle of maximum information entropy by maximizing the conditional information entropy,…

Statistical Mechanics · Physics 2016-06-14 Domagoj Kuic

The past two decades have seen a revolution in statistical physics, generalizing it to apply to systems of arbitrary size, evolving while arbitrarily far from equilibrium. Many of these new results are based on analyzing the dynamics of the…

Statistical Mechanics · Physics 2022-08-08 David H. Wolpert

We formulate a stochastic description of entropy production in scattering theory for coherent transport. We distinguish between the information entropy change due to partial knowledge of the leads' state and the thermodynamic entropy change…

Mesoscale and Nanoscale Physics · Physics 2026-04-29 Ludovico Tesser , Henning Kirchberg , Matteo Acciai , Janine Splettstoesser

The entropy production rate of nonequilibrium systems is studied via the Fokker-Planck equation. This approach, based on the entropy production rate equation given by Schnakenberg from a master equation, requires information of the…

Statistical Mechanics · Physics 2015-08-10 Haitao Yu , Jiulin Du

The amount of information generated by a discrete time stochastic processes in a single step can be quantified by the entropy rate. We investigate the differences between two discrete time walk models, the discrete time quantum walk and the…

Quantum Physics · Physics 2014-03-04 Bálint Kollár , Mátyás Koniorczyk

We develop a statistical mechanical interpretation of algorithmic information theory by introducing the notion of thermodynamic quantities, such as free energy, energy, statistical mechanical entropy, and specific heat, into algorithmic…

Information Theory · Computer Science 2009-04-09 Kohtaro Tadaki

We study the entropy rate of pattern sequences of stochastic processes, and its relationship to the entropy rate of the original process. We give a complete characterization of this relationship for i.i.d. processes over arbitrary…

Information Theory · Computer Science 2007-07-13 George M. Gemelos , Tsachy Weissman

Estimating the dissipation, or the entropy production rate (EPR), can provide insights into the underlying mechanisms of nonequilibrium driven processes. Experimentally, however, only partial information can be accessed, and the ability to…

Statistical Mechanics · Physics 2022-12-29 Uri Kapustin , Aishani Ghosal , Gili Bisker

Thermodynamic uncertainty relations (TURs) are the inequalities which give lower bounds on the entropy production rate using only the mean and the variance of fluctuating currents. Since the TURs do not refer to the full details of the…

Statistical Mechanics · Physics 2020-06-25 Shun Otsubo , Sosuke Ito , Andreas Dechant , Takahiro Sagawa

We explore the dynamics of information systems. We show that the driving force for information dynamics is determined by both the information landscape and information flux which determines the equilibrium time reversible and the…

Statistical Mechanics · Physics 2018-02-14 Qian Zeng , Jin Wang

Biological systems process information under noisy environment. Sensory adaptation model of E. coli is suitable for investigation because of its simplicity. To understand the adaptation processing quantitatively, stochastic thermodynamic…

Molecular Networks · Quantitative Biology 2019-07-16 Keita Ashida , Kotaro Oka

Entropy is a measure of self-information which is used to quantify losses. Entropy was developed in thermodynamics, but is also used to compare probabilities based on their deviating information content. Corresponding model uncertainty is…

Probability · Mathematics 2018-01-23 Alois Pichler , Ruben Schlotter