Related papers: Thermodynamics of statistical inference by cells
Quantitative studies of cell metabolism are often based on large chemical reaction network models. A steady state approach is suited to analyze phenomena on the timescale of cell growth and circumvents the problem of incomplete experimental…
A system responding to a stochastic driving signal can be interpreted as computing, by means of its dynamics, an implicit model of the environmental variables. The system's state retains information about past environmental fluctuations,…
Virtually every organism gathers information about its noisy environment and builds models from that data, mostly using neural networks. Here, we use stochastic thermodynamics to analyse the learning of a classification rule by a neural…
The relationship between thermodynamics and statistical physics is valid in the thermodynamic limit - when the number of particles becomes very large. Here, we study thermodynamics in the opposite regime - at both the nano scale, and when…
Statistical divergences are important tools in data analysis, information theory, and statistical physics, and there exist well known inequalities on their bounds. However, in many circumstances involving temporal evolution, one needs…
A unified thermodynamic formalism describing the efficiency of learning is proposed. First, we derive an inequality, which is more strength than Clausius's inequality, revealing the lower bound of the entropy-production rate of a subsystem.…
We study nonequilibrium thermodynamics of complex information flows induced by interactions between multiple fluctuating systems. Characterizing nonequilibrium dynamics by causal networks (i.e., Bayesian networks), we obtain novel…
This letter exposes a tight connection between the thermodynamic efficiency of information processing and predictive inference. A generalized lower bound on dissipation is derived for partially observable information engines which are…
Statistical thermodynamics has a universal appeal that extends beyond molecular systems, and yet, as its tools are being transplanted to fields outside physics, the fundamental question, \textit{what is thermodynamics?}, has remained…
In recent years, the unified theory of information and thermodynamics has been intensively discussed in the context of stochastic thermodynamics. The unified theory reveals that information theory would be useful to understand…
An information theoretic approach inspired by quantum statistical mechanics was recently proposed as a means to optimize network models and to assess their likelihood against synthetic and real-world networks. Importantly, this method does…
This paper provides a perspective on applying the concepts of information thermodynamics, developed recently in non-equilibrium statistical physics, to problems in theoretical neuroscience. Historically, information and energy in…
The use of statistical methods to model gravitational systems is crucial to physics practice, but the extent to which thermodynamics and statistical mechanics genuinely apply to these systems is a contentious issue. This paper provides new…
In traditional thermodynamical and statistical-mechanical approaches one has (some) detailed knowledge of the principles governing the microdynamics of a system. However in many instances we may not have a Hamiltonian or good information…
Cells can be considered as systems that utilize changes in thermodynamic entropy as information. Therefore, they serve as useful models for investigating the relationships between entropy production and information transmission, i.e.,…
We establish a fundamental connection between score-based diffusion models and non-equilibrium thermodynamics by deriving performance limits based on entropy rates. Our main theoretical contribution is a lower bound on the negative…
Cells produce RNA and proteins via molecular templating networks. We show that information transmission in such networks is bounded by functions of a simple thermodynamic property of the network, regardless of complexity. Surprisingly,…
The past twenty years have seen a resurgence of interest in nonequilibrium thermodynamics, thanks to advances in the theory of stochastic processes and in their thermodynamic interpretation. Fluctuation theorems provide fundamental…
Understanding the connections between information and thermodynamics has been among the most visible applications of stochastic thermodynamics. While recent theoretical advances have established that the second law of thermodynamics sets…
We study the transition probabilities of a two-point measurement on a quantum system, initially prepared in a thermal state. We find two independent constraints on the difference between transition probabilities when the system is prepared…