Related papers: The thermodynamics of prediction
Biological systems have to build models from their sensory data that allow them to efficiently process previously unseen inputs. Here, we study a neural network learning a linearly separable rule using examples provided by a teacher. We…
We attempt to characterize irreversibility of a dynamical system from the existence of different forward and backward mathematical representations depending on the direction of the time arrow. Such different representations have been…
Stochastic chains represent a wide and key variety of phenomena in many branches of science within the context of Information Theory and Thermodynamics. They are typically approached by a sequence of independent events or by a memoryless…
We introduce an alternative route for obtaining reliable cyclic engines, based on interacting Brownian particles under time-periodic drivings. General expressions for the thermodynamic fluxes, such as power and heat, are obtained using the…
Small thermodynamic systems exhibit peculiar behavior different from that observed in long-scale systems. Non-equilibrium processes taking place in those systems are strongly influenced by the presence of fluctuations which can be large.…
The thermodynamic formalism allows one to access the chaotic properties of equilibrium and out-of-equilibrium systems, by deriving those from a dynamical partition function. The definition that has been given for this partition function…
We relate the information exchange between two stochastic systems to the nonequilibrium entropy production in the whole system. By deriving a general formula that decomposes the total entropy production into the thermodynamic and…
Quantifying energy flows at nanometer scales promises to guide future research in a variety of disciplines, from microscopic control and manipulation, to autonomously operating molecular machines. A general understanding of the…
The selection of an equilibrium state by maximising the entropy of a system, subject to certain constraints, is often powerfully motivated as an exercise in logical inference, a procedure where conclusions are reached on the basis of…
The high accuracy exhibited by biological information transcription processes is due to kinetic proofreading, i.e., by a mechanism which reduces the error rate of the information-handling process by driving it out of equilibrium. We provide…
For the system with inhomogeneous distribution of macroscopic parameters we obtain thermodynamic relation which depends on the spatial point (coordinate). In our approach, to obtain such a relation we use the basic ideas of the method of…
The thermodynamic uncertainty relation expresses a universal trade-off between precision and entropy production, which applies in its original formulation to current observables in steady-state systems. We generalize this relation to…
We examine information theory using the steady-state Boltzmann equation. In a nonequilibrium steady-state system under steady heat conduction, the thermodynamic quantities from information theory are calculated and compared with those from…
We investigate the thermodynamics as well as the population dynamics of ecosystems based on a stochastic approach in which the number of individuals of the several species of the ecosystem are treated as stochastic variables. The several…
Observations on the past provide some hints about what will happen in the future, and this can be quantified using information theory. The ``predictive information'' defined in this way has connections to measures of complexity that have…
We present a numerical method for learning the dynamics of slow components of unknown multiscale stochastic dynamical systems. While the governing equations of the systems are unknown, bursts of observation data of the slow variables are…
Efficiently harvesting thermodynamic resources requires a precise understanding of their structure. This becomes explicit through the lens of information engines -- thermodynamic engines that use information as fuel. Maximizing the work…
The averaged steady-state surprisal links a driven stochastic system's information processing to its nonequilibrium thermodynamic response. By explicitly accounting for the effects of nonequilibrium steady states, a decomposition of the…
Prognostics is a process of assessing the extent of deviation or degradation of a product from its expected normal operating condition, and then, based on continuous monitoring, predicting the future reliability of the product. By being…
Living systems efficiently use chemical fuel to do work, process information, and assemble patterns despite thermal noise. Whether high efficiency arises from general principles or specific fine-tuning is unknown. Here, applying a recent…