Related papers: The free energy requirements of biological organis…
Life is a nonequilibrium phenomenon: metabolism provides a continuous supply of energy that drives nearly all cellular processes. However, very little is known about how much energy different cellular processes use, i.e. their energetic…
It is now well established that there is no lower bound for the energy dissipated during a computation. The relevance of the zero-energy limit is unclear, however, because it entails computations that are unreliable or infinitely slow, or…
The energy dissipated by a living organism is commonly identified with heat generation. However, as cells exchange metabolites with their environment they also dissipate energy in the form of chemical entropy. How dissipation is distributed…
An approach to implementing variational Bayesian inference in biological systems is considered, under which the thermodynamic free energy of a system directly encodes its variational free energy. In the case of the brain, this assumption…
Modern digital electronics support remarkably reliable computing, especially given the challenge of controlling nanoscale logical components that interact in fluctuating environments. However, we demonstrate that the high-reliability limit…
In this PhD thesis, we explore and apply methods inspired by the free energy principle to two important areas in machine learning and neuroscience. The free energy principle is a general mathematical theory of the necessary…
Does the energy requirements for the human brain give energy constraints that give reason to doubt the feasibility of artificial intelligence? This report will review some relevant estimates of brain bioenergetics and analyze some of the…
The minimum heat cost of computation is subject to bounds arising from Landauer's principle. Here, I derive bounds on finite modelling -- the production or anticipation of patterns (time-series data) -- by devices that model the pattern in…
Maximum-entropy ensembles are key primitives in statistical mechanics from which thermodynamic properties can be derived. Over the decades, several approaches have been put forward in order to justify from minimal assumptions the use of…
In this study, the minimum amount of work needed to drive a thermodynamic system from one initial distribution to another in a given time duration is discussed. Equivalently, for given amount of work, the minimum time duration required to…
The information-thermodynamics link is revisited, going back to the analysis of Szilard's engine. It is argued that instead of equivalence rather complementarity of physical entropy and information theoretical one is a correct concept.…
By considering the energy cost of messages carried by proteins as proportional to their information content we found experimental proof that proteins from all living organisms tend to have their estimated semantic content of information per…
In this paper, we calculate energy required to copy one bit of useful information in the presence of thermal noise. For this purpose, we consider a quantum system capable of storing one bit of classical information, which is initially in a…
Nonequilibrium thermodynamics of a system situated in a sustained environment with influx and efflux is usually treated as a subsystem in a larger, closed "universe". It remains a question what the minimally required description for the…
We relate the information exchange between two stochastic systems to the nonequilibrium entropy production in the whole system. By deriving a general formula that decomposes the total entropy production into the thermodynamic and…
Landauer's principle states that the erasure of one bit of information requires the free energy kT ln 2. We argue that the reliability of the bit erasure process is bounded by the accuracy inherent in the statistical state of the energy…
One of the outstanding challenges to information processing is the eloquent suppression of energy consumption in execution of logic operations. Landauer principle sets an energy constraint in deletion of a classical bit of information.…
Landauer's bound is the minimum thermodynamic cost for erasing one bit of information. As this bound is achievable only for quasistatic processes, finite-time operation incurs additional energetic costs. We find a tight finite-time…
Landauer's principle bounds the heat generated by logical operations, but in practice the thermodynamic cost of computation is dominated by the control systems that implement logic. CMOS gates dissipate energy far above the Landauer bound,…
This letter exposes a tight connection between the thermodynamic efficiency of information processing and predictive inference. A generalized lower bound on dissipation is derived for partially observable information engines which are…