Related papers: It's about time: a thermodynamic information crite…
We review the trade-offs between speed, fluctuations, and thermodynamic cost involved with biological processes in nonequilibrium states, and discuss how optimal these processes are in light of the universal bound set by the thermodynamic…
We postulate a principle stating that the initial condition of a physical system is typically algorithmically independent of the dynamical law. We argue that this links thermodynamics and causal inference. On the one hand, it entails…
Chemical processes in closed systems are poorly controllable since they always relax to equilibrium. Living systems avoid this fate and give rise to a much richer diversity of phenomena by operating under nonequilibrium conditions. Recent…
The Bayesian and Akaike information criteria aim at finding a good balance between under- and over-fitting. They are extensively used every day by practitioners. Yet we contend they suffer from at least two afflictions: their penalty…
New exact results about the nonequilibrium thermodynamics of open quantum systems at arbitrary timescales are obtained by considering all possible variations of initial conditions of a system, its environment, and correlations between them.…
This letter exposes a tight connection between the thermodynamic efficiency of information processing and predictive inference. A generalized lower bound on dissipation is derived for partially observable information engines which are…
The tradeoff relation between speed and cost is a central issue in designing fast and efficient information processing devices. We derive an achievable bound on thermodynamic cost for obtaining information through finite-time…
Scientific discovery can be framed as a thermodynamic process in which an agent invests physical work to acquire information about an environment under a finite work budget. Using established results about the thermodynamics of computing,…
The use of Bayesian information criterion (BIC) in the model selection procedure is under the assumption that the observations are independent and identically distributed (i.i.d.). However, in practice, we do not always have i.i.d. samples.…
For sensory networks, we determine the rate with which they acquire information about the changing external conditions. Comparing this rate with the thermodynamic entropy production that quantifies the cost of maintaining the network, we…
Perfectly rational decision-makers maximize expected utility, but crucially ignore the resource costs incurred when determining optimal actions. Here we propose an information-theoretic formalization of bounded rational decision-making…
A central goal of thermodynamics is to identify optimal processes during which the least amount of energy is dissipated into the environment. Generally, even for simple systems, such as the parametric harmonic oscillator, optimal control…
In the paradigm of thermodynamic computing, instead of behaving deterministically, hardware undergoes a stochastic process in order to sample from a distribution of interest. While it has been hypothesized that thermodynamic computers may…
Model selection is a ubiquitous problem that arises in the application of many statistical and machine learning methods. In the likelihood and related settings, it is typical to use the method of information criteria (IC) to choose the most…
An agent acquires information dynamically until her belief about a binary state reaches an upper or lower threshold. She can choose any signal process subject to a constraint on the rate of entropy reduction. Strategies are ordered by "time…
In addition to the Riemannian metricization of the thermodynamic state space, local relaxation times offer a natural time scale, too. Generalizing existing proposals, we relate {\it thermodynamic} time scale to the standard kinetic…
Living systems regulate many aspects of their behavior through periodic oscillations of molecular concentrations, which function as `biochemical clocks.' These clocks are intrinsically subject to thermal fluctuations, so that the duration…
We initiate the study of a novel problem in mechanism design without money, which we term Truthful Interval Covering (TIC). An instance of TIC consists of a set of agents each associated with an individual interval on a line, and the…
For a small system like a colloidal particle or a single biomolecule embedded in a heat bath, the optimal protocol of an external control parameter minimizes the mean work required to drive the system from one given equilibrium state to…
We study a dynamical system with time dependent Hamiltonian by numerical experiments so as to find a relation between thermodynamics and chaotic nature of the system. Excess information loss, defined newly based on Lyapunov analysis, is…