Related papers: Information geometry, trade-off relations, and gen…
Despite the wide usage of information as a concept in science, we have yet to develop a clear & concise scientific definition. This paper is aimed at laying the foundations for a new theory concerning the mechanics of information alongside…
While information theory has been introduced to characterize the fundamental limitations of control and filtering for a few decades, the existing information-theoretic methods are indirect and cumbersome for analyzing the limitations of…
We establish an exact identity for overdamped Langevin dynamics: the total entropy production rate equals four times the mutual information rate between an infinitesimal displacement and its time midpoint, plus a mean flow term. This yields…
We analyze the geometry of a joint distribution over a set of discrete random variables. We briefly review Shannon's entropy, conditional entropy, mutual information and conditional mutual information. We review the entropic information…
Inference and learning are commonly cast in terms of optimisation, yet the fundamental constraints governing uncertainty reduction remain unclear. This work presents a first-principles framework inherent to Bayesian updating, termed…
Observing stochastic trajectories with rare transitions between states, practically undetectable on time scales accessible to experiments, makes it impossible to directly quantify the entropy production and thus infer whether and how far…
Information dynamics is an emerging description of information processing in complex systems which describes systems in terms of intrinsic computation, identifying computational primitives of information storage and transfer. In this paper…
The information shared among observables representing processes of interest is traditionally evaluated in terms of macroscale measures characterizing aggregate properties of the underlying processes and their interactions. Traditional…
This paper discusses the thermodynamic irreversibility realized in high-dimensional Hamiltonian systems with a time-dependent parameter. A new quantity, the irreversible information loss, is defined from the Lyapunov analysis so as to…
We put forth a unifying formalism for the description of the thermodynamics of continuously monitored systems, where measurements are only performed on the environment connected to a system. We show, in particular, that the conditional and…
Lateral predictive coding is a recurrent neural network which creates energy-efficient internal representations by exploiting statistical regularity in sensory inputs. Here we investigate the trade-off between information robustness and…
The capacity to precisely edit genomes has outpaced our ability to predict the consequences. A cell can be genetically perfect and therapeutically useless: edited exactly as intended, yet unstable, drifting toward unintended fates, or…
In this paper we study two entropic dynamical models from the viewpoint of information geometry. We study the geometry structures of the associated statistical manifolds. In order to analyse the character of the instability of the systems,…
In a recent work, Somogyfoki et al. (J. Non-Equilib. Thermodyn. 50, 59-76, 2025) analysed the linear stability of homogeneous equilibrium in third-order non-Fourier heat conduction within the framework of non-equilibrium thermodynamics with…
In a recent paper, Phys. Rev E 81, 041137 (2010), the author attempts to derive ten necessary conditions for stability of dissipative fluids and plasmas. Assuming the validity of the local equilibrium principle, these criteria have been…
An important issue during an engineering design process is to develop an understanding which design parameters have the most influence on the performance. Especially in the context of optimization approaches this knowledge is crucial in…
When we extract information from a system by performing a quantum measurement, the state of the system is disturbed due to the backaction of the measurement. Numerous studies have been performed to quantitatively formulate tradeoff…
We explore the idea that non-equilibrium steady states breaking detailed balance are obtained by deforming trajectories (lines in space-time) that have been sampled in a reference system with stochastic dynamics obeying detailed balance,…
Although the notion of entropy lies at the core of statistical mechanics, it is not often used in statistical mechanical models to characterize phase transitions, a role more usually played by quantities such as various order parameters,…
On the basis of the balance equations for energy-momentum, spin, particle and entropy density, an approach is considered which represents a comparatively general framework for special- and general-relativistic continuum thermodynamics. In…