Related papers: On the Mathematics of Information-Thermodynamics
In the present work we investigate phase correlations by recourse to the Shannon entropy. Using theoretical arguments we show that the entropy provides an accurate measure of phase correlations in any dynamical system, in particular when…
Thermodynamic length is a metric distance between equilibrium thermodynamic states that asymptotically bounds the dissipation induced by a finite time transformation of a thermodynamic system. By means of thermodynamic length, we first…
For a gas-solid interfacial system where chemical species undergo reversible adsorption, we develop a mesoscopic stochastic modeling method that simulates both gas-phase hydrodynamics and surface coverage dynamics by coupling the Langmuir…
We propose the use of entropy, measured from the spatial and flux distribution of pixels in the residual image, as a potential diagnostic and stopping metric for the CLEAN algorithm. Despite its broad success as the standard deconvolution…
Using information entropy formalism, we consider a one-dimensional system with heat flux and extend the meaning of equilibrium variables to non equilibrium scenarios when classical local equilibrium approach is not applicable; this is…
The statistical mechanical interpretation of algorithmic information theory (AIT, for short) was introduced and developed by our former works [K. Tadaki, Local Proceedings of CiE 2008, pp.425-434, 2008] and [K. Tadaki, Proceedings of…
The configurational entropy of ice is calculated by thermodynamic integration from high to low temperatures. We use Monte Carlo simulations with a simple energy model which reproduces the Bernal-Fowler ice rules. This procedure is found to…
The concept of autonomy is fundamental for understanding biological organization and the evolutionary transitions of living systems. Understanding how a system constitutes itself as an individual, cohesive, self-organized entity is a…
We put forth a unifying formalism for the description of the thermodynamics of continuously monitored systems, where measurements are only performed on the environment connected to a system. We show, in particular, that the conditional and…
In the present work we develop a strictly Hamiltonian approach to Thermodynamics. A thermodynamic description based on symplectic geometry is introduced, where all thermodynamic processes can be described within the framework of Analytic…
During a spontaneous change, a macroscopic physical system will evolve towards a macro-state with more realizations. This observation is at the basis of the Statistical Mechanical version of the Second Law of Thermodynamics, and it provides…
Dense Associative Memory networks (DenseAMs) unify several popular paradigms in Artificial Intelligence (AI), such as Hopfield Networks, transformers, and diffusion models, while casting their computational properties into the language of…
I give a quick overview of some of the theoretical background necessary for using modern non-equilibrium statistical physics to investigate the thermodynamics of computation. I first present some of the necessary concepts from information…
In contrast to the canonical ensemble where thermodynamic functions are smooth for all finite system sizes, the microcanonical entropy can show nonanalytic points also for finite systems, even if the Hamiltonian is smooth. The relation…
We show that macroscopic irreversible thermodynamics for viscous fluids can be derived from exact information-theoretic thermodynamic identities valid at the microscale. Entropy production, in particular, is a measure of the loss of…
We study stochastic thermodynamics for a quantum system of interest whose dynamics are described by a completely positive trace-preserving (CPTP) map as a result of its interaction with a thermal bath. We define CPTP maps with equilibrium…
The microcanonical ensemble has long been a starting point for the development of thermodynamics from statistical mechanics. However, this approach presents two problems. First, it predicts that the entropy is only defined on a discrete set…
Estimating entropy production from real observation data can be difficult due to finite resolution in both space and time and finite measurement statistics. We characterize the statistical error introduced by finite sample size and compare…
Residual entropy, which reflects the degrees of freedom in a system at absolute zero temperature, is crucial for understanding quantum and classical ground states. Despite its key role in explaining low-temperature phenomena and ground…
For the system with inhomogeneous distribution of macroscopic parameters we obtain thermodynamic relation which depends on the spatial point (coordinate). In our approach, to obtain such a relation we use the basic ideas of the method of…