Related papers: A Thermodynamic Structure of Asymptotic Inference
A unified thermodynamic framework for characterization of functional materials is developed. This framework encompasses linear reversible and irreversible processes with thermal, electrical, magnetic, and/or mechanical effects coupled. The…
Stochastic thermodynamics extends classical thermodynamics to small systems in contact with one or more heat baths. It can account for the effects of thermal fluctuations and describe systems far from thermodynamic equilibrium. A basic…
We propose a variational framework for nonequilibrium thermodynamics built around the effective number of accessible state, a multiplicative count that ranges from for a uniform distribution to one under complete localization, and whose…
Shannon entropy, a cornerstone of information theory, statistical physics and inference methods, is uniquely identified by the Shannon-Khinchin or Shore-Johnson axioms. Generalizations of Shannon entropy, motivated by the study of…
Non-equilibrium processes in Schottky systems generate by projection onto the equilibrium subspace reversible accompanying processes for which the non-equilibrium variables are functions of the equilibrium ones. The embedding theorem which…
The significance of statistical physics concepts such as entropy extends far beyond classical thermodynamics. We interpret the similarity between partitions in statistical mechanics and partitions in Bayesian inference as an articulation of…
Adaptive physical and biological systems continually process fluctuating information from their environments. When the environment is nonstationary, inference itself becomes a nonequilibrium process with thermodynamic cost. We analyse a…
Quantum-Induced Stochastic Dynamics arises from the coupling between a classical system and a quantum environment. Unlike standard thermal reservoirs, this environment acts as a dynamic bath, capable of simultaneously exchanging heat and…
Statements of Shannon's Noiseless Coding Theorem by various authors, including the original, are reviewed and clarified. Traditional statements of the theorem are often unclear as to when it applies. A new notation is introduced and the…
This paper provides a perspective on applying the concepts of information thermodynamics, developed recently in non-equilibrium statistical physics, to problems in theoretical neuroscience. Historically, information and energy in…
A microscopic definition of the thermodynamic entropy in an isolated quantum system must satisfy (i) additivity, (ii) extensivity and (iii) the second law of thermodynamics. We show that the diagonal entropy, which is the Shannon entropy in…
Many of the traditional results in information theory, such as the channel coding theorem or the source coding theorem, are restricted to scenarios where the underlying resources are independent and identically distributed (i.i.d.) over a…
This work consists in the theorical development on the analysis of the Thermodynamic Laws and thermodynamic systems in relative motion, according to the laws of Classical Mechanics. The difference of this work for many of the literature is…
Information-based uncertainty measures like Shannon entropy, Onicescu energy and Fisher information (in position and momentum space) are employed to understand the effect of \emph{symmetric and asymmetric} confinement in a quantum harmonic…
The laws of thermodynamics are a cornerstone of physics. At the nanoscale, where fluctuations and quantum effects matter, there is no unique thermodynamic framework because thermodynamic quantities such as heat and work depend on the…
We propose an effective field-theoretic framework for analyzing Transformer attention through a thermodynamic lens. By constructing a Lagrangian on the information manifold equipped with the Fisher metric, we show that, within the…
Based on a synthesis of three main ingredients: (i) the Shannon information in nonequilibrium systems, (ii) the semiclassical energy-time quantization rule, and (iii) the quasistatic information-energy correspondence, a new general rule for…
We develop a thermodynamic framework for modeling innovation adoption and abandonment dynamics using statistical mechanics. Starting from a mathematical model for an adoption distribution that fits empirically obtained date, we construct a…
In a thermodynamic process with measurement and feedback, the second law of thermodynamics is no longer valid. In its place, various second-law-like inequalities have been advanced that each incorporate a distinct additional term accounting…
In this paper we discuss about the validity of the Shannon entropy functional in connection with the correct Gibbs-Hertz probability distribution function. We show that there is no contradiction in using the Shannon-Gibbs functional and…