Related papers: Physics of the Shannon Limits
The Shannon entropy, one of the cornerstones of information theory, is widely used in physics, particularly in statistical mechanics. Yet its characterization and connection to physics remain vague, leaving ample room for misconceptions and…
Even though the second law of thermodynamics holds the supreme position among the laws of nature, as stated by many distinguished scientists, notably Eddington and Einstein, its position appears to be also quite peculiar. Given the atomic…
Three laws of information theory have been proposed. Labeling by introducing nonsymmetry and formatting by introducing symmetry are defined. The function L (L=lnw, w is the number of microstates, or the sum of entropy and information,…
We generalize the Clausius (in)equality to overdamped mesoscopic and macroscopic diffusions in the presence of nonconservative forces. In contrast to previous frameworks, we use a decomposition scheme for heat which is based on an exact…
The irreversible entropy increase described by the second law of thermodynamics is fundamentally tied to thermalization and the emergence of equilibrium. In the first part of our work (Ref: arXiv.2503.04152), we constructed an isolated gas…
A new thermodynamic inequality is derived which leads to the maximum work that can be extracted from multi-heat baths with the assistance of discrete quantum feedback control. The maximum work is determined by the free-energy difference and…
Almost all processes -- highly correlated, weakly correlated, or correlated not at all---exhibit statistical fluctuations. Often physical laws, such as the Second Law of Thermodynamics, address only typical realizations -- as highlighted by…
Landauer discussed the minimum energy necessary for computation and stated that erasure of information is accompanied by heat generation to the amount of kT ln2/bit. Modifying the above statement, we claim that erasure of information is…
The aim of this note is to connect a reversed form of the Gross logarithmic Sobolev inequality with the Gaussian maximum of Shannon's entropy power. There is thus a complete parallel with the well-known link between logarithmic Sobolev…
A central result that arose in applying information theory to the stochastic thermodynamics of nonlinear dynamical systems is the Information-Processing Second Law (IPSL): the physical entropy of the universe can decrease if compensated by…
A direct connection of information entropy $S$ and kinetic energy $T$ is obtained for nuclei and atomic clusters, which establishes $T$ as a measure of the information in a distribution. It is conjectured that this is a universal property…
We propose a new form of the Second Law inequality that defines a tight bound for extractable work from the non-equilibrium quantum state. In classical thermodynamics, the optimal work is given by the difference of free energy, what…
New families of Fisher information and entropy power inequalities for sums of independent random variables are presented. These inequalities relate the information in the sum of $n$ independent random variables to the information contained…
Based on a synthesis of three main ingredients: (i) the Shannon information in nonequilibrium systems, (ii) the semiclassical energy-time quantization rule, and (iii) the quasistatic information-energy correspondence, a new general rule for…
Quantum mechanics and information theory are among the most important scientific discoveries of the last century. Although these two areas initially developed separately it has emerged that they are in fact intimately related. In this…
We illustrate in terms familiar to modern day science students that: (i) an uncertainty slope mechanism underlies the usefulness of temperature via its reciprocal, which is incidentally around 42 [nats/eV] at the freezing point of water;…
We study thermodynamic limits when controllers operate with only partial observability of internal correlations in multipartite systems. Understanding the costs imposed by lack of information is crucial in settings where agents must act…
We examine the minimization of information entropy for measures on the phase space of bounded domains, subject to constraints that are averages of grand canonical distributions. We describe the set of all such constraints and show that it…
We present a new inequality which holds in the thermodynamical processes with measurement and feedback controls with using only the Helmholtz free energy and the entanglement of formation: $W_{\mathrm{ext}}\le-\Delta F-k_{B}T\Delta E_{F}$.…
We generalize the second law of thermodynamics in its maximum work formulation for a nonequilibrium initial distribution. It is found that in an isothermal process, the Boltzmann relative entropy (H-function) is not just a Lyapunov function…