Related papers: Physics of the Shannon Limits
On the standard microscopic model of friction we confirm the common belief that the irreversible entropy production originates from the increase of Shannon information. We reveal that the reversible microscopic dynamics would continuously…
Shannon entropy and Fisher information functionals are known to quantify certain information-theoretic properties of continuous probability distributions of various origins. We carry out a systematic study of these functionals, while…
In a macroscopic (quantum or classical) Hamiltonian system, we prove the second law of thermodynamics in the forms of the minimum work principle and the law of entropy increase, under the assumption that the initial state is described by a…
Information-theoretic approaches provide a promising avenue for extending the laws of thermodynamics to the nanoscale. Here, we provide a general fundamental lower limit, valid for systems with an arbitrary Hamiltonian and in contact with…
We formulate a geometric framework in which physical laws emerge from restricted access to microscopic information. Measurement constraints are modeled as a gauge symmetry acting on density operators, inducing a gauge-reduced space of…
A common framework for quantum mechanics, thermodynamics and information theory is presented. It is accomplished by reinterpreting the mathematical formalism of Everett's many-worlds theory of quantum mechanics and augmenting it to include…
Shannon entropy, a cornerstone of information theory, statistical physics and inference methods, is uniquely identified by the Shannon-Khinchin or Shore-Johnson axioms. Generalizations of Shannon entropy, motivated by the study of…
The statistical properties of physical systems in thermal equilibrium are blatantly different from their far-from-equilibrium counterparts. In the latter, fluctuations often dominate the dynamics and might cluster in ordered patterns in the…
Certain fluctuations in particle number at fixed total energy lead exactly to a cut-power law distribution in the one-particle energy, via the induced fluctuations in the phase-space volume ratio. The temperature parameter is expressed…
The possibility of stating the second law of thermodynamics in terms of the increasing behaviour of a physical property establishes a connection between that branch of physics and the theory of algebraic inequalities. We use this connection…
The present work deals with irreversible Universal thermodynamics. The homogenous and isotropic flat model of the universe is chosen as open thermodynamical system and non-equilibrium thermodynamics comes into picture due to the mechanism…
We draw relationships between the generalized data processing theorems of Zakai and Ziv (1973 and 1975) and the dynamical version of the second law of thermodynamics, a.k.a. the Boltzmann H-Theorem, which asserts that the Shannon entropy,…
While most useful information theoretic inequalities can be deduced from the basic properties of entropy or mutual information, up to now Shannon's entropy power inequality (EPI) is an exception: Existing information theoretic proofs of the…
Logical information theory is the quantitative version of the logic of partitions just as logical probability theory is the quantitative version of the dual Boolean logic of subsets. The resulting notion of information is about…
The development of stochastic thermodynamics during the last decades prompted the discovery of novel nonequilibrium relations refining our understanding of the second law in small fluctuating systems and its connection with information…
Even after over 150 years of discussion, the interpretation of the second law of thermodynamics continues to be a source of confusion and controversy in physics. This confusion has been accentuated by recent challenges to the second law and…
After presenting possible motives for fighting against the second law of thermodynamics, several attempts to beat this law are analyzed. The second law wins, but an interesting interpretation of it emerges. This interpretation uses the…
Information theory is a statistical theory concerned with the relative state of detectors and physical systems. As a consequence, the classical framework of Shannon needs to be extended to deal with quantum detectors, possibly moving at…
We speculate whether the second law of thermodynamics has more to do with Turing machines than steam pipes. It states the logical reversibility of reality as a computation, i.e., the fact that no information is forgotten: nature computes…
Recently, there has been a considerable progress on the issue of the thermodynamic second law, which is known as the law of entropy increase or irreversibility. In particular, a novel symmetry known as the Gallavotti-Cohen symmetry is found…