Related papers: A Coherent View on Entropy
We relate the information exchange between two stochastic systems to the nonequilibrium entropy production in the whole system. By deriving a general formula that decomposes the total entropy production into the thermodynamic and…
I recall my 'matter-gravity entanglement hypothesis' and briefly review the evidence for it, based partly on its seeming ability to resolve a number of puzzles related to quantum black holes including the black hole information loss puzzle.…
Given an unknown quantum state distributed over two systems, we determine how much quantum communication is needed to transfer the full state to one system. This communication measures the "partial information" one system needs conditioned…
We discuss the information entropy for a general open pointer-based simultaneous measurement and show how it is bound from below. This entropic uncertainty bound is a direct consequence of the structure of the entropy and can be obtained…
Observational entropy captures both the intrinsic uncertainty of a thermodynamic state and the lack of knowledge due to coarse-graining. We demonstrate two interpretations of observational entropy, one as the statistical deficiency…
What is information, physically, and why does it so reliably emerge in living, cultural, and technological systems? Existing theories quantify uncertainty, cost, or compressibility, but do not identify which physical structures count as…
The paper examines and critiques the expression of entropy as the logarithm of the number of quantum states of a physical system. Boltzmann method of expressing entropy as the logarithm of the number of states of a gas with a given total…
The finiteness of black hole entropy suggest that spacetime is fundamentally discrete, and hints at an underlying relationship between geometry and "information". The foundation of this relationship is yet to be uncovered, but should…
Quantum uncertainty relations are formulated in terms of relative entropy between distributions of measurement outcomes and suitable reference distributions with maximum entropy. This type of entropic uncertainty relation can be applied…
Shannon's information entropy measures of the uncertainty of an event's outcome. If learning about a system reflects a decrease in uncertainty, then a plausible intuition is that learning should be accompanied by a decrease in the entropy…
In this paper, we review the concept of entropy in connection with the description of quantum unstable systems. We revise the conventional definition of entropy due to Boltzmann and extend it so as to include the presence of complex-energy…
This paper presents an information theoretic approach to the concept of intelligence in the computational sense. We introduce a probabilistic framework from which computational intelligence is shown to be an entropy minimizing process at…
Entropy is critically examined as a fundamental concept in contemporary science and informatics. Although the typical Shannon entropy provides a proper framework for describing the canonical ensemble, it fails to represent adequately the…
It is shown for classical and quantum ensembles that there is a unique quantity which has the properties of a "volume". This quantity is a function of the ensemble entropy, and hence provides a geometric interpretation for the latter. It…
The time variation of entropy, as an alternative to the variance, is proposed as a measure of the diffusion rate. It is shown that for linear and time-translationally invariant systems having a large-time limit for the density, at large…
We explore the connection between deep learning and information theory through the paradigm of diffusion models. A diffusion model converts noise into structured data by reinstating, imperfectly, information that is erased when data was…
Information entropic measures such as Fisher information, Shannon entropy, Onicescu energy and Onicescu Shannon entropy of a symmetric double-well potential are calculated in both position and momentum space. Eigenvalues and eigenvectors of…
We investigate fundamental connections between thermodynamics and quantum information theory. First, we show that the operational framework of thermal operations is nonequivalent to the framework of Gibbs-preserving maps, and we comment on…
First, the relation between black holes and limitations on information of other systems is developed. After reviewing the relation of entropy to information, we derive the entropy bound, review its applications to cosmology and its…
The paper analyzes the entropy of a system composed by non-interacting and indistinguishable particles whose quantum state numbers are modelled as independent and identically distributed classical random variables. The crucial observation…