Related papers: Information Entropy, Information Distances and Com…
Entropy and information can be considered dual: entropy is a measure of the subspace defined by the information constraining the given ambient space. Negative entropies, arising in na\"ive extensions of the definition of entropy from…
The present work studies aspects of the electronic correlation in confined H$^{-}$, He and Li$^+$ atoms in their ground states using the informational entropies. In this way, different variational wavefunctions are employed in order of…
Shannon entropy, a cornerstone of information theory, statistical physics and inference methods, is uniquely identified by the Shannon-Khinchin or Shore-Johnson axioms. Generalizations of Shannon entropy, motivated by the study of…
By extrapolating the energies of non-relativistic atoms and their ions with up to 3000 electrons within Kohn-Sham density functional theory, we find that the ionization potential remains finite and increases across a row, even as…
The Shannon entropy, the desequilibrium and their generalizations (R\'enyi and Tsallis entropies) of the three-dimensional single-particle systems in a spherically-symmetric potential $V(r)$ can be decomposed into angular and radial parts.…
We survey and introduce concepts and tools located at the intersection of information theory and network biology. We show that Shannon's information entropy, compressibility and algorithmic complexity quantify different local and global…
We report measurements of the spin susceptibility and the electron effective mass for two-dimensional electrons confined at the interfaces of MgxZn1-xO/ZnO single heterostructures (x = 0.05, 0.08, and 0.11), grown by molecular-beam epitaxy…
Shannon's metric of "Entropy" of information is a foundational concept of information theory. This article is a primer for novices that presents an intuitive way of understanding, remembering, and/or reconstructing Shannon's Entropy metric…
We compute the isotope shifts of the \emph{total} electron binding energy of neutral atoms and singly charged ions up to element $Z=120$, using relativistic Hartree-Fock method including the Breit interaction. Field shift coefficients are…
We calculate the phonon density of states (DOS) for strongly amorphous materials with a short-ranged interatomic potential. Exponentially decaying and abruptly truncated interatomic potentials are examined. Thermally excited mean square…
Shannon information entropy is a natural measure of probability (de)localization and thus (un)predictability in various procedures of data analysis for model systems. We pay particular attention to links between the Shannon entropy and the…
The quantification of the complexity of networks is, today, a fundamental problem in the physics of complex systems. A possible roadmap to solve the problem is via extending key concepts of information theory to networks. In this paper we…
Entropic uncertainty relations are interesting in their own rights as well as for a lot of applications. Keeping this in mind, we try to make the corresponding inequalities as tight as possible. The use of parametrized entropies also allows…
Upper and lower bounds are obtained for the joint entropy of a collection of random variables in terms of an arbitrary collection of subset joint entropies. These inequalities generalize Shannon's chain rule for entropy as well as…
We define correlational (von Neumann) entropy for an individual quantum state of a system whose time-independent hamiltonian contains random parameters and is treated as a member of a statistical ensemble. This entropy is representation…
We argue certain nonviolent local quantum field theory (LQFT) modification considered at the global horizon ($r=2M$) of a static spherically-symmetric black hole can lead to adiabatic leakage of quantum information in the form of Hawking…
In this paper, some general properties of Shannon information measures are investigated over sets of probability distributions with restricted marginals. Certain optimization problems associated with these functionals are shown to be…
We present certain universal bounds on the capacity of quantum information storage and on the time scale of its retrieval for a generic quantum field theoretic system. The capacity, quantified by the microstate entropy, is bounded from…
There are (at least) three approaches to quantifying information. The first, algorithmic information or Kolmogorov complexity, takes events as strings and, given a universal Turing machine, quantifies the information content of a string as…
The rapid scaling of artificial intelligence models has revealed a fundamental tension between model capacity (storage) and inference efficiency (computation). While classical information theory focuses on transmission and storage limits,…