English
Related papers

Related papers: Information Entropy, Information Distances and Com…

200 papers

A unifying theory is put forward that entropy is equal to action. The crowning derivation is based on information theoretic methods and uses our hypothesis that "particles move via the discrete Bernoulli Process." While this hypothesis…

General Physics · Physics 2022-09-13 John L. Haller

We describe five types of results concerning information and concentration of discrete random variables, and relationships between them, motivated by their counterparts in the continuous case. The results we consider are information…

Probability · Mathematics 2017-04-25 Oliver Johnson

The density of an atom in a state of well-defined angular momentum has a specific finite spherical harmonic content, without and with interactions. Approximate single-particle schemes, such as the Hartree, Hartree-Fock, and Local Density…

Materials Science · Physics 2009-02-05 H. A. Fertig , W. Kohn

The informational energy of Onicescu is a positive quantity that measures the amount of uncertainty of a random variable. But contrary to Shannon's entropy, the informational energy increases when randomness decreases. We report closed-form…

Information Theory · Computer Science 2022-04-21 Frank Nielsen

A correlated many-body calculation is presented to characterize the Shannon information entropy of trapped interacting bosons. We reformulate the one-body Shannon information entropy in terms of the one-body probability density. The minimum…

Quantum Gases · Physics 2013-09-16 Sudip Kumar Haldar , Barnali Chakrabarti , Tapan Kumar Das , Anindya Biswas

Information complexity is the interactive analogue of Shannon's classical information theory. In recent years this field has emerged as a powerful tool for proving strong communication lower bounds, and for addressing some of the major open…

Computational Complexity · Computer Science 2015-04-28 Omri Weinstein

The correlation energy in density functional theory can be expressed exactly in terms of the change in the probability of finding two electrons at a given distance $r_{12}$ (intracule density) when the electron-electron interaction is…

Other Condensed Matter · Physics 2017-08-23 Paola Gori-Giorgi , Michael Seidl , Andreas Savin

Entropy and information provide natural measures of correlation among elements in a network. We construct here the information theoretic analog of connected correlation functions: irreducible $N$--point correlation is measured by a decrease…

Biological Physics · Physics 2016-09-08 Elad Schneidman , Susanne Still , Michael J. Berry , William Bialek

We consider a model for a Planck scale ultraviolet cutoff which is based on Shannon sampling. Shannon sampling originated in information theory, where it expresses the equivalence of continuous and discrete representations of information.…

Quantum Physics · Physics 2015-11-18 Jason Pye , William Donnelly , Achim Kempf

When the von Neumann entropy (VNE) of a system increases due to measurements, certain information is lost, some of which may be recoverable. We define information retrievability (IR) and information loss (IL) as functions of the density…

Quantum Physics · Physics 2025-03-27 Xing M. Wang

The entropic uncertainty measures of the multidimensional hydrogenic states quantify the multiple facets of the spatial delocalization of the electronic probability density of the system. The Shannon entropy is the most adequate uncertainty…

Quantum Physics · Physics 2019-11-19 Irene V. Toranzo , David Puertas-Centeno , Nahual Sobrino , Jesús S. Dehesa

We analyze the geometry of a joint distribution over a set of discrete random variables. We briefly review Shannon's entropy, conditional entropy, mutual information and conditional mutual information. We review the entropic information…

We introduce a class of information measures based on group entropies, allowing us to describe the information-theoretical properties of complex systems. These entropic measures are nonadditive, and are mathematically deduced from a series…

Statistical Mechanics · Physics 2019-10-21 Piergiulio Tempesta , Henrik Jeldtoft Jensen

We present a problem relating measurements and information theory in spin foam models. In the three dimensional case of quantum gravity we can compute probabilities of spin network graphs and study the behaviour of the Shannon entropy…

General Relativity and Quantum Cosmology · Physics 2015-06-05 J. Manuel Garcia-Islas

Thermodynamic entropy, as defined by Clausius, characterizes macroscopic observations of a system based on phenomenological quantities such as temperature and heat. In contrast, information-theoretic entropy, introduced by Shannon, is a…

Quantum Physics · Physics 2017-01-04 Mirjam Weilenmann , Lea Krämer , Philippe Faist , Renato Renner

How much information is added to the Review of Particle Physics when a new decay branching ratio of a hadron is measured and reported? This is quantifiable by Shannon's information entropy $S(i) =-\sum_{f}BR_{(i\longrightarrow f)}\log…

Entropy and other fundamental quantities of information theory are customarily expressed and manipulated as functions of probabilities. Here we study the entropy H and subentropy Q as functions of the elementary symmetric polynomials in the…

Quantum Physics · Physics 2014-05-02 Richard Jozsa , Graeme Mitchison

We present a quantum information theory that allows for a consistent description of entanglement. It parallels classical (Shannon) information theory but is based entirely on density matrices (rather than probability distributions) for the…

Quantum Physics · Physics 2009-10-30 Nicolas J. Cerf , Chris Adami

Ground and excited states of a confined negative Hydrogen ion has been pursued under Kohn-Sham density functional approach by invoking a physically motivated work-function-based exchange potential. The exchange-only results are of near…

Atomic Physics · Physics 2022-05-23 Sangita Majumdar , Neetik Mukherjee , Amlan K. Roy

We propose a new interpretation of measures of information and disorder by connecting these concepts to group theory in a new way. Entropy and group theory are connected here by their common relation to sets of permutations. A combinatorial…

Information Theory · Computer Science 2019-11-25 David J. Galas