English
Related papers

Related papers: Inferring Diversity: Life After Shannon

200 papers

The scientific method relies on the iterated processes of inference and inquiry. The inference phase consists of selecting the most probable models based on the available data; whereas the inquiry phase consists of using what is known about…

Machine Learning · Statistics 2015-05-19 N. K. Malakar , K. H. Knuth

(Jaynes') Method of (Shannon-Kullback's) Relative Entropy Maximization (REM or MaxEnt) can be - at least in the discrete case - according to the Maximum Probability Theorem (MPT) viewed as an asymptotic instance of the Maximum Probability…

Data Analysis, Statistics and Probability · Physics 2012-08-27 M. Grendar, , M. Grendar

It is not obvious how to extend Shannon's original information entropy to higher dimensions, and many different approaches have been tried. We replace the English text symbol sequence originally used to illustrate the theory by a discrete,…

Information Theory · Computer Science 2016-09-06 Kieran G. Larkin

The diversity of the symbols of the information source is calculated following the definition that entropy is the information loss and following a new entropy-symbol similarity relation after the rejection of the Gibbs paradox statement.…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Shu-Kun Lin

Shannon entropy was defined for probability distributions and then its using was expanded to measure the uncertainty of knowledge for systems with complete information. In this article, it is proposed to extend the using of Shannon entropy…

Information Theory · Computer Science 2017-09-15 Vasile Patrascu

Entropy is a measure of heterogeneity widely used in applied sciences, often when data are collected over space. Recently, a number of approaches has been proposed to include spatial information in entropy. The aim of entropy is to…

Statistics Theory · Mathematics 2019-11-12 Linda Altieri , Daniela Cocchi , Giulia Roli

Simplified mechanistic models in ecology have been criticized for the fact that a good fit to data does not imply the mechanism is true: pattern does not equal process. In parallel, the maximum entropy principle (MaxEnt) has been applied in…

Populations and Evolution · Quantitative Biology 2017-05-02 James P. O'Dwyer , Andrew Rominger , Xiao Xiao

The statistical analysis of data stemming from dynamical systems, including, but not limited to, time series, routinely relies on the estimation of information theoretical quantities, most notably Shannon entropy. To this purpose, possibly…

Information Theory · Computer Science 2021-09-01 Leonardo Ricci , Alessio Perinelli , Michele Castelluzzo

Entropy, under a variety of names, has long been used as a measure of diversity in ecology, as well as in genetics, economics and other fields. There is a spectrum of viewpoints on diversity, indexed by a real parameter q giving greater or…

Information Theory · Computer Science 2017-09-05 Tom Leinster , Mark W. Meckes

The entropy maximum approach (Maxent) was developed as a minimization of the subjective uncertainty measured by the Boltzmann--Gibbs--Shannon entropy. Many new entropies have been invented in the second half of the 20th century. Now there…

Data Analysis, Statistics and Probability · Physics 2013-11-07 A. N. Gorban

Two families of dependence measures between random variables are introduced. They are based on the R\'enyi divergence of order $\alpha$ and the relative $\alpha$-entropy, respectively, and both dependence measures reduce to Shannon's mutual…

Information Theory · Computer Science 2019-08-22 Amos Lapidoth , Christoph Pfister

Recently, the conditional maximum-entropy method (abbreviated as C-MaxEnt) has been proposed for selecting priors in Bayesian statistics in a very simple way. Here, it is examined for extreme-value statistics. For the Weibull type as an…

Statistical Mechanics · Physics 2022-01-26 Sumiyoshi Abe

According to E.T. Jaynes and E.P. Wigner, entropy is an anthropomorphic concept in the sense that in a physical system correspond many thermodynamic systems. The physical system can be examined from many points of view each time examining…

Information Theory · Computer Science 2015-12-03 Panteleimon Rodis

We wish to formally test for changes in the taxonomic diversity of a community, especially in the presence of high latent diversity. Drawing on the meta-analysis literature, we construct a model for diversity that accounts for covariate…

Methodology · Statistics 2015-06-19 Amy Willis , John Bunge , Thea Whitman

The purpose of this note is to show how the method of maximum entropy in the mean (MEM) may be used to improve parametric estimation when the measurements are corrupted by large level of noise. The method is developed in the context on a…

Machine Learning · Computer Science 2021-08-23 Henryk Gzyl , Enrique ter Horst

After Shannon, entropy becomes a fundamental quantity to describe not only uncertainity or chaos of a system but also information carried by the system. Shannon's important discovery is to give a mathematical expression of the mutual…

Quantum Physics · Physics 2007-05-23 Masanori Ohya

In the first chapter of Shannon's "A Mathematical Theory of Communication," it is shown that the maximum entropy rate of an input process of a constrained system is limited by the combinatorial capacity of the system. Shannon considers…

Information Theory · Computer Science 2009-11-20 Georg Böcherer , Valdemar Cardoso da Rocha Junior , Cecilio Pimentel

Distributed systems, such as biological and artificial neural networks, process information via complex interactions engaging multiple subsystems, resulting in high-order patterns with distinct properties across scales. Investigating how…

Information Theory · Computer Science 2025-04-23 Aaron J. Gutknecht , Fernando E. Rosas , David A. Ehrlich , Abdullah Makkeh , Pedro A. M. Mediano , Michael Wibral

Upper and lower bounds are obtained for the joint entropy of a collection of random variables in terms of an arbitrary collection of subset joint entropies. These inequalities generalize Shannon's chain rule for entropy as well as…

Information Theory · Computer Science 2024-05-07 Mokshay Madiman , Prasad Tetali

The principle of maximum entropy (Maxent) is often used to obtain prior probability distributions as a method to obtain a Gibbs measure under some restriction giving the probability that a system will be in a certain state compared to the…

Information Theory · Computer Science 2019-06-26 Hector Zenil , Narsis A. Kiani , Jesper Tegnér