English
Related papers

Related papers: Estimating the Shannon Entropy Using the Pitman--Y…

200 papers

We consider the entropy of sums of independent discrete random variables, in analogy with Shannon's Entropy Power Inequality, where equality holds for normals. In our case, infinite divisibility suggests that equality should hold for…

Information Theory · Computer Science 2010-10-21 Oliver Johnson , Yaming Yu

Maximum entropy method is a constructive criterion for setting up a probability distribution maximally non-committal to missing information on the basis of partial knowledge, usually stated as constrains on expectation values of some…

Statistical Mechanics · Physics 2015-07-20 Jorge Fernandez-de-Cossio , Jorge Fernandez-de-Cossio Diaz

Complexity is an important metric for appropriate characterization of different classes of irregular signals, observed in the laboratory or in nature. The literature is already rich in the description of such measures using a variety of…

We study the problem of generating a random variate $X$ from a finite discrete probability distribution $P$ using an entropy source of independent fair coin flips. A classic result from Knuth and Yao shows that the optimal expected number…

Data Structures and Algorithms · Computer Science 2026-04-28 Thomas L. Draper , Feras A. Saad

We extend the notion of estimation entropy of autonomous dynamical systems proposed by Liberzon and Mitra [1] to nonlinear dynamical systems with uncertain inputs with bounded variation. We call this new notion the {$\epsilon$}-estimation…

Systems and Control · Electrical Eng. & Systems 2023-11-14 Hussein Sibai , Sayan Mitra

We develop a maximum relative entropy formalism to generate optimal approximations to probability distributions. The central results consist in (a) justifying the use of relative entropy as the uniquely natural criterion to select a…

Statistical Mechanics · Physics 2008-10-17 Chih-Yuan Tseng , Ariel Caticha

Ewens-Pitman's partition structure arises as a system of sampling consistent probability distributions on set partitions induced by the Pitman-Yor process. It is widely used in statistical applications, particularly in species sampling…

Methodology · Statistics 2025-03-10 Jan Greve

The Principle of Maximum Entropy is a rigorous technique for estimating an unknown distribution given partial information while simultaneously minimizing bias. However, an important requirement for applying the principle is that the…

Information Theory · Computer Science 2026-02-03 Kenneth Bogert , Matthew Kothe

In this paper, we investigate new procedures for statistical testing based on Tsallis entropy, a parametric generalization of Shannon entropy. Focusing on multivariate generalized Gaussian and $q$-Gaussian distributions, we develop…

Methodology · Statistics 2025-06-18 Mehmet Sıddık Çadırcı

Distributed systems, such as biological and artificial neural networks, process information via complex interactions engaging multiple subsystems, resulting in high-order patterns with distinct properties across scales. Investigating how…

Information Theory · Computer Science 2025-04-23 Aaron J. Gutknecht , Fernando E. Rosas , David A. Ehrlich , Abdullah Makkeh , Pedro A. M. Mediano , Michael Wibral

Statistical inference on biodiversity has a rich history going back to RA Fisher. An influential ecological theory suggests the existence of a fundamental biodiversity number, denoted $\alpha$, which coincides with the precision parameter…

Methodology · Statistics 2025-02-04 Tommaso Rigon , Ching-Lung Hsu , David B. Dunson

We consider the classic problem of estimating T, the total number of species in a population, from repeated counts in a simple random sample. We look first at the Chao-Lee estimator: we initially show that such estimator can be obtained by…

Applications · Statistics 2008-04-09 L. Cecconi , A. Gandolfi , C. C. A. Sastri

Shannon information has, in the past, been applied to quantify the genetic diversity of many natural populations. Here, we apply the Shannon concept to consecutive generations of alleles as they evolve over time. We suppose a genetic system…

Populations and Evolution · Quantitative Biology 2015-12-17 J. S. Glasenapp , B. R. Frieden , C. D. Cruz

This paper derives bounds for two omnipresent information theoretic measures, the Shannon entropy and its complementary dual, the extropy. Based on a large size data set from a logconcave model, the said bounds are obtained for the entropy…

Statistics Theory · Mathematics 2025-07-21 Konstantinos Zografos

We introduce a new measure of interdependence among the components of a random vector along the main diagonal of the vector copula, i.e. along the line $u_{1}=\ldots=u_{J}$, for $\left(u_{1},\ldots,u_{J}\right)\in\left[0,1\right]^{J}$. Our…

Methodology · Statistics 2014-08-29 Jhan Rodríguez , András Bárdossy

We consider an isomorphism invariant for measure-preserving systems - types of generalized entropy convergence rates. We show the connections of this invariant with the types of Shannon entropy convergence rates. In the case when they…

Dynamical Systems · Mathematics 2013-09-25 Fryderyk Falniowski

In the analysis of any type of system, granting maximum information extraction from its data is non-trivial. Confidence in successful information extraction typically builds on prior knowledge of the studied system or on the user's…

Data Analysis, Statistics and Probability · Physics 2026-01-01 Matteo Becchi , Giovanni Maria Pavan

The stretched exponential function, $\exp[-(t/\tau_{K})^{\beta}]$, describes various relaxation processes while it has been suggested that the power exponent, $\beta$ is derived from the non-uniformity of the process. In this paper, we…

Soft Condensed Matter · Physics 2018-09-12 Hirokazu Maruoka , Akio Nishimura , Makoto Yoshida , Keisuke Hatada

Upper and lower bounds are obtained for the joint entropy of a collection of random variables in terms of an arbitrary collection of subset joint entropies. These inequalities generalize Shannon's chain rule for entropy as well as…

Information Theory · Computer Science 2024-05-07 Mokshay Madiman , Prasad Tetali

We deploy Shannon's information entropy to the distribution of branching fractions in a particle decay. This serves to quantify how important a given new reported decay channel is, from the point of view of the information that it adds to…