English
Related papers

Related papers: Entropy Estimates from Insufficient Samplings

200 papers

In this paper, we present a new multi-scale information content calculation method based on Shannon information (and Shannon entropy). The original method described by Claude E. Shannon and based on the logarithm of the probability of…

Information Theory · Computer Science 2023-05-23 Zsolt Pocze

This paper addresses the correspondence between linear inequalities of Shannon entropy and differential entropy for sums of independent group-valued random variables. We show that any balanced (with the sum of coefficients being zero)…

Information Theory · Computer Science 2016-09-12 Ashok Vardhan Makkuva , Yihong Wu

We consider the problem of estimating Shannon's entropy $H$ from discrete data, in cases where the number of possible symbols is unknown or even countably infinite. The Pitman-Yor process, a generalization of Dirichlet process, provides a…

Information Theory · Computer Science 2014-04-11 Evan Archer , Il Memming Park , Jonathan Pillow

Accounting for the non-normality of asset returns remains challenging in robust portfolio optimization. In this article, we tackle this problem by assessing the risk of the portfolio through the "amount of randomness" conveyed by its…

Portfolio Management · Quantitative Finance 2018-07-03 Nathan Lassance , Frédéric Vrins

Gamma distributions, which contain the exponential as a special case, have a distinguished place in the representation of near-Poisson randomness for statistical processes; typically, they represent distributions of spacings between events…

Mathematical Physics · Physics 2009-05-22 C. T. J. Dodson

We present a numerical study of the application of the Shannon entropy technique to the planar restricted three-body problem in the vicinity of first-order interior mean-motion resonances with the perturber. We estimate the diffusion…

Chaotic Dynamics · Physics 2020-01-08 C. Beaugé , P. M. Cincotta

In this paper we will analyze discrete probability distributions in which probabilities of particular outcomes of some experiment (microstates) can be represented by the ratio of natural numbers (in other words, probabilities are…

Information Theory · Computer Science 2009-09-29 Marko V. Jankovic

We describe an approach to improving model fitting and model generalization that considers the entropy of distributions of modelling residuals. We use simple simulations to demonstrate the observational signatures of overfitting on ordered…

Methodology · Statistics 2019-08-05 Barnaby Rowe

We consider Shannon entropy, Fisher information, R\'enyi entropy, and Tsallis entropy to study the quantum droplet phase in Bose-Einstein condensates. In the beyond mean-field description, the Gross-Pitaevskii equation with Lee-Huang-Yang…

Quantum Gases · Physics 2024-10-04 Sk Siddik , Golam Ali Sekh

Shannon entropy is the most common metric to measure the degree of randomness of time series in many fields, ranging from physics and finance to medicine and biology. Real-world systems may be in general non stationary, with an entropy…

Statistical Finance · Quantitative Finance 2023-06-08 Andrey Shternshis , Piero Mazzarisi

We consider the problem of estimating functionals of discrete distributions, and focus on tight nonasymptotic analysis of the worst case squared error risk of widely used estimators. We apply concentration inequalities to analyze the random…

Information Theory · Computer Science 2017-08-11 Jiantao Jiao , Kartik Venkat , Yanjun Han , Tsachy Weissman

Shannon's metric of "Entropy" of information is a foundational concept of information theory. This article is a primer for novices that presents an intuitive way of understanding, remembering, and/or reconstructing Shannon's Entropy metric…

Information Theory · Computer Science 2014-05-09 Sriram Vajapeyam

Data partitioning that maximizes/minimizes the Shannon entropy, or more generally the R\'enyi entropy is a crucial subroutine in data compression, columnar storage, and cardinality estimation algorithms. These partition algorithms can be…

Data Structures and Algorithms · Computer Science 2025-11-05 Aryan Esmailpour , Sanjay Krishnan , Stavros Sintos

This paper derives bounds for two omnipresent information theoretic measures, the Shannon entropy and its complementary dual, the extropy. Based on a large size data set from a logconcave model, the said bounds are obtained for the entropy…

Statistics Theory · Mathematics 2025-07-21 Konstantinos Zografos

We consider some questions concerning the monotonicity properties of entropy and mean entropy of states on translationally invariant systems (classical lattice, quantum lattice and quantum continuous). By taking the property of strong…

Mathematical Physics · Physics 2008-11-26 Amanda R. Kay , Bernard S. Kay

Entropy and differential entropy are important quantities in information theory. A tractable extension to singular random variables-which are neither discrete nor continuous-has not been available so far. Here, we present such an extension…

Information Theory · Computer Science 2017-01-04 Günther Koliander , Georg Pichler , Erwin Riegler , Franz Hlawatsch

According to a previous conjecture, spatial and temporal Lyapunov exponents of chaotic extended systems can be obtained from derivatives of a suitable function: the entropy potential. The validity and the consequences of this hypothesis are…

chao-dyn · Physics 2009-10-30 Stefano Lepri , Antonio Politi , Alessandro Torcini

Entropy has emerged as a dynamic, interdisciplinary, and widely accepted quantitative measure of uncertainty across different disciplines. A unified understanding of entropy measures, supported by a detailed review of their theoretical…

Probability · Mathematics 2025-03-21 Naveen Kumar , Ambesh Dixit , Vivek Vijay

Stochastic thermodynamics extends classical thermodynamics to small systems in contact with one or more heat baths. It can account for the effects of thermal fluctuations and describe systems far from thermodynamic equilibrium. A basic…

Statistical Mechanics · Physics 2018-01-04 Momčilo Gavrilov , Raphaël Chétrite , John Bechhoefer

Thermodynamic uncertainty relations reveal a fundamental trade-off between the precision of a trajectory observable and entropy production, where the uncertainty of the observable is quantified by its variance. In information theory,…

Statistical Mechanics · Physics 2025-11-25 Yoshihiko Hasegawa , Tomohiro Nishiyama