Related papers: Minimal Joint Entropy and Order-Preserving Couplin…
From the output produced by a memoryless deletion channel from a uniformly random input of known length $n$, one obtains a posterior distribution on the channel input. The difference between the Shannon entropy of this distribution and that…
We study the Shannon entropy of the cluster size distribution in classical as well as explosive percolation, in order to estimate the uncertainty in the sizes of randomly chosen clusters. At the critical point the cluster size distribution…
It is shown that the residual entropy (entropy minus that of the ideal gas at the same temperature and density) is mostly synonymous with the independent variable of density scaling, identifying a direct link between these two approaches.…
The spin 1/2 entropy of electrons trapped in a quantum dot has previously been measured with great accuracy, but the protocol used for that measurement is valid only within a restrictive set of conditions. Here, we demonstrate a novel…
The exact range of the joined values of several R\'{e}nyi entropies is determined. The method is based on topology with special emphasis on the orientation of the objects studied. Like in the case when only two orders of R\'{e}nyi entropies…
The paper examines relationships between the Shannon entropy and the $\ell_{\alpha}$-norm for $n$-ary probability vectors, $n \ge 2$. More precisely, we investigate the tight bounds of the $\ell_{\alpha}$-norm with a fixed Shannon entropy,…
Mixture distributions are a workhorse model for multimodal data in information theory, signal processing, and machine learning. Yet even when each component density is simple, the differential entropy of the mixture is notoriously hard to…
The Shannon entropy is a fundamental measure for quantifying diversity and model complexity in fields such as information theory, ecology, and genetics. However, many existing studies assume that the number of species is known, an…
We address the generalized uncertainty principle in scenarios of successive measurements. Uncertainties are characterized by means of generalized entropies of both the R\'{e}nyi and Tsallis types. Here, specific features of measurements of…
The theorem of Shannon-McMillan-Breiman states that for every generating partition on an ergodic system, the exponential decay rate of the measure of cylinder sets equals the metric entropy almost everywhere (provided the entropy is…
We study the small-regularisation limit of the entropic optimal transport problem on the line with distance cost. While convergence of entropic minimizers is well understood in the discrete setting and in the case where the cost is…
The entropic region is formed by the collection of the Shannon entropies of all subvectors of finitely many jointly distributed discrete random variables. For four or more variables, the structure of the entropic region is mostly unknown.…
High-order accurate, $\textit{entropy stable}$ numerical methods for hyperbolic conservation laws have attracted much interest over the last decade, but only a few rigorous convergence results are available, particularly in multiple space…
We study the fluctuation entropy for two-dimensional matter systems with an internal symmetry coupled to Jackiw--Teitelboim(JT) gravity joined to a Minkowski region. The fluctuation entropy is the Shannon entropy associated to probabilities…
The entanglement in a quantum system that possess an internal symmetry, characterized by the Sz-magnetization or U(1)-charge, is distributed among different sectors. The aim of this letter is to gain a deeper understanding of the…
We quantify a social organization's potentiality, that is its ability to attain different configurations. The organization is represented as a network in which nodes correspond to individuals and (multi-)edges to their multiple…
Entropic measures of complexity are able to quantify the information encoded in complex network structures. Several entropic measures have been proposed in this respect. Here we study the relation between the Shannon entropy and the Von…
We study the Shannon entropy of the probability distribution resulting from the ground-state wave function of a one-dimensional quantum model. This entropy is related to the entanglement entropy of a Rokhsar-Kivelson-type wave function…
We consider entanglement in the ground state of the XY spin model on infinite chain. We use von Neumann entropy of a sub-system as a measure of entanglement. The entropy of a large block of neighboring spins approaches a constant as the…
A method of estimating the joint probability mass function of a pair of discrete random variables is described. This estimator is used to construct the conditional Shannon-R\'eyni-Tsallis entropies estimates. From there almost sure rates of…