Related papers: Average Entropy Functions
Generalized entropies are studied as Lyapunov functions for the Master equation (Markov chains). Three basic properties of these Lyapunov functions are taken into consideration: universality (independence of the kinetic coefficients),…
In a 1+1 dimensional QFT on a circle, we consider the von Neumann entanglement entropy of an interval for typical pure states. As a function of the interval size, we expect a Page curve in the entropy. We employ a specific ensemble average…
Reliable data-driven estimation of Shannon entropy from small data sets, where the number of examples is potentially smaller than the number of possible outcomes, is a critical matter in several applications. In this paper, we introduce a…
Shannon information entropy is a natural measure of probability (de)localization and thus (un)predictability in various procedures of data analysis for model systems. We pay particular attention to links between the Shannon entropy and the…
Convergence properties of Shannon Entropy are studied. In the differential setting, it is shown that weak convergence of probability measures, or convergence in distribution, is not enough for convergence of the associated differential…
We study the volume entropy of a class of presentations (including the classical ones) for all surface groups, called \emph{minimal geometric presentations}. We rediscover a formula first obtained by Cannon and Wagreich with the computation…
Measuring the average information that is necessary to describe the behaviour of a dynamical system leads to a generalization of the Kolmogorov-Sinai entropy. This is particularly interesting when the system has null entropy and the…
We propose an order parameter for a general one-dimensional gapped system with an open boundary condition. The order parameter can be computed from the ground state entanglement entropy of some regions near one of the boundaries. Hence, it…
We address the problem of quantifying the information content of a source for an arbitrary information theory, where the information content is defined in terms of the asymptotic achievable compression rate. The functions that solve this…
Entropy arises in strong interactions by a dynamical separation of ``partons'' from unobservable ``environment'' modes due to confinement. For interacting scalar fields we calculate the statistical entropy of the observable subsystem.…
Entropy rate is a real valued functional on the space of discrete random sources which lacks a closed formula even for subclasses of sources which have intuitive parameterizations. A good way to overcome this problem is to examine its…
Shannon's entropy and other entropy-based concepts are derived from the new, more general concept of relative divergence of one "grading' function on a linearly ordered set from another such function. The definition of relative divergence…
We generalize the convex duality symmetry in Gibbs' statistical ensemble formulation, between Massieu's free entropy $\Phi_{V,N} (\beta)$ and the Gibbs entropy $\varphi_{V,N}(u)$ as a function of mean internal energy $u$. The duality tells…
We study the entanglement entropy of random partitions in one- and two-dimensional critical fermionic systems. In an infinite system we consider a finite, connected (hypercubic) domain of linear extent $L$, the points of which with…
We obtain a mathematically simple characterization of all functionals coinciding with the von Neumann reduced entropy on pure states based on the Khinchin-Faddeev axiomatization of Shannon entropy and give a physical interpretation of the…
To study arithmetic structures of natural numbers, we introduce a notion of entropy of arithmetic functions, called anqie entropy. This entropy possesses some crucial properties common to both Shannon's and Kolmogorov's entropies. We show…
We consider entanglement through permeable junctions of $N$ $(1+1)$-dimensional free boson and free fermion conformal field theories. In the folded picture we constrain the form of the general boundary state. We calculate replicated…
Entropy has emerged as a dynamic, interdisciplinary, and widely accepted quantitative measure of uncertainty across different disciplines. A unified understanding of entropy measures, supported by a detailed review of their theoretical…
We summarize some results of geometric measure theory concerning rectifiable sets and measures. Combined with the entropic chain rule for disintegrations (Vigneaux, 2021), they account for some properties of the entropy of rectifiable…
In this paper, we introduce a way to generalize the Euler's gamma function as well as some related special functions. With a given polynomial in one variable $f(t)\ge 0$, we can associate a function, so-called "gamma function associated…