Related papers: Entropy of Closure Operators
We present estimators for entropy and other functions of a discrete probability distribution when the data is a finite sample drawn from that probability distribution. In particular, for the case when the probability distribution is a joint…
We present a detailed study of the Entanglement Entropy (EE) of excited states in all closed rank one subsectors of N=4 SYM, namely SU(2), SU(1|1) and SL(2). Exploiting the techniques of the Coordinate and the Algebraic Bethe Ansatz we…
Using canonical Monte Carlo simulations, we introduce a new numerical procedure for comparing the entropic exponents of polymers with different constraints and/or topologies. Setting up competitions between polymer segments which can…
A general method for proving continuity of the von Neumann entropy on subsets of positive trace-class operators is considered. This makes it possible to re-derive the known conditions for continuity of the entropy in more general forms and…
We calculate Shannon information entropy of trapped interacting bosons in both the position and momentum spaces, $S_r$ and $S_k$ respectively. The total entropy maintains the fuctional form $S=a + b \ln N$ for repulsive bosons. At the…
We prove that there is no algorithm to decide whether a given integer vector is in the closure of the entropic cone $\overline{\Gamma_{n}^{*}}$. Equivalently, there is no decision procedure to determine whether a given integer-valued…
We study upper bounds on the growth of operator entropy $S_K$ in operator growth. Using uncertainty relation, we first prove a dispersion bound on the growth rate $|\partial_t S_K|\leq 2b_1 \Delta S_K$, where $b_1$ is the first Lanczos…
Following arXiv:2210.12963 [hep-th], we investigate aspects of the time evolution operator regarded as a density operator and associated entanglement-like structures in various quantum systems. These involve timelike separations and…
Shannon's fundamental bound for perfect secrecy says that the entropy of the secret message cannot be larger than the entropy of the secret key initially shared by the sender and the legitimate receiver. Massey gave an information theoretic…
We propose a compression-based version of the empirical entropy of a finite string over a finite alphabet. Whereas previously one considers the naked entropy of (possibly higher order) Markov processes, we consider the sum of the…
We propose a general framework for neural network compression that is motivated by the Minimum Description Length (MDL) principle. For that we first derive an expression for the entropy of a neural network, which measures its complexity…
We introduce a taxonomy for partially coherent optical fields spanning multiple degrees of freedom (DoFs) based on the rank of the associated coherence matrix (the number of non-zero eigenvalues). When DoFs comprise two spatial modes and…
We define and investigate a notion of entropy for quantum error correcting codes. The entropy of a code for a given quantum channel has a number of equivalent realisations, such as through the coefficients associated with the Knill-Laflamme…
It is known that the entropy function over a set of jointly distributed random variables is a submodular set function. However, not any submodular function is of this form. In this paper, we consider a family of submodular set functions,…
We study the problem of maximizing R{\'e}nyi entropy of order $2$ (equivalently, minimizing the index of coincidence) over the set of joint distributions with prescribed marginals. A closed-form optimizer is known under a feasibility…
The entropy of an orthogonal matrix is defined. It provides a new interpretation of Hadamard matrices as those that saturate the bound for entropy.It appears to be a useful Morse function on the group manifold. It has sharp maxima and other…
We introduce the (private) entropy of a directed graph (in a new network coding sense) as well as a number of related concepts. We show that the entropy of a directed graph is identical to its guessing number and can be bounded from below…
In this work we determine and discuss the entropic uncertainty measures of Shannon type for all the discrete stationary states of the multidimensional harmonic systems directly in terms of the states' hyperquantum numbers, the…
In this work, we use the Shannon informational entropies to study an electron confined in a double quantum dot; we mean the entropy in the space of positions, $S_r$, in the space of momentum, $S_p$, and the total entropy, $S_t = S_r+S_p$.…
We study the compact embedding between smoothness Morrey spaces on bounded domains and characterise its entropy numbers. Here we discover a new phenomenon when the difference of smoothness parameters in the source and target spaces is…