Related papers: Shannon and Renyi Entropy of Wavelets
The new estimates of the conditional Shannon entropy are introduced in the framework of the model describing a discrete response variable depending on a vector of d factors having a density w.r.t. the Lebesgue measure in R^d. Namely, the…
We introduce R\'enyi entropy of a subsystem energy as a natural quantity which closely mimics the behavior of the entanglement entropy and can be defined for all the quantum many body systems. For this purpose, consider a quantum chain in…
We study how the Shannon entropy of sequences produced by an information source converges to the source's entropy rate. We synthesize several phenomenological approaches to applying information theoretic measures of randomness and memory to…
The Tsallis entropy given for a positive parameter $\alpha$ can be considered as a modification of the classical Shannon entropy. For the latter, corresponding to $\alpha=1$, there exist many axiomatic characterizations. One of them based…
We define a one-parameter family of entropies, each assigning a real number to any probability measure on a compact metric space (or, more generally, a compact Hausdorff space with a notion of similarity between points). These entropies…
We generalize, improve and unify theorems of Rumin, and Maassen--Uffink about classical entropies associated to quantum density matrices. These theorems refer to the classical entropies of the diagonals of a density matrix in two different…
We find, in an intrinsic form, a generalized Rankine-Hugoniot condition with respect to an entropy density that allows to give the proper interpretation to a formula of Vol'pert reducing the entropy condition on a function with bounded…
We explore a web of connections between quantum entanglement and knot theory by examining how topological entanglement entropy probes the braiding data of quasi-particles in Chern-Simons theory, mainly using $SU(2)$ gauge group as our…
The classical problem of maximizing the Shannon entropy of a sum of independent random variables supported on a finite alphabet is considered and settled in the ternary case. Namely, the following theorem is established: if…
Entropy is the measure of uncertainty in any data and is adopted for maximisation of mutual information in many remote sensing operations. The availability of wide entropy variations motivated us for an investigation over the suitability…
The wave-structure of moving electrons is analyzed on a fundamental level by employing a modified de Broglie relation. Formalizing the wave-function $\psi$ in real notation yields internal energy components due to mass oscillations. The…
Recent works emphasized the interest of numerical solution of PDE's with wavelets. In their works, A.Cohen, W.Dahmen and R.DeVore focussed on the non linear approximation aspect of the wavelet approximation of PDE's to prove the relevance…
We derive a novel chain rule for a family of channel conditional entropies, covering von Neumann and sandwiched R\'{e}nyi entropies. In the process, we show that these channel conditional entropies are equal to their regularized version,…
An interferometer - no matter how clever the design - cannot reveal both the wave and particle behavior of a quantum system. This fundamental idea has been captured by inequalities, so-called wave-particle duality relations (WPDRs), that…
We consider the two-dimensional (2d) Ising model on a infinitely long cylinder and study the probabilities $p_i$ to observe a given spin configuration $i$ along a circular section of the cylinder. These probabilities also occur as…
R\'enyi entropy of order \alpha is a general measure of entropy. In this paper we derive estimations for the R\'enyi entropy of the mixture of sources in terms of the entropy of the single sources. These relations allow to compute the…
General expressions for the R\'enyi entropies and central charges for higher derivative free spinors and scalars on even spheres are obtained using a direct spectral method on a compact lune division of the sphere. Formulae and numbers are…
In this paper, some general properties of Shannon information measures are investigated over sets of probability distributions with restricted marginals. Certain optimization problems associated with these functionals are shown to be…
Entanglement criteria for an $n$-partite quantum system with continuous variables are formulated in terms of R\'{e}nyi entropies. R\'{e}nyi entropies are widely used as a good information measure due to many nice properties. Derived…
In the present paper we prove a family of tight upper and lower bounds for the Shannon entropy and von Neumann entropy based on the p-norms. This allows us to have an entropy estimate, a criterion for the finiteness of it and a bound on the…