Related papers: Basic inequalities for weighted entropies
The properties of an alternative definition of quantum entropy, based on Wigner functions, are discussed. Such definition emerges naturally from the Wigner representation of quantum mechanics, and can easily quantify the amount of…
Non-Hermitian physics has become a fundamental framework for understanding open systems where gain and loss play essential roles, with impact across photonics, quantum science, and condensed matter. While the role of complex eigenvalues is…
Measure of the weighted cumulative entropy about the predictability of failure time of a system have been introduced in [3]. Referring properties of doubly truncated (interval) cumulative residual and past entropy, several bounds and…
Weighting methods are used in observational studies to adjust for covariate imbalances between treatment and control groups. Entropy balancing (EB) is an alternative to inverse probability weighting with an estimated propensity score. The…
We develop techniques to compute the k-th Moment of the Eigenvalue-statistic for a random Matrix M the entries of which do not have to be necessarily Independent. The dependence is controlled via an equivalence relation on the pairs of the…
Some of the important inequalities associated with quantum entropy are immediate algebraic consequences of the Hansen-Pedersen-Jensen inequality. A general argument is given in terms of the matrix perspective of an operator convex function.…
The new estimates of the conditional Shannon entropy are introduced in the framework of the model describing a discrete response variable depending on a vector of d factors having a density w.r.t. the Lebesgue measure in R^d. Namely, the…
A new sharp inequality featuring the differential R\'enyi entropy, the R\'enyi divergence and the R\'enyi cross-entropy of a pair of probability density functions is established. The equality is reached when one of the probability density…
Generalized versions of the entropic (Hirschman-Beckner) and support (Elad-Bruckstein) uncertainty principle are presented for frames representations. Moreover, a sharpened version of the support inequality has been obtained by introducing…
Information-theoretic inequalities play a fundamental role in numerous scientific and technological areas as they generally express the impossibility to have a complete description of a system via a finite number of information measures. In…
Entropies are fundamental measures of uncertainty with central importance in information theory and statistics and applications across all the quantitative sciences. Under a natural set of operational axioms, the most general form of…
The derivation of Bell inequalities in terms of quantum statistical (thermodynamic) entropies is considered. Inequalities of the Wigner form are derived but shown to be extremely limiting in their applicability due to the nature of the…
We propose a compression-based version of the empirical entropy of a finite string over a finite alphabet. Whereas previously one considers the naked entropy of (possibly higher order) Markov processes, we consider the sum of the…
The problem of Shannon entropy estimation in countable infinite alphabets is addressed from the study and use of convergence results of the entropy functional, which is known to be discontinuous with respect to the total variation distance…
This article explores weighted $(L^p, L^q)$ inequalities for the Fourier transform in rank one Riemannian symmetric spaces of noncompact type. We establish both necessary and sufficient conditions for these inequalities to hold. To prove…
Waist inequality is a fundamental inequality in geometry and topology. We apply it to the study of entropy and mean dimension of dynamical systems. We consider equivariant continuous maps between dynamical systems and assume that the mean…
We work out the general theory of one-parameter families of partial entanglement properties and the resulting entanglement depth-like quantities. Special cases of these are the depth of partitionability, the depth of producibility (or…
While most useful information theoretic inequalities can be deduced from the basic properties of entropy or mutual information, up to now Shannon's entropy power inequality (EPI) is an exception: Existing information theoretic proofs of the…
Take a random variable X with some finite exponential moments. Define an exponentially weighted expectation by E^t(f) = E(e^{tX}f)/E(e^{tX}) for admissible values of the parameter t. Denote the weighted expectation of X itself by r(t) =…
As one of the most commonly seen data challenges, missing data, in particular, multiple, non-monotone missing patterns, complicates estimation and inference due to the fact that missingness mechanisms are often not missing at random, and…