Related papers: A new entropy power inequality for integer-valued …
Costa's entropy power inequality is an important generalization of Shannon's entropy power inequality. Related with Costa's entropy power inequality and a conjecture proposed by McKean in 1966, Cheng-Geng recently conjectured that $D(m,n):…
The entropy force is the collective effect of inhomogeneity in disorder in a statistical many particle system. We demonstrate its presumable effect on one particular astrophysical object, the black hole. We then derive the kinetic equations…
Entropy and information can be considered dual: entropy is a measure of the subspace defined by the information constraining the given ambient space. Negative entropies, arising in na\"ive extensions of the definition of entropy from…
We study the relative entropy between the empirical estimate of a discrete distribution and the true underlying distribution. If the minimum value of the probability mass function exceeds an $\alpha > 0$ (i.e. when the true underlying…
This paper develops a new divergence that generalizes relative entropy and can be used to compare probability measures without a requirement of absolute continuity. We establish properties of the divergence, and in particular derive and…
Researchers in physical science aim to uncover universal features in strongly interacting many-body systems, often hidden in complicated observables like entanglement entropy (EE). The non-local nature of EE makes it challenging to compute…
The celebrated Hardy inequality can be written in the form $$\int_0^\infty \mathcal{P}_p \big(f|_{[0,x]}\big)dx \le (1-p)^{-1/p} \int_0^\infty f(x)\:dx \qquad \text{ for }p\in(0,1)\text{ and }f \in L^1\text{ with }f\ge0,$$ where…
We present two classes of improved estimators for mutual information $M(X,Y)$, from samples of random points distributed according to some joint probability density $\mu(x,y)$. In contrast to conventional estimators based on binnings, they…
A common statistical situation concerns inferring an unknown distribution Q(x) from a known distribution P(y), where X (dimension n), and Y (dimension m) have a known functional relationship. Most commonly, n<m, and the task is relatively…
Conditional mutual information is important in the selection and interpretation of graphical models. Its empirical version is well known as a generalised likelihood ratio test and that it may be represented as a difference in entropy. We…
We consider a new functional inequality controlling the rate of relative entropy decay for random walks, the interchange process and more general block-type dynamics for permutations. The inequality lies between the classical logarithmic…
Statistical mechanics relies on the complete though probabilistic description of a system in terms of all the microscopic variables. Its object is to derive therefrom static and dynamic properties involving some reduced set of variables.…
The $\alpha$-$z$ R\'enyi relative entropies are a two-parameter family of R\'enyi relative entropies that are quantum generalizations of the classical $\alpha$-R\'enyi relative entropies. In \cite{zhang20CFL} we decided the full range of…
We consider the maximum entropy problems associated with R\'enyi $Q$-entropy, subject to two kinds of constraints on expected values. The constraints considered are a constraint on the standard expectation, and a constraint on the…
The unknown amplitude law q(x) defining an observed effect may be found using the principle of Extreme Physical Information. EPI is derived as follows. The observations follow an information flow J --> I, with J the information intrinsic to…
We show how the fundamental entropic inequality proved recently in [arXiv:2408.15306] can be applied to obtain a useful relation for the Holevo quantity of discrete and continuous ensembles of quantum states. This relation gives a tight…
We derive a universal inequality that provides a lower bound on the ensemble-averaged von Neumann entropy change in a quantum system subject to continuous measurement and dissipation. Our result clarifies how entropy production is…
Recent experiments using innovative optical detectors and techniques have strongly increased the capacity of testing the violation of the Bell's inequalities in the Nature. Most of them have used the Eberhardt's inequality (EI) to close the…
We show a direct relationship between the variance and the differential entropy for subclasses of symmetric and asymmetric unimodal distributions by providing an upper bound on variance in terms of entropy power. Combining this bound with…
Typically, the entropy of an isolated system in equilibrium is calculated by counting the number of accessible microstates, or in more general cases by using the Gibbs formula. In irreversible processes entropy spontaneously increases and…