English
Related papers

Related papers: Gaussian maximum of entropy and reversed log-Sobol…

200 papers

We show that an information-theoretic property of Shannon's entropy power, known as concavity of entropy power, can be fruitfully employed to prove inequalities in sharp form. In particular, the concavity of entropy power implies the…

Information Theory · Computer Science 2012-07-13 Giuseppe Toscani

Relative to the Gaussian measure on $\mathbb{R}^d$, entropy and Fisher information are famously related via Gross' logarithmic Sobolev inequality (LSI). These same functionals also separately satisfy convolution inequalities, as proved by…

Information Theory · Computer Science 2016-08-22 Thomas A. Courtade

We generalize the usual exponential Boltzmann factor to any reasonable and potentially observable distribution function, $B(E)$. By defining generalized logarithms $\Lambda$ as inverses of these distribution functions, we are led to a…

Statistical Mechanics · Physics 2007-05-23 Rudolf Hanel , Stefan Thurner

We develop a reverse entropy power inequality for convex measures, which may be seen as an affine-geometric inverse of the entropy power inequality of Shannon and Stam. The specialization of this inequality to log-concave measures may be…

Functional Analysis · Mathematics 2012-04-02 Sergey Bobkov , Mokshay Madiman

We establish the equivalence between exponential decay of the relative entropy along a quantum Markov semigroup and the modified logarithmic Sobolev inequality for general von Neumann algebras. We also extend an intertwining criterion for…

Operator Algebras · Mathematics 2025-06-27 Melchior Wirth

An "entropy increasing to the maximum" result analogous to the entropic central limit theorem (Barron 1986; Artstein et al. 2004) is obtained in the discrete setting. This involves the thinning operation and a Poisson limit. Monotonic…

Information Theory · Computer Science 2009-11-18 Yaming Yu

For statistical systems that violate one of the four Shannon-Khinchin axioms, entropy takes a more general form than the Boltzmann-Gibbs entropy. The framework of superstatistics allows one to formulate a maximum entropy principle with…

Classical Physics · Physics 2012-11-13 Rudolf Hanel , Stefan Thurner , Murray Gell-Mann

Statements of Shannon's Noiseless Coding Theorem by various authors, including the original, are reviewed and clarified. Traditional statements of the theorem are often unclear as to when it applies. A new notation is introduced and the…

Information Theory · Computer Science 2010-11-01 L. F. Johnson

In this paper we remark that Shannon entropy can be expressed as a function of the self-information (i.e. the logarithm) and the inverse of the Lambert $W$ function. It means that we consider that Shannon entropy has the trace form: $-k…

Statistical Mechanics · Physics 2019-07-05 Laurent Truffet

We provide a simple physical interpretation, in the context of the second law of thermodynamics, to the information inequality (a.k.a. the Gibbs' inequality, which is also equivalent to the log-sum inequality), asserting that the relative…

Information Theory · Computer Science 2009-03-29 Neri Merhav

We give here a simple proof of weighted logarithmic Sobolev inequality, for example for Cauchy type measures, with optimal weight, sharpening results of Bobkov-Ledoux. Some consequences are also discussed.

Probability · Mathematics 2010-07-26 Patrick Cattiaux , Arnaud Guillin , Liming Wu

We establish dual equivalent forms involving relative entropy, Fisher information and optimal transport costs of inverse Santal{\'o} inequalities. We show in particular that the Mahler conjecture is equivalent to some dimensional lower…

Functional Analysis · Mathematics 2021-03-30 Nathaël Gozlan

In the present paper we give proof that the information-transmission capacity of the approximate position measurement with the oscillator energy constraint, which underlies noisy Gaussian homodyning in quantum optics, is attained on…

Quantum Physics · Physics 2022-08-18 A. S. Holevo

Within a framework of utmost generality, we show that the entropy maximization procedure with linear constraints uniquely leads to the Shannon-Boltzmann-Gibbs entropy. Therefore, the use of this procedure with linear constraints should not…

Statistical Mechanics · Physics 2018-05-01 Thomas Oikonomou , G. Baris Bagci

We show that Shannon's entropy--power inequality admits a strengthened version in the case in which the densities are log-concave. In such a case, in fact, one can extend the Blachman--Stam argument to obtain a sharp inequality for the…

Information Theory · Computer Science 2014-08-19 Giuseppe Toscani

Both direct and reverse log-Sobolev inequalities, relating the Shannon entropy with a $\mu$-deformed energy, are shown to hold in a family of $\mu$-deformed Segal-Bargmann spaces. This shows that the $\mu$-deformed energy of a state is…

Mathematical Physics · Physics 2007-07-24 Carlos Ernesto Angulo Aguila , Stephen Bruce Sontz

We establish a general class of entropy inequalities that take the concise form of Gaussian comparisons. The main result unifies many classical and recent results, including the Shannon-Stam inequality, the Brunn-Minkowski inequality, the…

Information Theory · Computer Science 2022-06-29 Efe Aras , Thomas A. Courtade

We develop an information-theoretic perspective on some questions in convex geometry, providing for instance a new equipartition property for log-concave probability measures, some Gaussian comparison results for log-concave measures, an…

Functional Analysis · Mathematics 2011-03-31 Sergey Bobkov , Mokshay Madiman

We establish a reverse inequality for Tsallis relative operator entropy involving a positive linear map. In addition, we present converse of Ando's inequality, for each parameter. We give examples to compare our results with the known…

Functional Analysis · Mathematics 2018-11-16 H. R. Moradi , S. Furuichi

We study the $p$-R\'{e}nyi entropy power inequality with a weight factor $t$ on two independent continuous random variables $X$ and $Y$. The extension essentially relies on a modulation on the sharp Young's inequality due to Bobkov and…

Quantum Physics · Physics 2023-11-28 Junseo Lee , Hyeonjun Yeo , Kabgyun Jeong
‹ Prev 1 2 3 10 Next ›