English
Related papers

Related papers: Entropy and Information jump for log-concave vecto…

200 papers

We prove a quantitative dimension-free bound in the Shannon-Stam Entropy inequality for the convolution of two log-concave distributions in dimension d interms of the spectral gap of the density. The method relies on the analysis of the…

Functional Analysis · Mathematics 2013-06-04 Keith Ball , Van Hoang Nguyen

We establish analogues of the Bergstr\"om and Bonnesen inequalities, related to determinants and volumes respectively, for the entropy power and for the Fisher information. The obtained inequalities strengthen the well-known convolution…

Information Theory · Computer Science 2025-01-20 Matthieu Fradelizi , Lampros Gavalakis , Martin Rapaport

Relative to the Gaussian measure on $\mathbb{R}^d$, entropy and Fisher information are famously related via Gross' logarithmic Sobolev inequality (LSI). These same functionals also separately satisfy convolution inequalities, as proved by…

Information Theory · Computer Science 2016-08-22 Thomas A. Courtade

We show that Shannon's entropy--power inequality admits a strengthened version in the case in which the densities are log-concave. In such a case, in fact, one can extend the Blachman--Stam argument to obtain a sharp inequality for the…

Information Theory · Computer Science 2014-08-19 Giuseppe Toscani

We establish a quantitative bound on the entropy jump associated to the sum of independent, identically distributed (IID) radially symmetric random vectors having dimension greater than one. Following the usual approach, we first consider…

Information Theory · Computer Science 2016-11-04 Thomas A. Courtade

We prove stability estimates for the Shannon-Stam inequality (also known as the entropy-power inequality) for log-concave random vectors in terms of entropy and transportation distance. In particular, we give the first stability estimate…

Information Theory · Computer Science 2020-09-08 Ronen Eldan , Dan Mikulincer

In this paper we introduce a new generalisation of the relative Fisher Information for Markov jump processes on a finite or countable state space, and prove an inequality which connects this object with the relative entropy and a large…

Functional Analysis · Mathematics 2018-12-12 Bastian Hilder , Mark A. Peletier , Upanshu Sharma , Oliver Tse

We develop an information-theoretic perspective on some questions in convex geometry, providing for instance a new equipartition property for log-concave probability measures, some Gaussian comparison results for log-concave measures, an…

Functional Analysis · Mathematics 2011-03-31 Sergey Bobkov , Mokshay Madiman

We show that the nonlocal Fisher information - defined as the entropy dissipation of the Boltzmann entropy for nonlocal heat equations - admits a natural lifting in the sense of Guillen and Silvestre (2025). Important examples include the…

Analysis of PDEs · Mathematics 2026-03-24 Fabian Merz , Rico Zacher

The entropy power inequality for independent random vectors is a foundational result of information theory, with deep connections to probability and geometric functional analysis. Several extensions of the entropy power inequality have been…

Information Theory · Computer Science 2025-12-23 Mokshay Madiman , James Melbourne , Cyril Roberto

Dynamical aspects of information-theoretic and entropic measures of quantum systems are studied. First, we show that for the time-dependent harmonic oscillator, as well as for the charged particle in certain time-varying electromagnetic…

Quantum Physics · Physics 2022-03-22 K. Andrzejewski

We establish several convexity properties for the entropy and Fisher information of mixtures of centered Gaussian distributions. First, we prove that if $X_1, X_2$ are independent scalar Gaussian mixtures, then the entropy of $\sqrt{t}X_1 +…

Information Theory · Computer Science 2024-02-19 Alexandros Eskenazis , Lampros Gavalakis

An elementary proof is provided of sharp bounds for the varentropy of random vectors with log-concave densities, as well as for deviations of the information content from its mean. These bounds significantly improve on the bounds obtained…

Probability · Mathematics 2019-03-06 Matthieu Fradelizi , Mokshay Madiman , Liyao Wang

When two independent analog signals, X and Y are added together giving Z=X+Y, the entropy of Z, H(Z), is not a simple function of the entropies H(X) and H(Y), but rather depends on the details of X and Y's distributions. Nevertheless, the…

Quantum Physics · Physics 2014-02-21 Robert Koenig , Graeme Smith

While most useful information theoretic inequalities can be deduced from the basic properties of entropy or mutual information, up to now Shannon's entropy power inequality (EPI) is an exception: Existing information theoretic proofs of the…

Information Theory · Computer Science 2016-11-17 Olivier Rioul

We show that an information-theoretic property of Shannon's entropy power, known as concavity of entropy power, can be fruitfully employed to prove inequalities in sharp form. In particular, the concavity of entropy power implies the…

Information Theory · Computer Science 2012-07-13 Giuseppe Toscani

We consider the central limit theorem for stable laws in the case of the standardized sum of independent and identically distributed random variables with regular probability density function. By showing decay of different entropy…

Probability · Mathematics 2016-10-12 Giuseppe Toscani

We establish a variant of the log-Sobolev and transport-information inequalities for mixture distributions. If a probability measure $\pi$ can be decomposed into components that individually satisfy such inequalities, then any measure $\mu$…

Information Theory · Computer Science 2026-03-16 Jonathan Niles-Weed

Upper and lower bounds are obtained for the joint entropy of a collection of random variables in terms of an arbitrary collection of subset joint entropies. These inequalities generalize Shannon's chain rule for entropy as well as…

Information Theory · Computer Science 2024-05-07 Mokshay Madiman , Prasad Tetali

Information entropic measures such as Fisher information, Shannon entropy, Onicescu energy and Onicescu Shannon entropy of a symmetric double-well potential are calculated in both position and momentum space. Eigenvalues and eigenvectors of…

Quantum Physics · Physics 2019-04-26 Neetik Mukherjee , Arunesh Roy , Amlan K. Roy
‹ Prev 1 2 3 10 Next ›