English
Related papers

Related papers: Dimensional behaviour of entropy and information

200 papers

The entropy power inequality, which plays a fundamental role in information theory and probability, may be seen as an analogue of the Brunn-Minkowski inequality. Motivated by this connection to Convex Geometry, we survey various recent…

Information Theory · Computer Science 2020-02-07 Mokshay Madiman , James Melbourne , Peng Xu

We develop a reverse entropy power inequality for convex measures, which may be seen as an affine-geometric inverse of the entropy power inequality of Shannon and Stam. The specialization of this inequality to log-concave measures may be…

Functional Analysis · Mathematics 2012-04-02 Sergey Bobkov , Mokshay Madiman

We study the connection between the concavity properties of a measure $\nu$ and the convexity properties of the associated relative entropy $D(\cdot \Vert \nu)$ along optimal transport. As a corollary we prove a new dimensional…

Metric Geometry · Mathematics 2026-03-24 Gautam Aishwarya , Liran Rotem

We develop information-theoretic measures of spatial structure and pattern in more than one dimension. As is well known, the entropy density of a two-dimensional configuration can be efficiently and accurately estimated via a converging…

Statistical Mechanics · Physics 2009-11-07 David P. Feldman , James P. Crutchfield

An important theme in recent work in asymptotic geometric analysis is that many classical implications between different types of geometric or functional inequalities can be reversed in the presence of convexity assumptions. In this note,…

Probability · Mathematics 2015-07-22 Elizabeth S. Meckes , Mark W. Meckes

We establish sharp exponential deviation estimates of the information content as well as a sharp bound on the varentropy for the class of convex measures on Euclidean spaces. This generalizes a similar development for log-concave measures…

Probability · Mathematics 2020-02-25 Matthieu Fradelizi , Jiange Li , Mokshay Madiman

We show the equivalences of several notions of entropy, like a version of the topological entropy of the geodesic flow and the Minkowski dimension of the boundary, in metric spaces with convex geodesic bicombings satisfying a uniform…

Dynamical Systems · Mathematics 2021-05-26 Nicola Cavallucci

Elaborating on the similarity between the entropy power inequality and the Brunn-Minkowski inequality, Costa and Cover conjectured in {\it On the similarity of the entropy power inequality and the Brunn-Minkowski inequality} (IEEE Trans.…

Functional Analysis · Mathematics 2013-02-26 Matthieu Fradelizi , Arnaud Marsiglietti

We establish a reversal of Lyapunov's inequality for monotone log-concave sequences, settling a conjecture of Havrilla-Tkocz and Melbourne-Tkocz. A strengthened version of the same conjecture is disproved through counter example. We also…

Information Theory · Computer Science 2021-11-16 James Melbourne , Gerardo Palafox-Castillo

We prove that the exponent of the entropy of one dimensional projections of a log-concave random vector defines a 1/5-seminorm. We make two conjectures concerning reverse entropy power inequalities in the log-concave setting and discuss…

Probability · Mathematics 2018-01-25 Keith Ball , Piotr Nayar , Tomasz Tkocz

We introduce an inequality which may be viewed as a generalization of both the Brascamp-Lieb inequality and its reverse (Barthe's inequality), and prove its information-theoretic (i.e.\ entropic) formulation. This result leads to a unified…

Information Theory · Computer Science 2017-12-05 Jingbo Liu , Thomas A. Courtade , Paul Cuff , Sergio Verdu

We produce a series of results extending information-theoretical inequalities (discussed by Dembo--Cover--Thomas in 1989-1991) to a weighted version of entropy. The resulting inequalities involve the Gaussian weighted entropy; they imply a…

Information Theory · Computer Science 2015-05-08 Y. Suhov , S. Yasaei Sekeh , I. Stuhl

Relative to the Gaussian measure on $\mathbb{R}^d$, entropy and Fisher information are famously related via Gross' logarithmic Sobolev inequality (LSI). These same functionals also separately satisfy convolution inequalities, as proved by…

Information Theory · Computer Science 2016-08-22 Thomas A. Courtade

Entropy and information can be considered dual: entropy is a measure of the subspace defined by the information constraining the given ambient space. Negative entropies, arising in na\"ive extensions of the definition of entropy from…

Probability · Mathematics 2023-03-06 Daniel Lazarev

In this work, we study generalized entropies and information geometry in a group-theoretical framework. We explore the conditions that ensure the existence of some natural properties and at the same time of a group-theoretical structure for…

Mathematical Physics · Physics 2021-08-03 Miguel A. Rodríguez , Álvaro Romaniega , Piergiulio Tempesta

We extend the result of Ball and Nguyen on the jump of entropy under convolution for logconcave random vectors. We show that the result holds for any pair of vectors (not necessarily identically distributed) and that a similar inequality…

Functional Analysis · Mathematics 2021-11-08 Pierre Bizeul

We use a novel form of quantum conditional probability to define new measures of quantum information in a dynamical context. We explore relationships between our new quantities and standard measures of quantum information, such as von…

Quantum Physics · Physics 2022-12-09 Jacob A. Barandes , David Kagan

A considerable amount of literature in the theory of inequality is devoted to the study of Jensen's and Young's inequality. This article presents a number of new inequalities involving the log-convex functions and the geometrically convex…

Classical Analysis and ODEs · Mathematics 2022-02-10 Shigeru Furuichi , Hamid Reza Moradi , Supriyo Dutta

We show that an information-theoretic property of Shannon's entropy power, known as concavity of entropy power, can be fruitfully employed to prove inequalities in sharp form. In particular, the concavity of entropy power implies the…

Information Theory · Computer Science 2012-07-13 Giuseppe Toscani

In an earlier paper \cite{mazeng} the authors introduced the notion of curvature entropy, and proved the plane log-Minkowski inequality of curvature entropy under the symmetry assumption. In this paper we demonstrate the plane log-Minkowski…

Metric Geometry · Mathematics 2022-11-29 Chunna Zeng , Xu Dong , Yaling Wang , Lei Ma
‹ Prev 1 2 3 10 Next ›