English
Related papers

Related papers: Information-Theoretic Perspectives on Brascamp-Lie…

200 papers

We advocate the use of a notion of entropy that reflects the relative abundances of the symbols in an alphabet, as well as the similarities between them. This concept was originally introduced in theoretical ecology to study the diversity…

Machine Learning · Computer Science 2022-07-12 Jose Gallego-Posada , Ankit Vani , Max Schwarzer , Simon Lacoste-Julien

Anantharam, Jog and Nair recently put forth an entropic inequality which simultaneously generalizes the Shannon-Stam entropy power inequality and the Brascamp-Lieb inequality in entropic form. We give a brief proof of their result based on…

Information Theory · Computer Science 2019-02-01 Thomas A. Courtade

In this paper, we provide a new PDE proof for the celebrated Borell--Brascamp--Lieb inequality. Our approach reveals a deep connection between the Borell--Brascamp--Lieb inequality and properties of diffusion equations of porous medium type…

Analysis of PDEs · Mathematics 2024-05-28 Kazuhiro Ishige , Qing Liu , Paolo Salani

We consider the problem of distributed lossy linear function computation in a tree network. We examine two cases: (i) data aggregation (only one sink node computes) and (ii) consensus (all nodes compute the same function). By quantifying…

Information Theory · Computer Science 2017-01-16 Yaoqing Yang , Pulkit Grover , Soummya Kar

An inequality of Brascamp-Lieb-Luttinger generalizes the Riesz-Sobolev inequality, stating that certain multilinear functionals, acting on nonnegative functions of one real variable with prescribed distribution functions, are maximized when…

Classical Analysis and ODEs · Mathematics 2017-06-12 Michael Christ

In this Thesis, several results in quantum information theory are collected, most of which use entropy as the main mathematical tool. *While a direct generalization of the Shannon entropy to density matrices, the von Neumann entropy behaves…

Quantum Physics · Physics 2018-10-25 Christian Majenz

The entropy power inequality, which plays a fundamental role in information theory and probability, may be seen as an analogue of the Brunn-Minkowski inequality. Motivated by this connection to Convex Geometry, we survey various recent…

Information Theory · Computer Science 2020-02-07 Mokshay Madiman , James Melbourne , Peng Xu

We adapt arguments concerning information-theoretic convergence in the Central Limit Theorem to the case of dependent random variables under Rosenblatt mixing conditions. The key is to work with random variables perturbed by the addition of…

Probability · Mathematics 2008-10-06 Oliver Johnson

Our capacity to process information depends on the computational power at our disposal. Information theory captures our ability to distinguish states or communicate messages when it is unconstrained with unrivaled beauty and elegance. For…

Quantum Physics · Physics 2026-04-08 Johannes Jakob Meyer , Asad Raza , Jacopo Rizzo , Lorenzo Leone , Sofiene Jerbi , Jens Eisert

During the last two decades, concentration of measure has been a subject of various exciting developments in convex geometry, functional analysis, statistical physics, high-dimensional statistics, probability theory, information theory,…

Information Theory · Computer Science 2015-10-13 Maxim Raginsky , Igal Sason

The relative $\alpha$-entropy is the R\'enyi analog of relative entropy and arises prominently in information-theoretic problems. Recent information geometric investigations on this quantity have enabled the generalization of the…

Information Theory · Computer Science 2020-02-13 Kumar Vijay Mishra , M. Ashok Kumar

Within its range of applicability, the Boltzmann equation seems unique in its capacity to accurately describe the transition from almost any initial state to a self-equilibrated thermal state. Using information-theoretic methods to rephrase…

Statistical Mechanics · Physics 2025-10-07 Jürgen T. Stockburger

In this paper, we propose our information-theoretic equivalence of entropic multi-marginal optimal transport (MOT). This equivalence can be easily reduced to the case of entropic optimal transport (OT). Because OT is widely used to compare…

Information Theory · Computer Science 2024-02-27 Shuchan Wang

We establish a reversal of Lyapunov's inequality for monotone log-concave sequences, settling a conjecture of Havrilla-Tkocz and Melbourne-Tkocz. A strengthened version of the same conjecture is disproved through counter example. We also…

Information Theory · Computer Science 2021-11-16 James Melbourne , Gerardo Palafox-Castillo

An information theoretic approach to bounds in superconformal field theories is proposed. It is proved that the supersymmetric R\'enyi entropy $\bar S_\alpha$ is a monotonically decreasing function of $\alpha$ and $(\alpha-1)\bar S_\alpha$…

High Energy Physics - Theory · Physics 2023-03-03 Yang Zhou

We prove a global nonlinear Brascamp-Lieb inequality for a general class of maps, encompassing polynomial and rational maps, as a consequence of the multilinear Kakeya-type inequalities of Zhang and Zorin-Kranich. We incorporate a natural…

Classical Analysis and ODEs · Mathematics 2024-01-17 Jennifer Duncan

We formulate a new information-theoretic principle--the shifted composition rule--which bounds the divergence (e.g., Kullback-Leibler or R\'enyi) between the laws of two stochastic processes via the introduction of auxiliary shifts. In this…

Probability · Mathematics 2023-11-27 Jason M. Altschuler , Sinho Chewi

The problem of assigning probability distributions which objectively reflect the prior information available about experiments is one of the major stumbling blocks in the use of Bayesian methods of data analysis. In this paper the method of…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Ariel Caticha , Roland Preuss

We review with a tutorial scope the information theory foundations of quantum statistical physics. Only a small proportion of the variables that characterize a system at the microscopic scale can be controlled, for both practical and…

Statistical Mechanics · Physics 2007-05-23 R. Balian

The H\"older-Brascamp-Lieb inequalities are a collection of multilinear inequalities generalizing a convolution inequality of Young and the Loomis-Whitney inequalities. The full range of exponents was classified in Bennett et al. (2008). In…

Classical Analysis and ODEs · Mathematics 2017-11-23 Kevin O'Neill