English
Related papers

Related papers: Information-Theoretic Perspectives on Brascamp-Lie…

200 papers

We show how convergence to the Gumbel distribution in an extreme value setting can be understood in an information-theoretic sense. We introduce a new type of score function which behaves well under the maximum operation, and which implies…

Statistics Theory · Mathematics 2024-07-22 Oliver Johnson

Information theory is an outstanding framework to measure uncertainty, dependence and relevance in data and systems. It has several desirable properties for real world applications: it naturally deals with multivariate data, it can handle…

Machine Learning · Statistics 2024-10-30 Valero Laparra , J. Emmanuel Johnson , Gustau Camps-Valls , Raul Santos-Rodríguez , Jesus Malo

The works of Bennett, Carbery, Christ, Tao and of Valdimarsson have clarified when equality holds in the Brascamp-Lieb inequality. Here we characterize the case of equality in the Geometric case of Barthe's reverse Brascamp-Lieb inequality.

Functional Analysis · Mathematics 2022-11-30 Karoly J. Boroczky , Pavlos Kalantzopoulos , Dongmeng Xi

Relying substantially on work of Garg, Gurvits, Oliveira and Wigderson, it is shown that geometric Brascamp--Lieb data are, in a certain sense, ubiquitous. This addresses a question raised by Bennett and Tao in their recent work on the…

Classical Analysis and ODEs · Mathematics 2024-08-01 Neal Bez , Anthony Gauvan , Hiroshi Tsuji

We study the infimum of the best constant in a functional inequality, the Brascamp-Lieb-like inequality, over auxiliary measures within a neighborhood of a product distribution. In the finite alphabet and the Gaussian cases, such an infimum…

Information Theory · Computer Science 2016-02-09 Jingbo Liu , Thomas A. Courtade , Paul Cuff , Sergio Verdu

We prove a new extremal inequality, motivated by the vector Gaussian broadcast channel and the distributed source coding with a single quadratic distortion constraint problems. As a corollary, this inequality yields a generalization of the…

Information Theory · Computer Science 2007-07-13 Tie Liu , Pramod Viswanath

We use the characterization of the case of equality in Barthe's Geometric Reverse Brascamp-Lieb inequality to characterize equality in Liakopoulos's volume estimate in terms of sections by certain lower-dimensional linear subspaces.

Metric Geometry · Mathematics 2026-04-09 Karoly J. Böröczky , Ferenc Fodor , Pavlos Kalantzopoulos

While most useful information theoretic inequalities can be deduced from the basic properties of entropy or mutual information, up to now Shannon's entropy power inequality (EPI) is an exception: Existing information theoretic proofs of the…

Information Theory · Computer Science 2016-11-17 Olivier Rioul

The goal of this note is to show that some convolution type inequalities from Harmonic Analysis and Information Theory, such as Young's convolution inequality (with sharp constant), Nelson's hypercontractivity of the Hermite semi-group or…

Functional Analysis · Mathematics 2009-07-17 Dario Cordero-Erausquin , Michel Ledoux

We derive two concentration inequalities for linear functions of log-concave distributions: an enhanced version of the classical Brascamp--Lieb concentration inequality, and an inequality quantifying log-concavity of marginals in a manner…

Mathematical Physics · Physics 2021-11-23 Alexander Magazinov , Ron Peled

The extremal inequality approach plays a key role in network information theory problems. In this paper, we propose a novel monotone path construction in product probability space. The optimality of Gaussian distribution is then established…

Information Theory · Computer Science 2021-09-02 Yinfei Xu , Guojun Chen

We establish a nonlinear generalisation of the classical Brascamp-Lieb inequality in the case where the Lebesgue exponents lie in the interior of the finiteness polytope. As a corollary we show that the best constant in Young's convolution…

Classical Analysis and ODEs · Mathematics 2018-01-17 Jonathan Bennett , Neal Bez , Stefan Buschenhenke , Taryn C. Flock

We establish a general class of entropy inequalities that take the concise form of Gaussian comparisons. The main result unifies many classical and recent results, including the Shannon-Stam inequality, the Brunn-Minkowski inequality, the…

Information Theory · Computer Science 2022-06-29 Efe Aras , Thomas A. Courtade

This paper proposes a unifying variational approach for proving and extending some fundamental information theoretic inequalities. Fundamental information theory results such as maximization of differential entropy, minimization of Fisher…

Information Theory · Computer Science 2016-02-05 Sangwoo Park , Erchin Serpedin , Khalid Qaraqe

The celebrated Brascamp-Lieb (BL) inequalities (and their extensions) are an important mathematical tool, unifying and generalizing numerous inequalities in analysis, convex geometry and information theory. While their structural theory is…

Computational Complexity · Computer Science 2018-04-16 Ankit Garg , Leonid Gurvits , Rafael Oliveira , Avi Wigderson

"Bounds on information combining" are entropic inequalities that determine how the information (entropy) of a set of random variables can change when these are combined in certain prescribed ways. Such bounds play an important role in…

Quantum Physics · Physics 2019-08-27 Christoph Hirche , David Reeb

We study the problem of distributed information bottleneck, in which multiple encoders separately compress their observations in a manner such that, collectively, the compressed signals preserve as much information as possible about another…

Information Theory · Computer Science 2017-10-04 Inaki Estella Aguerri , Abdellatif Zaidi

In this paper, we derive sharp nonlinear dimension-free Brascamp--Lieb inequalities (including hypercontractivity inequalities) for distributions on Polish spaces, which strengthen the classic Brascamp--Lieb inequalities. Applications…

Functional Analysis · Mathematics 2021-11-23 Lei Yu

We show that a proper expression of the uncertainty relation for a pair of canonically-conjugate continuous variables relies on entropy power, a standard notion in Shannon information theory for real-valued signals. The resulting…

Quantum Physics · Physics 2018-01-16 Anaelle Hertz , Michael G. Jabbour , Nicolas J. Cerf

This dissertation investigates relative entropies, also called generalized divergences, and how they can be used to characterize information-theoretic tasks in quantum information theory. The main goal is to further refine characterizations…

Quantum Physics · Physics 2016-11-29 Felix Leditzky