English
Related papers

Related papers: A Vector Generalization of Costa's Entropy-Power I…

200 papers

A framework for deriving R\'enyi entropy-power inequalities (EPIs) is presented that uses linearization and an inequality of Dembo, Cover, and Thomas. Simple arguments are given to recover the previously known R\'enyi EPIs and derive new…

Information Theory · Computer Science 2020-04-08 Olivier Rioul

Recently de Palma et al. [IEEE Trans. Inf. Theory 63, 728 (2017)] proved---using Lagrange multiplier techniques---that under a non-zero input entropy constraint, a thermal state input minimizes the output entropy of a pure-loss bosonic…

Quantum Physics · Physics 2017-07-27 Haoyu Qi , Mark M. Wilde , Saikat Guha

We establish quantitative stability results for the entropy power inequality (EPI). Specifically, we show that if uniformly log-concave densities nearly saturate the EPI, then they must be close to Gaussian densities in the quadratic…

Information Theory · Computer Science 2016-10-26 Thomas A. Courtade , Max Fathi , Ashwin Pananjady

The entropy power inequality (EPI) and the Brascamp-Lieb inequality (BLI) are fundamental inequalities concerning the differential entropies of linear transformations of random vectors. The EPI provides lower bounds for the differential…

Information Theory · Computer Science 2021-09-28 Venkat Anantharam , Varun Jog , Chandra Nair

In this paper, we study the connection between entropic optimal transport and entropy power inequality (EPI). First, we prove an HWI-type inequality making use of the infinitesimal displacement convexity of optimal transport map. Second, we…

Information Theory · Computer Science 2024-07-01 Shuchan Wang , Photios A. Stavrou , Mikael Skoglund

This paper proposes a unifying variational approach for proving and extending some fundamental information theoretic inequalities. Fundamental information theory results such as maximization of differential entropy, minimization of Fisher…

Information Theory · Computer Science 2016-02-05 Sangwoo Park , Erchin Serpedin , Khalid Qaraqe

The paper establishes the equality condition in the I-MMSE proof of the entropy power inequality (EPI). This is done by establishing an exact expression for the deficit between the two sides of the EPI. Interestingly, a necessary condition…

Information Theory · Computer Science 2017-03-23 Alex Dytso , Ronit Bustin , H. Vincent Poor , Shlomo Shamai

Costa's entropy power inequality is an important generalization of Shannon's entropy power inequality. Related with Costa's entropy power inequality and a conjecture proposed by McKean in 1966, Cheng-Geng recently conjectured that $D(m,n):…

Probability · Mathematics 2020-04-21 Laigang Guo , Chun-Ming Yuan , Xiao-Shan Gao

The ability of quantum states to be in superposition is one of the key features that sets them apart from the classical world. This `coherence' is rigorously quantified by resource theories, which aim to understand how such properties may…

Quantum Physics · Physics 2024-07-08 Ruvi Lecamwasam , Syed M Assad , Joseph J Hope , Ping Koy Lam , Jayne Thompson , Mile Gu

Relative Fisher information, also known as score matching, is a recently introduced learning method for parameter estimation. Fundamental relations between relative entropy and score matching have been established in the literature for…

Information Theory · Computer Science 2025-04-29 Yirong Shen , Lu Gan , Cong Ling

The entropy power inequality for independent random vectors is a foundational result of information theory, with deep connections to probability and geometric functional analysis. Several extensions of the entropy power inequality have been…

Information Theory · Computer Science 2025-12-23 Mokshay Madiman , James Melbourne , Cyril Roberto

The matrix version of the entropy-power inequality for real or complex coefficients and variables is proved using a transportation argument that easily settles the equality case. An application to blind source extraction is given.

Information Theory · Computer Science 2019-06-04 Olivier Rioul , Ram Zamir

In this paper, we investigate upper and lower bounds on the capacity of two-user fading broadcast channels where one of the users has a constant (non-fading) channel. We use the Costa entropy power inequality (EPI) along with an…

Information Theory · Computer Science 2009-01-01 Amin Jafarian , Sriram Vishwanath

The R{\'e}nyi entropy is one of the important information measures that generalizes Shannon's entropy. The quantum R{\'e}nyi entropy has a fundamental role in quantum information theory, therefore, bounding this quantity is of vital…

Mathematical Physics · Physics 2016-09-26 Hadi Reisizadeh , S. Mahmoud Manjegani

In this paper, we consider the problem of secret key generation with one-way communication through both a rate-limited public channel and a rate-limited secure channels where the public channel is from Alice to Bob and Eve and the secure…

Information Theory · Computer Science 2020-04-13 Yinfei Xu , Daming Cao

We propose a generalization of the quantum entropy power inequality involving conditional entropies. For the special case of Gaussian states, we give a proof based on perturbation theory for symplectic spectra. We discuss some implications…

Quantum Physics · Physics 2015-06-15 Robert Koenig

Following a recent proof of Shannon's entropy power inequality (EPI), a comprehensive framework for deriving various EPIs for the R\'enyi entropy is presented that uses transport arguments from normal densities and a change of variable by…

Information Theory · Computer Science 2018-10-17 Olivier Rioul

The phenomenon of entropy concentration provides strong support for the maximum entropy method, MaxEnt, for inferring a probability vector from information in the form of constraints. Here we extend this phenomenon, in a discrete setting,…

Information Theory · Computer Science 2021-01-11 Kostas N. Oikonomou

We establish a quantum version of the classical isoperimetric inequality relating the Fisher information and the entropy power of a quantum state. The key tool is a Fisher information inequality for a state which results from a certain…

Quantum Physics · Physics 2017-02-16 Stefan Huber , Robert Koenig , Anna Vershynina

Yet another simple proof of the entropy power inequality is given, which avoids both the integration over a path of Gaussian perturbation and the use of Young's inequality with sharp constant or R\'enyi entropies. The proof is based on a…

Information Theory · Computer Science 2017-02-22 Olivier Rioul