中文
相关论文

相关论文: A Counterexample to the Vector Generalization of C…

200 篇论文

This paper considers an entropy-power inequality (EPI) of Costa and presents a natural vector generalization with a real positive semidefinite matrix parameter. This new inequality is proved using a perturbation approach via a fundamental…

信息论 · 计算机科学 2009-03-18 Ruoheng Liu , Tie Liu , H. Vincent Poor , Shlomo Shamai

A simple multivariate version of Costa's entropy power inequality is proved. In particular, it is shown that if independent white Gaussian noise is added to an arbitrary multivariate signal, the entropy power of the resulting random…

信息论 · 计算机科学 2008-04-30 M. Payaró , D. P. Palomar

While most useful information theoretic inequalities can be deduced from the basic properties of entropy or mutual information, up to now Shannon's entropy power inequality (EPI) is an exception: Existing information theoretic proofs of the…

信息论 · 计算机科学 2016-11-17 Olivier Rioul

In this short note, we find an equivalent combinatorial condition only involving finite sums under which a centered Gaussian random vector with multinomial covariance matrix satisfies the Gaussian product inequality (GPI) conjecture. These…

概率论 · 数学 2023-08-24 Frédéric Ouimet

We tighten the Entropy Power Inequality (EPI) when one of the random summands is Gaussian. Our strengthening is closely connected to the concept of strong data processing for Gaussian channels and generalizes the (vector extension of)…

信息论 · 计算机科学 2016-02-10 Thomas A. Courtade

A combinatorial proof of the Gaussian product inequality (GPI) is given under the assumption that each component of a centered Gaussian random vector $\boldsymbol{X} = (X_1, \ldots, X_d)$ of arbitrary length can be written as a linear…

概率论 · 数学 2022-11-18 Christian Genest , Frédéric Ouimet

This paper is twofold. In the first part, we present a refinement of the R\'enyi Entropy Power Inequality (EPI) recently obtained in \cite{BM16}. The proof largely follows the approach in \cite{DCT91} of employing Young's convolution…

概率论 · 数学 2018-05-01 Jiange Li

When two independent analog signals, X and Y are added together giving Z=X+Y, the entropy of Z, H(Z), is not a simple function of the entropies H(X) and H(Y), but rather depends on the details of X and Y's distributions. Nevertheless, the…

量子物理 · 物理学 2014-02-21 Robert Koenig , Graeme Smith

We prove that the reciprocal of Fisher information of a log-concave probability density $X$ in ${\bf{R}}^n$ is concave in $t$ with respect to the addition of a Gaussian noise $Z_t = N(0, tI_n)$. As a byproduct of this result we show that…

信息论 · 计算机科学 2015-06-23 G. Toscani

We introduce a new generalization of relative entropy to non-negative vectors with sums $\gt 1$. We show in a purely combinatorial setting, with no probabilistic considerations, that in the presence of linear constraints defining a convex…

信息论 · 计算机科学 2024-05-08 Kostas N. Oikonomou

A framework for deriving R\'enyi entropy-power inequalities (EPIs) is presented that uses linearization and an inequality of Dembo, Cover, and Thomas. Simple arguments are given to recover the previously known R\'enyi EPIs and derive new…

信息论 · 计算机科学 2020-04-08 Olivier Rioul

We establish quantitative stability results for the entropy power inequality (EPI). Specifically, we show that if uniformly log-concave densities nearly saturate the EPI, then they must be close to Gaussian densities in the quadratic…

信息论 · 计算机科学 2016-10-26 Thomas A. Courtade , Max Fathi , Ashwin Pananjady

Many trace inequalities can be expressed either as concavity/convexity theorems or as monotonicity theorems. A classic example is the joint convexity of the quantum relative entropy which is equivalent to the Data Processing Inequality. The…

泛函分析 · 数学 2022-10-25 Eric A. Carlen , Haonan Zhang

While most useful information theoretic inequalities can be deduced from the basic properties of entropy or mutual information, Shannon's entropy power inequality (EPI) seems to be an exception: available information theoretic proofs of the…

信息论 · 计算机科学 2016-11-17 Olivier Rioul

The entropy power inequality (EPI) provides lower bounds on the differential entropy of the sum of two independent real-valued random variables in terms of the individual entropies. Versions of the EPI for discrete random variables have…

信息论 · 计算机科学 2013-01-18 Saeid Haghighatshoar , Emmanuel Abbe , Emre Telatar

Yet another simple proof of the entropy power inequality is given, which avoids both the integration over a path of Gaussian perturbation and the use of Young's inequality with sharp constant or R\'enyi entropies. The proof is based on a…

信息论 · 计算机科学 2017-02-22 Olivier Rioul

Aim of this short note is to study Shannon's entropy power along entropic interpolations, thus generalizing Costa's concavity theorem. We shall provide two proofs of independent interest: the former by $\Gamma$-calculus, hence applicable to…

信息论 · 计算机科学 2020-12-23 Luca Tamanini

This paper gives improved R\'{e}nyi entropy power inequalities (R-EPIs). Consider a sum $S_n = \sum_{k=1}^n X_k$ of $n$ independent continuous random vectors taking values on $\mathbb{R}^d$, and let $\alpha \in [1, \infty]$. An R-EPI…

信息论 · 计算机科学 2016-07-21 Eshed Ram , Igal Sason

This article addresses the issue of the proof of the entropy power inequality (EPI), an important tool in the analysis of Gaussian channels of information transmission, proposed by Shannon. We analyse continuity properties of the mutual…

信息论 · 计算机科学 2013-04-04 Mark Kelbert , Yuri Suhov

This note establishes that the opposite Gaussian product inequality (GPI) of the type proved by Russell & Sun (2022a) in two dimensions, and partially extended to higher dimensions by Zhou et al. (2024), continues to hold for an arbitrary…

概率论 · 数学 2025-07-23 Guolie Lan , Frédéric Ouimet , Wei Sun
‹ 上一页 1 2 3 10 下一页 ›