English
Related papers

Related papers: Entropy-power inequality for weighted entropy

200 papers

A number of inequalities for the weighted entropies is proposed, mirroring properties of a standard (Shannon) entropy and related quantities.

Information Theory · Computer Science 2015-10-12 Yuri Suhov , Salimeh Yasaei Sekeh

This paper represents an extended version of an earlier note [10]. The concept of weighted entropy takes into account values of different outcomes, i.e., makes entropy context-dependent, through the weight function. We analyse analogs of…

Probability · Mathematics 2017-10-31 Mark Kelbert , Izabella Stuhl , Yuri Suhov

This note contributes to the understanding of generalized entropy power inequalities. Our main goal is to construct a counter-example regarding monotonicity and entropy comparison of weighted sums of independent identically distributed…

Information Theory · Computer Science 2021-10-20 Mokshay Madiman , Piotr Nayar , Tomasz Tkocz

An extension of the entropy power inequality to the form $N_r^\alpha(X+Y) \geq N_r^\alpha(X) + N_r^\alpha(Y)$ with arbitrary independent summands $X$ and $Y$ in $\mathbb{R}^n$ is obtained for the R\'enyi entropy and powers $\alpha \geq…

Information Theory · Computer Science 2017-10-25 Sergey Bobkov , Arnaud Marsiglietti

We provide a condition under which a version of Shannon's Entropy Power Inequality will hold for dependent variables. We provide information inequalities extending those found in the independent case.

Probability · Mathematics 2007-05-23 Oliver Johnson

We present an entropy comparison result concerning weighted sums of independent and identically distributed random variables.

Information Theory · Computer Science 2009-09-24 Yaming Yu

The entropy power inequality for independent random vectors is a foundational result of information theory, with deep connections to probability and geometric functional analysis. Several extensions of the entropy power inequality have been…

Information Theory · Computer Science 2025-12-23 Mokshay Madiman , James Melbourne , Cyril Roberto

Yet another simple proof of the entropy power inequality is given, which avoids both the integration over a path of Gaussian perturbation and the use of Young's inequality with sharp constant or R\'enyi entropies. The proof is based on a…

Information Theory · Computer Science 2017-02-22 Olivier Rioul

R\'enyi entropy of order \alpha is a general measure of entropy. In this paper we derive estimations for the R\'enyi entropy of the mixture of sources in terms of the entropy of the single sources. These relations allow to compute the…

Information Theory · Computer Science 2012-04-13 Marek Śmieja , Jacek Tabor

We introduce quantum weighted entropy in analogy to an earlier notion of (classical) weighted entropy and derive many of its properties. These include the subadditivity, concavity and strong subadditivity property of quantum weighted…

Quantum Physics · Physics 2014-11-05 Y. Suhov , S. Zohren

We show that Shannon's entropy--power inequality admits a strengthened version in the case in which the densities are log-concave. In such a case, in fact, one can extend the Blachman--Stam argument to obtain a sharp inequality for the…

Information Theory · Computer Science 2014-08-19 Giuseppe Toscani

The entropy power inequality, which plays a fundamental role in information theory and probability, may be seen as an analogue of the Brunn-Minkowski inequality. Motivated by this connection to Convex Geometry, we survey various recent…

Information Theory · Computer Science 2020-02-07 Mokshay Madiman , James Melbourne , Peng Xu

In this paper we study two different weighted isoperimetric inequalities. In the first part of the paper we prove a sharp stability result for the isoperimetric inequality with a log-convex weight. In the second part we analize the behavior…

Analysis of PDEs · Mathematics 2022-07-21 Nicola Fusco , Domenico Angelo La Manna

The matrix version of the entropy-power inequality for real or complex coefficients and variables is proved using a transportation argument that easily settles the equality case. An application to blind source extraction is given.

Information Theory · Computer Science 2019-06-04 Olivier Rioul , Ram Zamir

We give a short proof of a recent inequality of Audenaert, Datta and Ozols, and determine cases of equality.

Mathematical Physics · Physics 2016-06-29 Eric A. Carlen , Elliott H. Lieb , Michael Loss

The aim of this paper is to analyze the weighted KyFan inequality proposed in [11]. A number of numerical simulations involving the exponential weighted function is given. We show that in several cases and types of examples one can imply an…

Information Theory · Computer Science 2015-04-07 Yuri Suhov , Salimeh Yasaei Sekeh

The analog of the Schauder inequality for closed surfaces in Euclidean spaces is obtained in this article.

Differential Geometry · Mathematics 2007-06-18 Andrei Bodrenko

The concept of weighted entropy takes into account values of different outcomes, i.e., makes entropy context-dependent, through the weight function. In this paper, we establish a number of simple inequalities for the weighted entropies…

Information Theory · Computer Science 2016-01-15 Yuri Suhov , Izabella Stuhl , Salimeh Yasaei Sekeh , Mark Kelbert

We study the $p$-R\'{e}nyi entropy power inequality with a weight factor $t$ on two independent continuous random variables $X$ and $Y$. The extension essentially relies on a modulation on the sharp Young's inequality due to Bobkov and…

Quantum Physics · Physics 2023-11-28 Junseo Lee , Hyeonjun Yeo , Kabgyun Jeong

In this work, the q-analogue of Bernoulli inequality is proved. Some other related results are presented.

Classical Analysis and ODEs · Mathematics 2018-03-28 Mohammad W. Alomari
‹ Prev 1 2 3 10 Next ›