English
Related papers

Related papers: The concavity of generalized entropy powers

200 papers

Many common probability distributions in statistics like the Gaussian, multinomial, Beta or Gamma distributions can be studied under the unified framework of exponential families. In this paper, we prove that both R\'enyi and Tsallis…

Information Theory · Computer Science 2012-02-01 Frank Nielsen , Richard Nock

Using Tsallis statistics and its relation with Boltzmann entropy, the Tsallis entropy content of black holes is achieved, a result in full agreement with a recent study (Phys. Lett. B 794, 24 (2019)). In addition, employing Kaniadakis…

General Relativity and Quantum Cosmology · Physics 2020-08-18 H. Moradpour , A. H. Ziaie , M. Kord Zangeneh

In this paper, we generalize the log-Sobolev inequalities to R\'enyi--Sobolev inequalities by replacing the entropy with the two-parameter entropy, which is a generalized version of entropy and closely related to R\'enyi divergences. We…

Probability · Mathematics 2024-07-29 Lei Yu , Hao Wu

We show that an information-theoretic property of Shannon's entropy power, known as concavity of entropy power, can be fruitfully employed to prove inequalities in sharp form. In particular, the concavity of entropy power implies the…

Information Theory · Computer Science 2012-07-13 Giuseppe Toscani

Aim of this short note is to study Shannon's entropy power along entropic interpolations, thus generalizing Costa's concavity theorem. We shall provide two proofs of independent interest: the former by $\Gamma$-calculus, hence applicable to…

Information Theory · Computer Science 2020-12-23 Luca Tamanini

Generalized entropy, that has been recently proposed, puts all the known and apparently different entropies like The Tsallis, the R\'{e}nyi, the Barrow, the Kaniadakis, the Sharma-Mittal and the loop quantum gravity entropy within a single…

General Relativity and Quantum Cosmology · Physics 2023-11-08 Shin'ichi Nojiri , Sergei D. Odintsov , Tanmoy Paul

We show that a proper expression of the uncertainty relation for a pair of canonically-conjugate continuous variables relies on entropy power, a standard notion in Shannon information theory for real-valued signals. The resulting…

Quantum Physics · Physics 2018-01-16 Anaelle Hertz , Michael G. Jabbour , Nicolas J. Cerf

We prove that Sharma-Mittal entropy is a subadditive and supermodular function on the lattice of all $n$-dimensional probability distributions, ordered according to the partial order relation defined by majorization among vectors. Our…

Information Theory · Computer Science 2026-05-28 Roberto Bruno , Ugo Vaccaro

It is well-known that the Shannon entropies of some parameterized probability distributions are concave functions with respect to the parameter. In this paper we consider a family of such distributions (including the binomial, Poisson, and…

Classical Analysis and ODEs · Mathematics 2015-12-09 Ioan Rasa

We consider the entropy of sums of independent discrete random variables, in analogy with Shannon's Entropy Power Inequality, where equality holds for normals. In our case, infinite divisibility suggests that equality should hold for…

Information Theory · Computer Science 2010-10-21 Oliver Johnson , Yaming Yu

This paper gives improved R\'{e}nyi entropy power inequalities (R-EPIs). Consider a sum $S_n = \sum_{k=1}^n X_k$ of $n$ independent continuous random vectors taking values on $\mathbb{R}^d$, and let $\alpha \in [1, \infty]$. An R-EPI…

Information Theory · Computer Science 2016-07-21 Eshed Ram , Igal Sason

We consider the concept of generalized measure-theoretic entropy, where instead of the Shannon entropy function we consider an arbitrary concave function defined on the unit interval, vanishing in the origin. Under mild assumptions on this…

Dynamical Systems · Mathematics 2014-08-21 Fryderyk Falniowski

We presented background information about various entropies in the literature. The pathway idea of Mathai (2005) is shown to be inferable from the maximization of a certain generalized entropy measure and established connections to…

Mathematical Physics · Physics 2016-11-25 Nicy Sebastian

The pathway model of Mathai (2005) is shown to be inferable from the maximization of a certain generalized entropy measure. This entropy is a variant of the generalized entropy of order 'alpha', considered in Mathai and Rathie (1975), and…

Statistical Mechanics · Physics 2009-11-11 A. M. Mathai , H. J. Haubold

The aim of this focus letter is to present a comprehensive classification of the main entropic forms introduced in the last fifty years in the framework of statistical physics and information theory. Most of them can be grouped into three…

Statistical Mechanics · Physics 2021-05-26 V. Ilić , J. Korbel , S. Gupta , A. M. Scarfone

We revisit entropy methods to prove new sharp trace logarithmic Sobolev and sharp Gagliardo-Nirenberg-Sobolev inequalities on the half space, with a focus on the entropy inequality itself and not the actual flow, allowing for somewhat…

Analysis of PDEs · Mathematics 2021-12-28 Simon Zugmeyer

We studied the Sharma-Mittal relative entropy and showed that its physical meaning is the free energy difference between the off-equilibrium and equilibrium distributions. Unfortunately, Sharma-Mittal relative entropy may acquire this…

Statistical Mechanics · Physics 2007-05-23 E. Akturk , G. B. Bagci , R. Sever

Recently, Suyari has proposed a generalization of Shannon-Khinchin axioms, which determines a class of entropies containing the well-known Tsalis and Havrda-Charvat entropies [H. Suyari, IEEE Trans. Inf. Theory, vol. 50, pp. 1783-1787, Aug.…

Mathematical Physics · Physics 2012-12-03 Velimir M. Ilic , Miomir S. Stankovic , Edin H. Mulalic

A lower bound on the R\'enyi differential entropy of a sum of independent random vectors is demonstrated in terms of rearrangements. For the special case of Boltzmann-Shannon entropy, this lower bound is better than that given by the…

Information Theory · Computer Science 2015-05-07 Liyao Wang , Mokshay Madiman

A generalised notion of exponential families is introduced. It is based on the variational principle, borrowed from statistical physics. It is shown that inequivalent generalised entropy functions lead to distinct generalised exponential…

Mathematical Physics · Physics 2015-05-13 Jan Naudts