English
Related papers

Related papers: R\'enyi entropy power inequality and a reverse

200 papers

Using R\'enyi entropy, a possible thermostatistics for nonextensive systems is discussed. We show that it is possible to get the $q$-exponential distribution function for nonextensive systems having nonadditive energy but additive entropy.…

Statistical Mechanics · Physics 2007-05-23 Qiuping A. Wang

This article is a continuation of my paper [arxiv: 1409.1015v2]. R\'enyi and Tsallis entropies are associated to positive linear operators and properties of some functions related to these entropies are investigated.

Classical Analysis and ODEs · Mathematics 2014-12-17 Ioan Raşa

The matrix version of the entropy-power inequality for real or complex coefficients and variables is proved using a transportation argument that easily settles the equality case. An application to blind source extraction is given.

Information Theory · Computer Science 2019-06-04 Olivier Rioul , Ram Zamir

We explore an asymptotic behavior of R\'enyi entropy along convolutions in the central limit theorem with respect to the increasing number of i.i.d. summands. In particular, the problem of monotonicity is addressed under suitable moment…

Probability · Mathematics 2018-03-01 Sergey G. Bobkov , Arnaud Marsiglietti

Recently, there has been a surge of interest in using R\'enyi entropies as quantifiers of correlations in many-body quantum systems. However, it is well known that in general these entropies do not satisfy the strong subadditivity…

Statistical Mechanics · Physics 2019-02-06 Giancarlo Camilo , Gabriel T. Landi , Sebas Eliëns

We study the behaviour of R\'enyi entropies in a generic thermodynamic macrostate of an integrable model. In the standard quench action approach to quench dynamics, the R\'enyi entropies may be derived from the overlaps of the initial state…

Statistical Mechanics · Physics 2018-09-03 Marton Mestyán , Vincenzo Alba , Pasquale Calabrese

The Renyi entropy is a generalisation of the Shannon entropy that is sensitive to the fine details of a probability distribution. We present results for the Renyi entropy of the totally asymmetric exclusion process (TASEP). We calculate…

Statistical Mechanics · Physics 2017-11-10 Anthony J. Wood , Richard A. Blythe , Martin R. Evans

We prove a sharp integral inequality that generalizes the well known Hardy type integral inequality for negative exponents. We also give sharp applications in two directions for Muckenhoupt weights on R. This work refines the results that…

Functional Analysis · Mathematics 2018-07-24 Eleftherios N. Nikolidakis , Theodoros Stavropoulos

We prove a tight uniform continuity bound for Arimoto's version of the conditional $\alpha$-R\'enyi entropy, for the range $\alpha \in [0, 1)$. This definition of the conditional R\'enyi entropy is the most natural one among the multiple…

Information Theory · Computer Science 2022-03-29 Michael G. Jabbour , Nilanjana Datta

In this paper we study certain properties of R\'{e}nyi entropy functionals $H_\alpha(\mathcal{P})$ on the space of probability distributions over $\mathbb{Z}_+$. Primarily, continuity and convergence issues are addressed. Some properties…

Information Theory · Computer Science 2020-08-13 Mladen Kovačević , Ivan Stanojević , Vojin Šenk

This paper develops systematic approaches to obtain $f$-divergence inequalities, dealing with pairs of probability measures defined on arbitrary alphabets. Functional domination is one such approach, where special emphasis is placed on…

Information Theory · Computer Science 2016-12-06 Igal Sason , Sergio Verdú

Many axiomatic definitions of entropy, such as the R\'enyi entropy, of a random variable are closely related to the $\ell_{\alpha}$-norm of its probability distribution. This study considers probability distributions on finite sets, and…

Information Theory · Computer Science 2016-05-06 Yuta Sakai , Ken-ichi Iwata

We show that a proper expression of the uncertainty relation for a pair of canonically-conjugate continuous variables relies on entropy power, a standard notion in Shannon information theory for real-valued signals. The resulting…

Quantum Physics · Physics 2018-01-16 Anaelle Hertz , Michael G. Jabbour , Nicolas J. Cerf

The concept of Entropy plays a key role in Information Theory, Statistics, and Machine Learning.This paper introduces a new entropy measure, called the t-entropy, which exploits the concavity of the inverse-tan function. We analytically…

Information Theory · Computer Science 2021-05-06 Saptarshi Chakraborty , Debolina Paul , Swagatam Das

We offer a new point of view on the (Modified) Log-Sobolev inequality and lower bounds on the Ricci-curvature in the setting where the dynamics are obtained as the limit of Markov processes. In this setting, the large deviation rate…

Probability · Mathematics 2016-10-03 Richard C. Kraaij

We propose and experimentally measure an entropy that quantifies the volume of correlations among qubits. The experiment is carried out on a nearly isolated quantum system composed of a central spin coupled and initially uncorrelated with…

Quantum Physics · Physics 2021-08-25 Mohamad Niknam , Lea F. Santos , David G. Cory

The $\alpha$-$z$ R\'enyi relative entropies are a two-parameter family of R\'enyi relative entropies that are quantum generalizations of the classical $\alpha$-R\'enyi relative entropies. In \cite{zhang20CFL} we decided the full range of…

Mathematical Physics · Physics 2020-11-02 Haonan Zhang

Shannon's Entropy Power Inequality can be viewed as characterizing the minimum differential entropy achievable by the sum of two independent random variables with fixed differential entropies. The entropy power inequality has played a key…

Information Theory · Computer Science 2012-07-31 Varun Jog , Venkat Anantharam

A generalization of Young's inequality for convolution with sharp constant is conjectured for scenarios where more than two functions are being convolved, and it is proven for certain parameter ranges. The conjecture would provide a unified…

Functional Analysis · Mathematics 2011-08-09 Sergey Bobkov , Mokshay Madiman , Liyao Wang

The de Bruijn identity states that Fisher information is equal to a half of the time-derivative of Shannon differential entropy along heat flow. In the same spirit, a generalized version of Fisher information, which we term the…

Information Theory · Computer Science 2025-06-12 Hao Wu , Lei Yu