English
Related papers

Related papers: R\'enyi entropy power inequality and a reverse

200 papers

An uncertainty relation for the R\'enyi entropies of conjugate quantum observables is used to obtain a strong Heisenberg limit of the form ${\rm RMSE} \geq f(\alpha)/(\langle N\rangle+\frac12)$, bounding the root mean square error of any…

Quantum Physics · Physics 2022-11-21 Michael J. W. Hall

We show that the fundamental objects of the $L_p$-Brunn-Minkowski theory, namely the $L_p$-affine surface areas for a convex body, are closely related to information theory: they are exponentials of R\'enyi divergences of the cone measures…

Functional Analysis · Mathematics 2011-05-06 Elisabeth M. Werner

We compute R\'enyi entropies for a spherical entangling surface in four-dimensional N=4 super-Yang-Mills at strong coupling using the AdS/CFT correspondence. Incorporating the effects of the leading \alpha' corrections to the low energy…

High Energy Physics - Theory · Physics 2015-06-16 Damian A. Galante , Robert C. Myers

The paper establishes the equality condition in the I-MMSE proof of the entropy power inequality (EPI). This is done by establishing an exact expression for the deficit between the two sides of the EPI. Interestingly, a necessary condition…

Information Theory · Computer Science 2017-03-23 Alex Dytso , Ronit Bustin , H. Vincent Poor , Shlomo Shamai

The entropy power inequality for independent random vectors is a foundational result of information theory, with deep connections to probability and geometric functional analysis. Several extensions of the entropy power inequality have been…

Information Theory · Computer Science 2025-12-23 Mokshay Madiman , James Melbourne , Cyril Roberto

We investigate the R\'enyi entropy of independent sums of integer valued random variables through Fourier theoretic means, and give sharp comparisons between the variance and the R\'enyi entropy, for Poisson-Bernoulli variables. As…

Probability · Mathematics 2024-03-19 Mokshay Madiman , James Melbourne , Cyril Roberto

We consider the two-dimensional (2d) Ising model on a infinitely long cylinder and study the probabilities $p_i$ to observe a given spin configuration $i$ along a circular section of the cylinder. These probabilities also occur as…

Strongly Correlated Electrons · Physics 2010-11-02 Jean-Marie Stéphan , Grégoire Misguich , Vincent Pasquier

Entanglement R\'enyi-$\alpha$ entropy is an entanglement measure. It generalizes the entanglement of formation, and they coincide when $\alpha$ tends to 1. We derive analytical lower and upper bounds for the entanglement R\'enyi-$\alpha$…

Quantum Physics · Physics 2017-03-07 Wei Song , Lin Chen , Zhuo-Liang Cao

We prove R\'enyi entropic inequalities in a holographic setup based on the recent proposal for the holographic formula of R\'enyi entropies when the bulk is stable against any perturbation. Regarding the R\'enyi parameter as an inverse…

High Energy Physics - Theory · Physics 2017-02-01 Yuki Nakaguchi , Tatsuma Nishioka

We provide the sandwiched R\'enyi divergence of order $\alpha\in(\frac{1}{2},1)$, as well as its induced quantum information quantities, with an operational interpretation in the characterization of the exact strong converse exponents of…

Quantum Physics · Physics 2024-05-29 Ke Li , Yongsheng Yao

There are no universally accepted definitions of R\'enyi conditional entropy and R\'enyi mutual information, although motivated by different applications, several definitions have been proposed in the literature. In this paper, we consider…

Information Theory · Computer Science 2025-11-05 Shi-Bing Li , Ke Li , Lei Yu

This paper provides tight bounds on the R\'enyi entropy of a function of a discrete random variable with a finite number of possible values, where the considered function is not one-to-one. To that end, a tight lower bound on the R\'enyi…

Information Theory · Computer Science 2018-12-11 Igal Sason

This paper considers an entropy-power inequality (EPI) of Costa and presents a natural vector generalization with a real positive semidefinite matrix parameter. This new inequality is proved using a perturbation approach via a fundamental…

Information Theory · Computer Science 2009-03-18 Ruoheng Liu , Tie Liu , H. Vincent Poor , Shlomo Shamai

The ground state entanglement entropy is studied in a many-body bipartite quantum system with either a single or multiple conserved quantities. It is shown that the entanglement entropy exhibits a universal power-law behaviour at large $R$…

Statistical Mechanics · Physics 2022-09-14 Ohad Shpielberg

The R\'enyi and Shannon entropies are information-theoretic measures which have enabled to formulate the position-momentum uncertainty principle in a much more adequate and stringent way than the (variance-based) Heisenberg-like relation.…

Quantum Physics · Physics 2013-05-24 Pablo Sánchez-Moreno , Steeve Zozor , Jesus S. Dehesa

In this note we introduce a new family of entropy powers which are related to generalized entropies, called Sharma-Mittal entropies, and we prove their concavity along diffusion processes generated by $L^2$-Wasserstein gradient flows of…

Information Theory · Computer Science 2022-02-28 Mario Bukal

The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…

Information Theory · Computer Science 2017-05-01 Maciej Skorski

This dissertation investigates relative entropies, also called generalized divergences, and how they can be used to characterize information-theoretic tasks in quantum information theory. The main goal is to further refine characterizations…

Quantum Physics · Physics 2016-11-29 Felix Leditzky

We present simple and computationally efficient nonparametric estimators of R\'enyi entropy and mutual information based on an i.i.d. sample drawn from an unknown, absolutely continuous distribution over $\R^d$. The estimators are…

Machine Learning · Statistics 2010-10-27 Dávid Pál , Barnabás Póczos , Csaba Szepesvári

It is known that many classical inequalities linked to convolutions can be obtained by looking at the monotonicity in time of convolutions of powers of solutions to the heat equation, provided that both the exponents and the coefficients of…

Mathematical Physics · Physics 2013-09-26 Giuseppe Toscani