English
Related papers

Related papers: Some applications of matrix inequalities in R\'eny…

200 papers

The Renyi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies or…

Quantum Physics · Physics 2014-01-28 Martin Müller-Lennert , Frédéric Dupuis , Oleg Szehr , Serge Fehr , Marco Tomamichel

Quantum information measures such as the entropy and the mutual information find applications in physics, e.g., as correlation measures. Generalizing such measures based on the R\'enyi entropies is expected to enhance their scope in…

Quantum Physics · Physics 2015-04-10 Mario Berta , Kaushik P. Seshadreesan , Mark M. Wilde

Bounds on information combining are entropic inequalities that determine how the information, or entropy, of a set of random variables can change when they are combined in certain prescribed ways. Such bounds play an important role in…

Information Theory · Computer Science 2020-11-10 Christoph Hirche

We investigate quantum R\'enyi entropic quantities, specifically those derived from 'sandwiched' divergence. This divergence is one of several proposed R\'enyi generalisations of the quantum relative entropy. We may define R\'enyi…

Quantum Physics · Physics 2021-10-04 Alexander McKinlay

Upper and lower bounds are obtained for the joint entropy of a collection of random variables in terms of an arbitrary collection of subset joint entropies. These inequalities generalize Shannon's chain rule for entropy as well as…

Information Theory · Computer Science 2024-05-07 Mokshay Madiman , Prasad Tetali

The R\'enyi and Shannon entropies are information-theoretic measures which have enabled to formulate the position-momentum uncertainty principle in a much more adequate and stringent way than the (variance-based) Heisenberg-like relation.…

Quantum Physics · Physics 2013-05-24 Pablo Sánchez-Moreno , Steeve Zozor , Jesus S. Dehesa

Entropic uncertainty relations are interesting in their own rights as well as for a lot of applications. Keeping this in mind, we try to make the corresponding inequalities as tight as possible. The use of parametrized entropies also allows…

Quantum Physics · Physics 2023-05-30 Alexey E. Rastegin

In this article, we discuss the problem of establishing relations between information measures assessed for network structures. Two types of entropy based measures namely, the Shannon entropy and its generalization, the R\'{e}nyi entropy…

Information Theory · Computer Science 2013-01-24 Lavanya Sivakumar , Matthias Dehmer

We derive a strengthened monotonicity inequality for quantum relative entropy by employing properties of $\alpha$-R\'{e}nyi relative entropy. We develop a unifying treatment towards the improvement of some quantum entropy inequalities. In…

Quantum Physics · Physics 2016-03-21 Lin Zhang

Relative entropy is a measure of distinguishability for quantum states, and plays a central role in quantum information theory. The family of Renyi entropies generalizes to Renyi relative entropies that include as special cases most entropy…

High Energy Physics - Theory · Physics 2014-12-12 Nima Lashkari

Estimation of Shannon and R\'enyi entropies of unknown discrete distributions is a fundamental problem in statistical property testing and an active research topic in both theoretical computer science and information theory. Tight bounds on…

Quantum Physics · Physics 2023-07-19 Tongyang Li , Xiaodi Wu

In the estimation theory context, we generalize the notion of Shannon's entropy power to the R\'{e}nyi-entropy setting. This not only allows to find new estimation inequalities, such as the R\'{e}nyi-entropy based De Bruijn identity,…

Quantum Physics · Physics 2021-04-07 Petr Jizba , Jacob Dunningham , Martin Prokš

We revisit generalized entropic formulations of the uncertainty principle for an arbitrary pair of quantum observables in two-dimensional Hilbert space. R\'enyi entropy is used as uncertainty measure associated with the distribution…

Quantum Physics · Physics 2014-06-23 Steeve Zozor , Gustavo Martín Bosyk , Mariela Portesi

The matrix-based R\'enyi's entropy allows us to directly quantify information measures from given data, without explicit estimation of the underlying probability distribution. This intriguing property makes it widely applied in statistical…

Machine Learning · Computer Science 2022-12-01 Yuxin Dong , Tieliang Gong , Shujian Yu , Hong Chen , Chen Li

The states of the qubit, the basic unit of quantum information, are $2 \times 2$ positive semi-definite Hermitian matrices with trace 1. We contribute to the program to axiomatize quantum mechanics by characterizing these states in terms of…

Quantum Physics · Physics 2024-01-18 Adam Brandenburger , Pierfrancesco La Mura , Stuart Zoble

A lower bound on the R\'enyi differential entropy of a sum of independent random vectors is demonstrated in terms of rearrangements. For the special case of Boltzmann-Shannon entropy, this lower bound is better than that given by the…

Information Theory · Computer Science 2015-05-07 Liyao Wang , Mokshay Madiman

We introduce a variant of the R\'enyi entropy definition that aligns it with the well-known H\"older mean: in the new formulation, the r-th order R\'enyi Entropy is the logarithm of the inverse of the r-th order H\"older mean. This brings…

Information Theory · Computer Science 2018-11-16 Francisco José Valverde-Albacete , Carmen Peláez-Moreno

This paper gives improved R\'{e}nyi entropy power inequalities (R-EPIs). Consider a sum $S_n = \sum_{k=1}^n X_k$ of $n$ independent continuous random vectors taking values on $\mathbb{R}^d$, and let $\alpha \in [1, \infty]$. An R-EPI…

Information Theory · Computer Science 2016-07-21 Eshed Ram , Igal Sason

We study the $p$-R\'{e}nyi entropy power inequality with a weight factor $t$ on two independent continuous random variables $X$ and $Y$. The extension essentially relies on a modulation on the sharp Young's inequality due to Bobkov and…

Quantum Physics · Physics 2023-11-28 Junseo Lee , Hyeonjun Yeo , Kabgyun Jeong

R\'enyi divergence is related to R\'enyi entropy much like information divergence (also called Kullback-Leibler divergence or relative entropy) is related to Shannon's entropy, and comes up in many settings. It was introduced by R\'enyi as…

Information Theory · Computer Science 2010-05-28 Tim van Erven , Peter Harremoës
‹ Prev 1 2 3 10 Next ›