English
Related papers

Related papers: Renyi extrapolation of Shannon entropy

200 papers

The von Neumann entropy and the subentropy of a mixed quantum state are upper and lower bounds, respectively, on the accessible information of any ensemble consistent with the given mixed state. Here we define and investigate a set of…

Quantum Physics · Physics 2007-05-23 Sarah R. Nichols , William K. Wootters

Entropy is a fundamental concept in equilibrium statistical mechanics, yet its origin in the non-equilibrium dynamics of isolated quantum systems is not fully understood. A strong consensus is emerging around the idea that the stationary…

Statistical Mechanics · Physics 2017-09-20 Vincenzo Alba , Pasquale Calabrese

We calculate and analyze various entropy measures and their properties for selected probability distributions. The entropies considered include Shannon, R\'enyi, generalized R\'enyi, Tsallis, Sharma-Mittal, and modified Shannon entropy,…

Information Theory · Computer Science 2024-11-26 Iryna Bodnarchuk , Yuliya Mishura , Kostiantyn Ralchenko

The quantum Renyi relative entropies play a prominent role in quantum information theory, finding applications in characterizing error exponents and strong converse exponents for quantum hypothesis testing and quantum communication theory.…

Quantum Physics · Physics 2018-07-26 Kaushik P. Seshadreesan , Ludovico Lami , Mark M. Wilde

The paper examines relationships between the Shannon entropy and the $\ell_{\alpha}$-norm for $n$-ary probability vectors, $n \ge 2$. More precisely, we investigate the tight bounds of the $\ell_{\alpha}$-norm with a fixed Shannon entropy,…

Information Theory · Computer Science 2016-01-29 Yuta Sakai , Ken-ichi Iwata

We explore the relation between entanglement entropy of quantum many body systems and the distribution of corresponding, properly selected, observables. Such a relation is necessary to actually measure the entanglement entropy. We show that…

Statistical Mechanics · Physics 2009-11-11 Israel Klich , Gil Refael , Alessandro Silva

We explore the relation between the von Neumann entropy and the Renyi entropies of integer orders for shift-invariant quasi-free Fermionic lattice systems. We investigate approximating the von Neumann entropy by a combination of…

Quantum Physics · Physics 2012-10-26 Mark Fannes , Nicholas Van Ryn

Complementarity relations between various characterizations of a probability distribution are at the core of information theory. In particular, lower and upper bounds for the entropic function are of great importance. In applied topics, we…

Quantum Physics · Physics 2022-09-07 Alexey E. Rastegin

This paper reports a new reading for wavelets, which is based on the classical 'De Broglie' principle. The wave-particle duality principle is adapted to wavelets. Every continuous basic wavelet is associated with a proper probability…

Information Theory · Computer Science 2015-04-07 H. M. de Oliveira

We investigate the uncertainty principle for two successive projective measurements in terms of R\'enyi entropy based on a single quantum system. Our results cover a large family of the entropy (including the Shannon entropy) uncertainty…

Quantum Physics · Physics 2015-04-14 Jun Zhang , Yang Zhang , Chang-shui Yu

Shannon entropy for discrete distributions is a fundamental and widely used concept, but its continuous analogue, known as differential entropy, lacks essential properties such as positivity and compatibility with the discrete case. In this…

Probability · Mathematics 2025-08-07 Yuliya Mishura , Kostiantyn Ralchenko

Entropies must correspond to mean values for them to be measurable. The Shannon entropy corresponds to the weighted arithmetic mean, whereas the Renyi entropy corresponds to the exponential mean. These means refer to code lengths, which are…

Statistical Mechanics · Physics 2011-10-25 B. H. Lavenda

Relative entropy is a measure of distinguishability for quantum states, and plays a central role in quantum information theory. The family of Renyi entropies generalizes to Renyi relative entropies that include as special cases most entropy…

High Energy Physics - Theory · Physics 2014-12-12 Nima Lashkari

A lower bound on the R\'enyi differential entropy of a sum of independent random vectors is demonstrated in terms of rearrangements. For the special case of Boltzmann-Shannon entropy, this lower bound is better than that given by the…

Information Theory · Computer Science 2015-05-07 Liyao Wang , Mokshay Madiman

It has long been conjectured that the entropy of quantum fields across boundaries scales as the boundary area. This conjecture has not been easy to test in spacetime dimensions greater than four because of divergences in the von Neumann…

High Energy Physics - Theory · Physics 2013-07-29 Samuel L. Braunstein , Saurya Das , S. Shankaranarayanan

Uniform continuity bounds on entropies are generally expressed in terms of a single distance measure between a pair of probability distributions or quantum states, typically, the total variation distance or trace distance. However, if an…

Quantum Physics · Physics 2025-01-09 Michael G. Jabbour , Nilanjana Datta

We propose a new way of defining entropy of a system, which gives a general form which may be nonextensive as Tsallis entropy, but is linearly dependent on component entropies, like Renyi entropy, which is extensive. This entropy has a…

Adaptation and Self-Organizing Systems · Physics 2007-10-11 Fariel Shafee

We investigate the universal inequalities relating the alpha-Renyi entropies of the marginals of a multi-partite quantum state. This is in analogy to the same question for the Shannon and von Neumann entropy (alpha=1) which are known to…

Quantum Physics · Physics 2013-12-24 Noah Linden , Milán Mosonyi , Andreas Winter

This paper gives improved R\'{e}nyi entropy power inequalities (R-EPIs). Consider a sum $S_n = \sum_{k=1}^n X_k$ of $n$ independent continuous random vectors taking values on $\mathbb{R}^d$, and let $\alpha \in [1, \infty]$. An R-EPI…

Information Theory · Computer Science 2016-07-21 Eshed Ram , Igal Sason

In quantum mechanics, stringnet condensed states - a family of prototypical states exhibiting non-trivial topological order - can be classified via their long-range entanglement properties, in particular topological corrections to the…

Statistical Mechanics · Physics 2014-05-12 M. Hermanns , S. Trebst