English
Related papers

Related papers: Chain Rules for Renyi Information Combining

200 papers

Information entropies give a genuine way to characterize quantitatively an incompatibility in quantum measurements. Together with the Shannon entropy, few families of parametrized entropies have found use in various questions. It is also…

Quantum Physics · Physics 2025-09-30 Alexey E. Rastegin

We discuss some properties of the generalized entropies, called Renyi entropies and their application to the case of continuous distributions. In particular it is shown that these measures of complexity can be divergent, however, their…

Disordered Systems and Neural Networks · Physics 2007-05-23 I. Varga , J. Pipek

We show that the new quantum extension of Renyi's \alpha-relative entropies, introduced recently by Muller-Lennert, Dupuis, Szehr, Fehr and Tomamichel, J. Math. Phys. 54, 122203, (2013), and Wilde, Winter, Yang, Commun. Math. Phys. 331,…

Quantum Physics · Physics 2015-02-17 Milan Mosonyi , Tomohiro Ogawa

We provide an upper bound on the maximal entropy rate at which the entropy of the expected density operator of a given ensemble of two states changes under nonlocal unitary evolution. A large class of entropy measures in considered, which…

Mathematical Physics · Physics 2022-01-03 Anna Vershynina

Bounds on the entropy of patterns of sequences generated by independently identically distributed (i.i.d.) sources are derived. A pattern is a sequence of indices that contains all consecutive integer indices in increasing order of first…

Information Theory · Computer Science 2007-07-13 Gil I. Shamir

In this article, we present quantum algorithms for estimating von Neumann entropy and Renyi entropy, which are crucial physical and information-theoretical properties of a given quantum state $\rho$. Although there have been existing works…

Quantum Physics · Physics 2025-02-12 Nhat A. Nghiem , Tzu-Chieh Wei

The interactions between three or more random variables are often nontrivial, poorly understood, and yet, are paramount for future advances in fields such as network information theory, neuroscience, genetics and many others. In this work,…

Information Theory · Computer Science 2016-04-20 Fernando Rosas , Vasilis Ntranos , Christopher J. Ellison , Sofie Pollin , Marian Verhelst

The chain rule for the classical relative entropy ensures that the relative entropy between probability distributions on multipartite systems can be decomposed into a sum of relative entropies of suitably chosen conditional distributions on…

Quantum Physics · Physics 2020-03-18 Kun Fang , Omar Fawzi , Renato Renner , David Sutter

The Renyi, Shannon and Fisher spreading lengths of the classical or hypergeometric orthogonal polynomials, which are quantifiers of their distribution all over the orthogonality interval, are defined and investigated. These…

Mathematical Physics · Physics 2009-11-11 P. Sánchez-Moreno , J. S. Dehesa , D. Manzano , R. Yáñez

We compute the Renyi entropy in a one-dimensional transverse-field quantum Ising model by employing a swapping operator acting on the states which are prepared from the neural network methods. In the static ground state, Renyi entropy can…

Disordered Systems and Neural Networks · Physics 2024-03-15 Han-Qing Shi , Hai-Qing Zhang

This work presents a generalization of the Koashi-Winter relation for $\alpha$-Renyi entropies. This result is based on the Renyi\apos s entropy version of quantum Jensen Shannon divergence. By means of this definition, a classical…

Quantum Physics · Physics 2017-06-08 Tiago Debarba

General probabilistic theories are designed to provide operationally the most general probabilistic models including both classical and quantum theories. In this letter, we introduce a systematic method to construct a series of entropies,…

Quantum Physics · Physics 2016-10-26 Gen Kimura , Junji Ishiguro , Makoto Fukui

Renyi's information measures ---the Renyi information, mean, capacity, radius, and center--- are analyzed relying on the elementary properties of the Renyi divergence and the power means. The van Erven-Harremoes conjecture is proved for any…

Information Theory · Computer Science 2019-08-27 Baris Nakiboglu

This paper proposes a novel entropy encoding technique for lossless data compression. Representing a message string by its lexicographic index in the permutations of its symbols results in a compressed version matching Shannon entropy of…

Information Theory · Computer Science 2017-03-24 Abu Bakar Siddique

Shannon entropy is the most crucial foundation of Information Theory, which has been proven to be effective in many fields such as communications. Renyi entropy and Chernoff information are other two popular measures of information with…

Information Theory · Computer Science 2017-01-13 Shanyun Liu , Rui She , Jiaxun Lu , Pingyi Fan

We study a generalized version of Wyner's common information problem (also coined the distributed source simulation problem). The original common information problem consists in understanding the minimum rate of the common input to…

Information Theory · Computer Science 2019-12-04 Lei Yu , Vincent Y. F. Tan

We address the task of compression of fermionic quantum information. Due to the parity superselection rule, differently from the case of encoding of quantum information in qubit states, part of the information carried by fermionic systems…

Quantum Physics · Physics 2025-03-31 Paolo Perinotti , Alessandro Tosini , Leonardo Vaglini

The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible constrained to match empirical data, for instance, feature expectations. We seek to generalize…

Information Theory · Computer Science 2022-05-30 Kenneth Bogert

We calculate in detail the Renyi entanglement entropies of cTPQ states as a function of subsystem volume, filling the details of our prior work [Nature Communications 9, 1635 (2018)], where the formulas were first presented. Working in a…

Statistical Mechanics · Physics 2019-01-30 Hiroyuki Fujita , Yuya O. Nakagawa , Sho Sugiura , Masataka Watanabe

It is well established that the notion of min-entropy fails to satisfy the \emph{chain rule} of the form $H(X,Y) = H(X|Y)+H(Y)$, known for Shannon Entropy. Such a property would help to analyze how min-entropy is split among smaller blocks.…

Information Theory · Computer Science 2017-03-01 Maciej Skorski