English
Related papers

Related papers: R\'enyi Common Information for Doubly Symmetric Bi…

200 papers

The analogues of Arimoto's definition of conditional R\'enyi entropy and R\'enyi mutual information are explored for abstract alphabets. These quantities, although dependent on the reference measure, have some useful properties similar to…

Information Theory · Computer Science 2021-10-20 Gautam Aishwarya , Mokshay Madiman

The random variable simulation problem consists in using a $k$-dimensional i.i.d. random vector $X^{k}$ with distribution $P_{X}^{k}$ to simulate an $n$-dimensional i.i.d. random vector $Y^{n}$ so that its distribution is approximately…

Information Theory · Computer Science 2018-12-24 Lei Yu , Vincent Y. F. Tan

The states of the qubit, the basic unit of quantum information, are $2 \times 2$ positive semi-definite Hermitian matrices with trace 1. We contribute to the program to axiomatize quantum mechanics by characterizing these states in terms of…

Quantum Physics · Physics 2024-01-18 Adam Brandenburger , Pierfrancesco La Mura , Stuart Zoble

R\'enyi divergence is related to R\'enyi entropy much like Kullback-Leibler divergence is related to Shannon's entropy, and comes up in many settings. It was introduced by R\'enyi as a measure of information that satisfies almost the same…

Information Theory · Computer Science 2014-04-25 Tim van Erven , Peter Harremoës

Concepts of information theory are increasingly used to characterize collective phenomena in condensed matter systems, such as the use of entanglement entropies to identify emergent topological order in interacting quantum many-body…

Strongly Correlated Electrons · Physics 2015-09-28 Johannes Helmes , Jean-Marie Stéphan , Simon Trebst

We extend from the hyperfinite setting to general von Neumann algebras Mosonyi and Ogawa's (2015) and Mosonyi and Hiai's (2023) results showing the operational interpretation of sandwiched relative R\'enyi entropy in the strong converse of…

Quantum Physics · Physics 2025-07-18 Marius Junge , Nicholas Laracuente

Many common probability distributions in statistics like the Gaussian, multinomial, Beta or Gamma distributions can be studied under the unified framework of exponential families. In this paper, we prove that both R\'enyi and Tsallis…

Information Theory · Computer Science 2012-02-01 Frank Nielsen , Richard Nock

We introduce an inequality which may be viewed as a generalization of both the Brascamp-Lieb inequality and its reverse (Barthe's inequality), and prove its information-theoretic (i.e.\ entropic) formulation. This result leads to a unified…

Information Theory · Computer Science 2017-12-05 Jingbo Liu , Thomas A. Courtade , Paul Cuff , Sergio Verdu

We study the R\'enyi mutual information $\tilde{I}_n$ of the ground state of different critical quantum chains. The R\'enyi mutual information definition that we use is based on the well established concept of the R\'enyi divergence. We…

Statistical Mechanics · Physics 2015-04-16 F. C. Alcaraz , M. A. Rajabpour

Consider the problem where a statistician in a two-node system receives rate-limited information from a transmitter about marginal observations of a memoryless process generated from two possible distributions. Using its own observations,…

Information Theory · Computer Science 2017-03-02 Gil Katz , Pablo Piantanida , Mérouane Debbah

We derive closed-form asymptotic formulas for the R\'enyi entanglement entropies of the open XX spin-$1/2$ chain by mapping the underlying determinant of the boundary correlation matrix (which has Toeplitz-plus-Hankel structure) to a Hankel…

Statistical Mechanics · Physics 2026-04-08 Miguel Tierz

This study examines sharp bounds on Arimoto's conditional R\'enyi entropy of order $\beta$ with a fixed another one of distinct order $\alpha \neq \beta$. Arimoto inspired the relation between the R\'enyi entropy and the $\ell_{r}$-norm of…

Information Theory · Computer Science 2020-08-24 Yuta Sakai , Ken-ichi Iwata

The matrix-based Renyi's \alpha-order entropy functional was recently introduced using the normalized eigenspectrum of a Hermitian matrix of the projected data in a reproducing kernel Hilbert space (RKHS). However, the current theory in the…

Information Theory · Computer Science 2019-08-01 Shujian Yu , Luis Gonzalo Sanchez Giraldo , Robert Jenssen , Jose C. Principe

The $\alpha$-$z$ R\'enyi relative entropies are a two-parameter family of R\'enyi relative entropies that are quantum generalizations of the classical $\alpha$-R\'enyi relative entropies. In \cite{zhang20CFL} we decided the full range of…

Mathematical Physics · Physics 2020-11-02 Haonan Zhang

The R\'{e}nyi cross-entropy measure between two distributions, a generalization of the Shannon cross-entropy, was recently used as a loss function for the improved design of deep learning generative adversarial networks. In this work, we…

Information Theory · Computer Science 2022-08-09 Ferenc Cole Thierrin , Fady Alajaji , Tamás Linder

The R\'enyi and Shannon entropies are information-theoretic measures which have enabled to formulate the position-momentum uncertainty principle in a much more adequate and stringent way than the (variance-based) Heisenberg-like relation.…

Quantum Physics · Physics 2013-05-24 Pablo Sánchez-Moreno , Steeve Zozor , Jesus S. Dehesa

The paper makes the observation that all orders of information entropy are equal in signals composed of repeating units of distinct symbols where the units can be classified as a member of a symmetry group. This leads to an improved metric…

Information Theory · Computer Science 2010-07-14 Reginald D. Smith

We introduce a variant of the R\'enyi entropy definition that aligns it with the well-known H\"older mean: in the new formulation, the r-th order R\'enyi Entropy is the logarithm of the inverse of the r-th order H\"older mean. This brings…

Information Theory · Computer Science 2018-11-16 Francisco José Valverde-Albacete , Carmen Peláez-Moreno

In a certain sense we generalize the recently introduced and extensively studied notion called quantum R\'enyi divergence (in another name, sandwiched R\'enyi relative entropy) and describe the structures of corresponding symmetries. More…

Functional Analysis · Mathematics 2015-12-09 Marcell Gaál , Lajos Molnár

We study an extension of the sandwiched R\'enyi relative entropies for normal positive functionals on a von Neumann algebra, for parameter values $\alpha\in [1/2,1)$. This work is intended as a continuation of [A. Jen\v{c}ov\'a, Ann. Henri…

Quantum Physics · Physics 2021-11-08 Anna Jenčová