English
Related papers

Related papers: R\'enyi Common Information for Doubly Symmetric Bi…

200 papers

Wyner's common information was originally defined for a pair of dependent discrete random variables. Its significance is largely reflected in, hence also confined to, several existing interpretations in various source coding problems. This…

Information Theory · Computer Science 2013-01-11 Ge Xu , Wei Liu , Biao Chen

We revisit the problem of asymmetric binary hypothesis testing against a composite alternative hypothesis. We introduce a general framework to treat such problems when the alternative hypothesis adheres to certain axioms. In this case we…

Information Theory · Computer Science 2017-12-12 Marco Tomamichel , Masahito Hayashi

Configurational entropy, or complexity, plays a critical role in characterizing disordered systems such as glasses, yet its measurement often requires significant computational resources. Recently, R\'enyi entropy, a one-parameter…

Disordered Systems and Neural Networks · Physics 2025-08-27 Nina Javerzat , Eric Bertin , Misaki Ozawa

Bounds on information combining are a fundamental tool in coding theory, in particular when analyzing polar codes and belief propagation. They usually bound the evolution of random variables with respect to their Shannon entropy. In recent…

Information Theory · Computer Science 2023-05-05 Christoph Hirche , Xinyue Guan , Marco Tomamichel

Existing polarization theories have mostly been concerned with Shannon's information measures, such as Shannon entropy and mutual information, and some related measures such as the Bhattacharyya parameter. In this work, we extend…

Information Theory · Computer Science 2019-07-16 Mengfan Zheng , Ling Liu , Cong Ling

Common information (CI) is ubiquitous in information theory and related areas such as theoretical computer science and discrete probability. However, because there are multiple notions of CI, a unified understanding of the deep…

Information Theory · Computer Science 2022-11-04 Lei Yu , Vincent Y. F. Tan

Computing entanglement entropy and its cousins is often challenging even in the simplest continuum and lattice models, partly because such entropies depend nontrivially on all geometric characteristics of the entangling region. Quantum…

Quantum Physics · Physics 2016-04-28 Mohammad F. Maghrebi

Numerous entropy-type characteristics (functionals) generalizing R\'enyi entropy are widely used in mathematical statistics, physics, information theory, and signal processing for characterizing uncertainty in probability distributions and…

Statistics Theory · Mathematics 2011-03-28 David Källberg , Nikolaj Leonenko , Oleg Seleznjev

We express the joint R\'enyi entropy of progressively censored order statistics in terms of an incomplete integral of the hazard function, and provide a simple estimate of the joint R\'enyi entropy of progressively Type-II censored data.…

Methodology · Statistics 2013-03-25 Akram Kohansal , Saeid Rezakhah

Pairwise metrics are often employed to estimate statistical dependencies between brain regions, however they do not capture higher-order information interactions. It is critical to explore higher-order interactions that go beyond paired…

Neurons and Cognition · Quantitative Biology 2023-08-04 Qiang Li , Shujian Yu , Kristoffer H Madsen , Vince D Calhoun , Armin Iraji

Uncovering causal interdependencies from observational data is one of the great challenges of nonlinear time series analysis. In this paper, we discuss this topic with the help of information-theoretic concept known as R\'enyi information…

Information Theory · Computer Science 2022-06-28 Petr Jizba , Hynek Lavička , Zlata Tabachová

We compute the R\'enyi mutual information of two disjoint spheres in free massless scalar theory in even dimensions higher than two. The spherical twist operator in a conformal field theory can be expanded into the sum of local primary…

High Energy Physics - Theory · Physics 2017-08-16 Bin Chen , Jiang Long

The conditional quantum mutual information $I(A;B|C)$ of a tripartite state $\rho_{ABC}$ is an information quantity which lies at the center of many problems in quantum information theory. Three of its main properties are that it is…

Quantum Physics · Physics 2015-03-17 Mario Berta , Kaushik P. Seshadreesan , Mark M. Wilde

We use a R\'enyi entropy method to prove strong converse theorems for certain information-theoretic tasks which involve local operations and quantum or classical communication between two parties. These include state redistribution,…

Quantum Physics · Physics 2016-08-10 Felix Leditzky , Mark M. Wilde , Nilanjana Datta

We consider the problem of distributed binary hypothesis testing of two sequences that are generated by an i.i.d. doubly-binary symmetric source. Each sequence is observed by a different terminal. The two hypotheses correspond to different…

Information Theory · Computer Science 2018-01-03 Eli Haim , Yuval Kochman

This study considers the unconditional smooth R\'{e}nyi entropy, the smooth conditional R\'{e}nyi entropy proposed by Kuzuoka [\emph{IEEE Trans.\ Inf.\ Theory}, vol.~66, no.~3, pp.~1674--1690, 2020], and a new quantity which we term the…

Information Theory · Computer Science 2020-03-13 Yuta Sakai , Vincent Y. F. Tan

The R\'enyi entropies $R_{p}[\rho]$, $p>0,\neq 1$ of the highly-excited quantum states of the $D$-dimensional isotropic harmonic oscillator are analytically determined by use of the strong asymptotics of the orthogonal polynomials which…

Mathematical Physics · Physics 2016-10-07 A. I. Aptekarev , D. N. Tulyakov , I. V. Toranzo , J. S. Dehesa

R\'enyi entropy of order \alpha is a general measure of entropy. In this paper we derive estimations for the R\'enyi entropy of the mixture of sources in terms of the entropy of the single sources. These relations allow to compute the…

Information Theory · Computer Science 2012-04-13 Marek Śmieja , Jacek Tabor

In [Berta et al., J. Math. Phys. 56, 022205 (2015)], we recently proposed Renyi generalizations of the conditional quantum mutual information of a tripartite state on $ABC$ (with $C$ being the conditioning system), which were shown to…

Quantum Physics · Physics 2015-09-21 Kaushik P. Seshadreesan , Mario Berta , Mark M. Wilde

The sandwiched R\'enyi divergences of two finite-dimensional density operators quantify their asymptotic distinguishability in the strong converse domain. This establishes the sandwiched R\'enyi divergences as the operationally relevant…

Quantum Physics · Physics 2025-08-12 Milán Mosonyi