English
Related papers

Related papers: On Exact and $\infty$-R\'enyi Common Informations

200 papers

The Renyi entropy plays an essential role in quantum information theory. We study the continuity estimation of the Renyi entropy. An inequality relating the Renyi entropy difference of two quantum states to their trace norm distance is…

Quantum Physics · Physics 2017-01-11 Zhihua Chen , Zhihao Ma , Ismail Nikoufar , Shaoming Fei

It has been shown that the $\alpha-z$ R{\'e}nyi relative entropy satisfies the Data Processing Inequality (DPI) for a certain range of $\alpha$'s and $z$'s. Moreover, the range is completely characterized by Zhang in `20. We prove necessary…

Mathematical Physics · Physics 2020-10-28 Sarah Chehade

A novel definition of the conditional smooth Renyi entropy, which is different from that of Renner and Wolf, is introduced. It is shown that our definition of the conditional smooth Renyi entropy is appropriate to give lower and upper…

Information Theory · Computer Science 2019-01-25 Shigeaki Kuzuoka

In 2016, Karney proposed an exact sampling algorithm for the standard normal distribution. In this paper, we study the computational complexity of this algorithm under the random deviate model. Specifically, Karney's algorithm requires the…

Data Structures and Algorithms · Computer Science 2020-08-11 Yusong Du , Baoying Fan , Baodian Wei

We investigate the problem of generating common randomness (CR) from finite compound sources aided by unidirectional communication over rate-limited perfect channels. The two communicating parties, often referred to as terminals, observe…

Information Theory · Computer Science 2024-01-26 Rami Ezzine , Moritz Wiese , Christian Deppe , Holger Boche

We use a R\'enyi entropy method to prove strong converse theorems for certain information-theoretic tasks which involve local operations and quantum or classical communication between two parties. These include state redistribution,…

Quantum Physics · Physics 2016-08-10 Felix Leditzky , Mark M. Wilde , Nilanjana Datta

We prove a tight uniform continuity bound for Arimoto's version of the conditional $\alpha$-R\'enyi entropy, for the range $\alpha \in [0, 1)$. This definition of the conditional R\'enyi entropy is the most natural one among the multiple…

Information Theory · Computer Science 2022-03-29 Michael G. Jabbour , Nilanjana Datta

We provide the sandwiched R\'enyi divergence of order $\alpha\in(\frac{1}{2},1)$, as well as its induced quantum information quantities, with an operational interpretation in the characterization of the exact strong converse exponents of…

Quantum Physics · Physics 2024-05-29 Ke Li , Yongsheng Yao

For normalized sums $Z_n$ of i.i.d. random variables, we explore necessary and sufficient conditions which guarantee the normal approximation with respect to the R\'enyi divergence of infinite order. In terms of densities $p_n$ of $Z_n$,…

Probability · Mathematics 2024-06-21 Sergey G. Bobkov , Friedrich Götze

We study conditional mutual information (cMI) between a pair of variables $X,Y$ given a third one $Z$ and derived quantities including transfer entropy (TE) and causation entropy (CE) in the dynamically relevant context where $X=T(Y,Z)$ is…

Dynamical Systems · Mathematics 2025-03-27 Zheng Bian , Erik M. Bollt

We consider wiretap channels with uncertainty on the eavesdropper channel under (i) noisy blockwise type II, (ii) compound, or (iii) arbitrarily varying models. We present explicit wiretap codes that can handle these models in a unified…

Information Theory · Computer Science 2022-11-03 Remi A. Chou

The quantum relative entropy is a fundamental quantity in quantum information science, characterizing the distinguishability between two quantum states. However, this quantity is not additive in general for correlated quantum states,…

Quantum Physics · Physics 2025-06-05 Kun Fang , Hamza Fawzi , Omar Fawzi

It has been known for a long time that the mutual information between the input sequence and output of a binary symmetric channel (BSC) is upper bounded by the mutual information between the same input sequence and the output of a binary…

Information Theory · Computer Science 2024-01-29 Uri Erez , Or Ordentlich , Shlomo Shamai

Estimating the entropy of a discrete random variable is a fundamental problem in information theory and related fields. This problem has many applications in various domains, including machine learning, statistics and data compression. Over…

Information Theory · Computer Science 2020-12-22 Yuval Shalev , Amichai Painsky , Irad Ben-Gal

Two familiar notions of correlation are rediscovered as extreme operating points for simulating a discrete memoryless channel, in which a channel output is generated based only on a description of the channel input. Wyner's "common…

Information Theory · Computer Science 2008-05-02 Paul Cuff

An information-theoretic development is given for the problem of compound Poisson approximation, which parallels earlier treatments for Gaussian and Poisson approximation. Let $P_{S_n}$ be the distribution of a sum $S_n=\Sumn Y_i$ of…

Probability · Mathematics 2019-06-05 A. D. Barbour , Oliver Johnson , Ioannis Kontoyiannis , Mokshay Madiman

This work provides data-processing and majorization inequalities for $f$-divergences, and it considers some of their applications to coding problems. This work also provides tight bounds on the R\'{e}nyi entropy of a function of a discrete…

Information Theory · Computer Science 2021-04-01 Igal Sason

We explore a large class of correlation measures called the $\alpha-z$ R\'enyi mutual informations (RMIs). Unlike the commonly used notion of RMI involving linear combinations of R\'enyi entropies, the $\alpha-z$ RMIs are positive…

High Energy Physics - Theory · Physics 2024-08-27 Jonah Kudler-Flam , Laimei Nie , Akash Vijay

This paper introduces "swiveled Renyi entropies" as an alternative to the Renyi entropic quantities put forward in [Berta et al., Phys. Rev. A 91, 022333 (2015)]. What distinguishes the swiveled Renyi entropies from the prior proposal of…

Quantum Physics · Physics 2016-03-22 Frédéric Dupuis , Mark M. Wilde

We derive a new upper bound for Eve's information in secret key generation from a common random number without communication. This bound improves on Bennett et al(1995)'s bound based on the R\'enyi entropy of order 2 because the bound…

Information Theory · Computer Science 2016-11-17 Masahito Hayashi