English
Related papers

Related papers: Properties of the Strong Data Processing Constant …

200 papers

This paper establishes that the strong converse holds for some classes of discrete memoryless multimessage multicast networks (DM-MMNs) whose corresponding cut-set bounds are tight, i.e., coincide with the set of achievable rate tuples. The…

Information Theory · Computer Science 2016-10-19 Silas L. Fong , Vincent Y. F. Tan

Optimal rates for achieving an information processing task are often characterized in terms of regularized information measures. In many cases of quantum tasks, we do not know how to compute such quantities. Here, we exploit the symmetries…

Quantum Physics · Physics 2023-08-25 Omar Fawzi , Ala Shayeghi , Hoang Ta

We propose a new family of regularized R\'enyi divergences parametrized not only by the order $\alpha$ but also by a variational function space. These new objects are defined by taking the infimal convolution of the standard R\'enyi…

Machine Learning · Statistics 2023-02-16 Jeremiah Birrell , Yannis Pantazis , Paul Dupuis , Markos A. Katsoulakis , Luc Rey-Bellet

We present a systematic study of the geometric R\'enyi divergence (GRD), also known as the maximal R\'enyi divergence, from the point of view of quantum information theory. We show that this divergence, together with its extension to…

Quantum Physics · Physics 2021-10-29 Kun Fang , Hamza Fawzi

Data processing inequalities for $f$-divergences can be sharpened using constants called "contraction coefficients" to produce strong data processing inequalities. For any discrete source-channel pair, the contraction coefficients for…

Information Theory · Computer Science 2018-07-17 Anuran Makur , Lizhong Zheng

Anomalous dynamics in which local perturbations spread faster than diffusion are ubiquitously observed in the long-time behavior of a wide variety of systems. Here, the manner by which such systems evolve towards their asymptotic…

Statistical Mechanics · Physics 2020-04-09 Asaf Miron

Rate-distortion (R-D) function, a key quantity in information theory, characterizes the fundamental limit of how much a data source can be compressed subject to a fidelity criterion, by any compression algorithm. As researchers push for…

Information Theory · Computer Science 2022-03-14 Yibo Yang , Stephan Mandt

Universal features in the scalings of Shannon-R\'enyi entropies of many-body groundstates are studied for interacting spin-$\frac{1}{2}$ systems across (2+1) dimensional $O(3)$ critical points, using quantum Monte Carlo simulations on…

Strongly Correlated Electrons · Physics 2014-04-23 David J. Luitz , Fabien Alet , Nicolas Laflorencie

R\'enyi divergence is related to R\'enyi entropy much like Kullback-Leibler divergence is related to Shannon's entropy, and comes up in many settings. It was introduced by R\'enyi as a measure of information that satisfies almost the same…

Information Theory · Computer Science 2014-04-25 Tim van Erven , Peter Harremoës

An intuitive outer bound for the multiterminal source coding problem is given. The proposed bound explicitly couples the rate distortion functions for each source and correlation measures which derive from a "strong" data processing…

Information Theory · Computer Science 2013-07-17 Thomas A. Courtade

We investigate the classical communication over quantum channels when assisted by no-signaling (NS) and positive-partial-transpose-preserving (PPT) codes, for which both the optimal success probability of a given transmission rate and the…

Quantum Physics · Physics 2018-07-16 Xin Wang , Wei Xie , Runyao Duan

Uniform continuity bounds on entropies are generally expressed in terms of a single distance measure between a pair of probability distributions or quantum states, typically, the total variation distance or trace distance. However, if an…

Quantum Physics · Physics 2025-01-09 Michael G. Jabbour , Nilanjana Datta

The sandwiched R\'enyi $\alpha$-divergences of two finite-dimensional quantum states play a distinguished role among the many quantum versions of R\'enyi divergences as the tight quantifiers of the trade-off between the two error…

Quantum Physics · Physics 2025-08-12 Fumio Hiai , Milán Mosonyi

Strong converse theorems refer to the study of impossibility results in information theory. In particular, Mosonyi and Ogawa established a one-shot strong converse bound for quantum hypothesis testing [Comm. Math. Phys, 334(3), 2014], which…

Quantum Physics · Physics 2024-03-21 Hao-Chung Cheng , Li Gao

We present new methods for assessing the privacy guarantees of an algorithm with regard to R\'enyi Differential Privacy. To the best of our knowledge, this work is the first to address this problem in a black-box scenario, where only…

Cryptography and Security · Computer Science 2022-12-12 Tim Kutta , Önder Askin , Martin Dunsche

The conventional channel resolvability problem refers to the determination of the minimum rate required for an input process so that the output distribution approximates a target distribution in either the total variation distance or the…

Information Theory · Computer Science 2018-12-04 Lei Yu , Vincent Y. F. Tan

R\'enyi divergence is related to R\'enyi entropy much like information divergence (also called Kullback-Leibler divergence or relative entropy) is related to Shannon's entropy, and comes up in many settings. It was introduced by R\'enyi as…

Information Theory · Computer Science 2010-05-28 Tim van Erven , Peter Harremoës

Surprise Adequacy (SA) has been widely studied as a test adequacy metric that can effectively guide software engineers towards inputs that are more likely to reveal unexpected behaviour of Deep Neural Networks (DNNs). Intuitively, SA is an…

Software Engineering · Computer Science 2025-02-06 Somin Kim , Shin Yoo

Information-theoretic inequalities play a fundamental role in numerous scientific and technological areas as they generally express the impossibility to have a complete description of a system via a finite number of information measures. In…

Mathematical Physics · Physics 2017-10-03 Steeve Zozor , David Puertas-Centeno , Jesús S. Dehesa

It has been shown that the $\alpha-z$ R{\'e}nyi relative entropy satisfies the Data Processing Inequality (DPI) for a certain range of $\alpha$'s and $z$'s. Moreover, the range is completely characterized by Zhang in `20. We prove necessary…

Mathematical Physics · Physics 2020-10-28 Sarah Chehade