English
Related papers

Related papers: Wyner's Common Information under R\'enyi Divergenc…

200 papers

Quantum information processing is limited, in practice, to efficiently implementable operations. This motivates the study of quantum divergences that preserve their operational meaning while faithfully capturing these computational…

Quantum Physics · Physics 2025-09-26 Álvaro Yángüez , Thomas A. Hahn , Jan Kochanowski

We propose R\'enyi information generating function and discuss its properties. A connection between the R\'enyi information generating function and the diversity index is proposed for discrete type random variables. The relation between the…

Statistics Theory · Mathematics 2025-02-25 Shital Saha , Suchandan Kayal , N. Balakrishnan

Bounds on information combining are entropic inequalities that determine how the information, or entropy, of a set of random variables can change when they are combined in certain prescribed ways. Such bounds play an important role in…

Information Theory · Computer Science 2020-11-10 Christoph Hirche

The mutual information is a measure of classical and quantum correlations of great interest in quantum information. It is also relevant in quantum many-body physics, by virtue of satisfying an area law for thermal states and bounding all…

Quantum Physics · Physics 2021-09-15 Samuel O. Scalet , Álvaro M. Alhambra , Georgios Styliaris , J. Ignacio Cirac

We study a distributed sampling problem where a set of processors want to output (approximately) independent and identically distributed samples from a joint distribution with the help of a common message from a coordinator. Each processor…

Information Theory · Computer Science 2021-06-24 Gowtham R. Kurri , Vinod M. Prabhakaran , Anand D. Sarwate

Secure multi-party computation is a central problem in modern cryptography. An important sub-class of this are problems of the following form: Alice and Bob desire to produce sample(s) of a pair of jointly distributed random variables. Each…

Information Theory · Computer Science 2010-02-10 Vinod Prabhakaran , Manoj Prabhakaran

We take a closer look at the structure of bivariate dependency induced by a pair of predictor random variables $(X_1, X_2)$ trying to synergistically, redundantly or uniquely encode a target random variable $Y$. We evaluate a recently…

Information Theory · Computer Science 2015-03-03 Pradeep Kr. Banerjee

Wyner's Common Information and a natural relaxation are studied in the special case of Gaussian random variables. The relaxation replaces conditional independence by a bound on the conditional mutual information. The main contribution is…

Information Theory · Computer Science 2020-09-29 Erixhen Sula , Michael Gastpar

In this paper we generalize the notion of common information of two dependent variables introduced by G\'acs & K\"orner. They defined common information as the largest entropy rate of a common random variable two parties observing one of…

Information Theory · Computer Science 2016-11-17 Vinod M. Prabhakaran , Manoj M. Prabhakaran

This paper establishes the exact strong converse exponent of the soft covering problem in the classical setting. This exponent characterizes the slowest achievable convergence speed of the total variation to one when a code of rate below…

Information Theory · Computer Science 2026-04-01 Xingyi He , S. Sandeep Pradhan , Andreas Winter

We propose a notion of common information that allows one to quantify and separate the information that is shared between two random variables from the information that is unique to each. Our notion of common information is defined by an…

Machine Learning · Computer Science 2023-11-07 Michael Kleinman , Alessandro Achille , Stefano Soatto , Jonathan Kao

We study secure source-coding with causal disclosure, under the Gaussian distribution. The optimality of Gaussian auxiliary random variables is shown in various scenarios. We explicitly characterize the tradeoff between the rates of…

Information Theory · Computer Science 2015-06-16 Sanket Satpathy , Paul Cuff

We revisit the Gray-Wyner lossy source coding problem and derive the first-order asymptotic optimal rate-distortion-perception region when additional perception constraints are imposed on reproduced source sequences. The optimal trade-off…

Information Theory · Computer Science 2026-01-19 Yu Yang , Yingxin Zhang , Weijie Yuan , Lin Zhou

We investigate the Wyner-Ziv coding in which the statistics of the principal source is known but the statistics of the channel generating the side-information is unknown except that it is in a certain class. The class consists of channels…

Information Theory · Computer Science 2013-05-06 Shun Watanabe , Shigeaki Kuzuoka

It is well known that lossless compression of a discrete memoryless source with near-uniform encoder output is possible at a rate above its entropy if and only if the encoder is randomized. This work focuses on deriving conditions for…

Information Theory · Computer Science 2016-07-12 Badri N Vellambi , Joerg Kliewer , Matthieu Bloch

The strong converse for a coding theorem shows that the optimal asymptotic rate possible with vanishing error cannot be improved by allowing a fixed error. Building on a method introduced by Gu and Effros for centralized coding problems, we…

Information Theory · Computer Science 2019-08-22 Himanshu Tyagi , Shun Watanabe

We introduce an innovative and mathematically rigorous definition for computing common information from multi-view data, drawing inspiration from G\'acs-K\"orner common information in information theory. Leveraging this definition, we…

Machine Learning · Computer Science 2024-06-24 Qi Zhang , Mingfei Lu , Shujian Yu , Jingmin Xin , Badong Chen

Consider the problem where a statistician in a two-node system receives rate-limited information from a transmitter about marginal observations of a memoryless process generated from two possible distributions. Using its own observations,…

Information Theory · Computer Science 2017-03-02 Gil Katz , Pablo Piantanida , Mérouane Debbah

The question of how much communication is required between collaborating parties to compute a function of their data is of fundamental importance in the fields of theoretical computer science and information theory. In this work, the focus…

Information Theory · Computer Science 2016-02-09 Shijin Rajakrishnan , Sundara Rajan S , Vinod Prabhakaran

We revisit the problem of asymmetric binary hypothesis testing against a composite alternative hypothesis. We introduce a general framework to treat such problems when the alternative hypothesis adheres to certain axioms. In this case we…

Information Theory · Computer Science 2017-12-12 Marco Tomamichel , Masahito Hayashi