English

On extractable shared information

Information Theory 2017-11-13 v3 math.IT

Abstract

We consider the problem of quantifying the information shared by a pair of random variables X1,X2X_{1},X_{2} about another variable SS. We propose a new measure of shared information, called extractable shared information, that is left monotonic; that is, the information shared about SS is bounded from below by the information shared about f(S)f(S) for any function ff. We show that our measure leads to a new nonnegative decomposition of the mutual information I(S;X1X2)I(S;X_1X_2) into shared, complementary and unique components. We study properties of this decomposition and show that a left monotonic shared information is not compatible with a Blackwell interpretation of unique information. We also discuss whether it is possible to have a decomposition in which both shared and unique information are left monotonic.

Keywords

Cite

@article{arxiv.1701.07805,
  title  = {On extractable shared information},
  author = {Johannes Rauh and Pradeep Kr. Banerjee and Eckehard Olbrich and Jürgen Jost and Nils Bertschinger},
  journal= {arXiv preprint arXiv:1701.07805},
  year   = {2017}
}

Comments

12 pages, journal version

R2 v1 2026-06-22T18:01:44.020Z