On extractable shared information
Abstract
We consider the problem of quantifying the information shared by a pair of random variables about another variable . We propose a new measure of shared information, called extractable shared information, that is left monotonic; that is, the information shared about is bounded from below by the information shared about for any function . We show that our measure leads to a new nonnegative decomposition of the mutual information into shared, complementary and unique components. We study properties of this decomposition and show that a left monotonic shared information is not compatible with a Blackwell interpretation of unique information. We also discuss whether it is possible to have a decomposition in which both shared and unique information are left monotonic.
Cite
@article{arxiv.1701.07805,
title = {On extractable shared information},
author = {Johannes Rauh and Pradeep Kr. Banerjee and Eckehard Olbrich and Jürgen Jost and Nils Bertschinger},
journal= {arXiv preprint arXiv:1701.07805},
year = {2017}
}
Comments
12 pages, journal version