English

Properties of Unique Information

Information Theory 2021-11-02 v2 math.IT

Abstract

We study the measure of unique information UI(T:XY)UI(T:X\setminus Y) defined by Bertschinger et al. (2014) within the framework of information decompositions. We study uniqueness and support of the solutions to the optimization problem underlying the definition of UIUI. We identify sufficient conditions for non-uniqueness of solutions with full support in terms of conditional independence constraints and in terms of the cardinalities of TT, XX and YY. Our results are based on a reformulation of the first order conditions on the objective function as rank constraints on a matrix of conditional probabilities. These results help to speed up the computation of UI(T:XY)UI(T:X\setminus Y), most notably when TT is binary. In the case that all variables are binary, we obtain a complete picture of where the optimizing probability distributions lie.

Keywords

Cite

@article{arxiv.1912.12505,
  title  = {Properties of Unique Information},
  author = {Johannes Rauh and Maik Schünemann and Jürgen Jost},
  journal= {arXiv preprint arXiv:1912.12505},
  year   = {2021}
}

Comments

18 pages, one figure, 11 theorems. One author was added to acknowledge early contributions to the results. The text was improved, minor mistakes and typos were corrected. One figure was added to visualize the optimization domain

R2 v1 2026-06-23T12:58:07.101Z