English

Intersection Information based on Common Randomness

Information Theory 2015-06-11 v3 math.IT

Abstract

The introduction of the partial information decomposition generated a flurry of proposals for defining an intersection information that quantifies how much of "the same information" two or more random variables specify about a target random variable. As of yet, none is wholly satisfactory. A palatable measure of intersection information would provide a principled way to quantify slippery concepts, such as synergy. Here, we introduce an intersection information measure based on the G\'acs-K\"orner common random variable that is the first to satisfy the coveted target monotonicity property. Our measure is imperfect, too, and we suggest directions for improvement.

Keywords

Cite

@article{arxiv.1310.1538,
  title  = {Intersection Information based on Common Randomness},
  author = {Virgil Griffith and Edwin K. P. Chong and Ryan G. James and Christopher J. Ellison and James P. Crutchfield},
  journal= {arXiv preprint arXiv:1310.1538},
  year   = {2015}
}

Comments

19 pages, 5 figures

R2 v1 2026-06-22T01:41:05.738Z