English

Coarse-graining and the Blackwell order

Information Theory 2017-11-13 v3 math.IT

Abstract

Suppose we have a pair of information channels, κ1,κ2\kappa_{1},\kappa_{2}, with a common input. The Blackwell order is a partial order over channels that compares κ1\kappa_{1} and κ2\kappa_{2} by the maximal expected utility an agent can obtain when decisions are based on the channel outputs. Equivalently, κ1\kappa_{1} is said to be Blackwell-inferior to κ2\kappa_{2} if and only if κ1\kappa_{1} can be constructed by garbling the output of κ2\kappa_{2}. A related partial order stipulates that κ2\kappa_{2} is more capable than κ1\kappa_{1} if the mutual information between the input and output is larger for κ2\kappa_{2} than for κ1\kappa_{1} for any distribution over inputs. A Blackwell-inferior channel is necessarily less capable. However, examples are known where κ1\kappa_{1} is less capable than κ2\kappa_{2} but not Blackwell-inferior. We show that this may even happen when κ1\kappa_{1} is constructed by coarse-graining the inputs of κ2\kappa_{2}. Such a coarse-graining is a special kind of "pre-garbling" of the channel inputs. This example directly establishes that the expected value of the shared utility function for the coarse-grained channel is larger than it is for the non-coarse-grained channel. This contradicts the intuition that coarse-graining can only destroy information and lead to inferior channels. We also discuss our results in the context of information decompositions.

Cite

@article{arxiv.1701.07602,
  title  = {Coarse-graining and the Blackwell order},
  author = {Johannes Rauh and Pradeep Kr. Banerjee and Eckehard Olbrich and Jürgen Jost and Nils Bertschinger and David Wolpert},
  journal= {arXiv preprint arXiv:1701.07602},
  year   = {2017}
}

Comments

12 pages, 1 figure, journal version

R2 v1 2026-06-22T18:00:56.446Z