English

Information flow on trees

Probability 2007-05-23 v1 Mathematical Physics Combinatorics math.MP

Abstract

Consider a tree network TT, where each edge acts as an independent copy of a given channel MM, and information is propagated from the root. For which TT and MM does the configuration obtained at level nn of TT typically contain significant information on the root variable? This problem arose independently in biology, information theory and statistical physics. For all bb, we construct a channel for which the variable at the root of the bb-ary tree is independent of the configuration at level 2 of that tree, yet for sufficiently large B>bB>b, the mutual information between the configuration at level nn of the BB-ary tree and the root variable is bounded away from zero. This is related to certain secret-sharing protocols. We improve the upper bounds on information flow for asymmetric binary channels (which correspond to the Ising model with an external field) and for symmetric qq-ary channels (which correspond to Potts models). Let \lam2(M)\lam_2(M) denote the second largest eigenvalue of MM, in absolute value. A CLT of Kesten and Stigum~(1966) implies that if b\lam2(M)2>1b |\lam_2(M)|^2 >1, then the {\em census} of the variables at any level of the bb-ary tree, contains significant information on the root variable. We establish a converse: if b\lam2(M)2<1b |\lam_2(M)|^2 < 1, then the census of the variables at level nn of the bb-ary tree is asymptotically independent of the root variable. This contrasts with examples where b\lam2(M)2<1b |\lam_2(M)|^2 <1, yet the {\em configuration} at level nn is not asymptotically independent of the root variable.

Keywords

Cite

@article{arxiv.math/0107033,
  title  = {Information flow on trees},
  author = {Elchanan Mossel and Yuval Peres},
  journal= {arXiv preprint arXiv:math/0107033},
  year   = {2007}
}