English

Belief Propagation and Loop Calculus for the Permanent of a Non-Negative Matrix

Data Structures and Algorithms 2015-05-14 v2 Statistical Mechanics Discrete Mathematics Machine Learning Numerical Analysis Optimization and Control

Abstract

We consider computation of permanent of a positive (N×N)(N\times N) non-negative matrix, P=(Piji,j=1,,N)P=(P_i^j|i,j=1,\cdots,N), or equivalently the problem of weighted counting of the perfect matchings over the complete bipartite graph KN,NK_{N,N}. The problem is known to be of likely exponential complexity. Stated as the partition function ZZ of a graphical model, the problem allows exact Loop Calculus representation [Chertkov, Chernyak '06] in terms of an interior minimum of the Bethe Free Energy functional over non-integer doubly stochastic matrix of marginal beliefs, β=(βiji,j=1,,N)\beta=(\beta_i^j|i,j=1,\cdots,N), also correspondent to a fixed point of the iterative message-passing algorithm of the Belief Propagation (BP) type. Our main result is an explicit expression of the exact partition function (permanent) in terms of the matrix of BP marginals, β\beta, as Z=\mboxPerm(P)=ZBP\mboxPerm(βij(1βij))/i,j(1βij)Z=\mbox{Perm}(P)=Z_{BP} \mbox{Perm}(\beta_i^j(1-\beta_i^j))/\prod_{i,j}(1-\beta_i^j), where ZBPZ_{BP} is the BP expression for the permanent stated explicitly in terms if β\beta. We give two derivations of the formula, a direct one based on the Bethe Free Energy and an alternative one combining the Ihara graph-ζ\zeta function and the Loop Calculus approaches. Assuming that the matrix β\beta of the Belief Propagation marginals is calculated, we provide two lower bounds and one upper-bound to estimate the multiplicative term. Two complementary lower bounds are based on the Gurvits-van der Waerden theorem and on a relation between the modified permanent and determinant respectively.

Keywords

Cite

@article{arxiv.0911.1419,
  title  = {Belief Propagation and Loop Calculus for the Permanent of a Non-Negative Matrix},
  author = {Yusuke Watanabe and Michael Chertkov},
  journal= {arXiv preprint arXiv:0911.1419},
  year   = {2015}
}

Comments

11 pages; submitted to Journal of Physics A: Mathematical Theoretical