English
Related papers

Related papers: Beyond Belief Propagation: Cluster-Corrected Tenso…

200 papers

Belief propagation (BP) is a message-passing method for solving probabilistic graphical models. It is very successful in treating disordered models (such as spin glasses) on random graphs. On the other hand, finite-dimensional lattice…

Statistical Mechanics · Physics 2016-02-17 Hai-Jun Zhou , Wei-Mou Zheng

We first present an empirical study of the Belief Propagation (BP) algorithm, when run on the random field Ising model defined on random regular graphs in the zero temperature limit. We introduce the notion of maximal solutions for the BP…

Disordered Systems and Neural Networks · Physics 2018-02-01 Gabriele Perugini , Federico Ricci-Tersenghi

Belief Propagation (BP) is one of the most popular methods for inference in probabilistic graphical models. BP is guaranteed to return the correct answer for tree structures, but can be incorrect or non-convergent for loopy graphical…

Artificial Intelligence · Computer Science 2012-06-22 Siamak Ravanbakhsh , Chun-Nam Yu , Russell Greiner

Belief propagation (BP) can do exact inference in loop-free graphs, but its performance could be poor in graphs with loops, and the understanding of its solution is limited. This work gives an interpretable belief propagation rule that is…

Machine Learning · Computer Science 2019-08-26 Dong Liu , Nima N. Moghadam , Lars K. Rasmussen , Jinliang Huang , Saikat Chatterjee

In this paper we present a synthesis of the work performed on two inference algorithms: the Pearl's belief propagation (BP) algorithm applied to Bayesian networks without loops (i.e. polytree) and the Loopy belief propagation (LBP)…

Artificial Intelligence · Computer Science 2012-06-06 Amen Ajroud , Mohamed Nazih Omri , Habib Youssef , Salem Benferhat

The belief propagation (BP) based algorithm is investigated as a potential decoder for both of error correcting codes and lossy compression, which are based on non-monotonic tree-like multilayer perceptron encoders. We discuss that whether…

Information Theory · Computer Science 2015-03-18 Kazushi Mimura , Florent Cousseau , Masato Okada

Message passing type algorithms such as the so-called Belief Propagation algorithm have recently gained a lot of attention in the statistics, signal processing and machine learning communities as attractive algorithms for solving a variety…

Discrete Mathematics · Computer Science 2016-03-10 David Gamarnik , Devavrat Shah , Yehua Wei

Belief propagation (BP) is a powerful tool to solve distributed inference problems, though it is limited by short cycles in the corresponding factor graph. Such cycles may lead to incorrect solutions or oscillatory behavior. Only for…

Systems and Control · Computer Science 2018-02-08 Christopher Lindberg , Julien M. Hendrickx , Henk Wymeersch

It has been proposed by many researchers that combining deep neural networks with graphical models can create more efficient and better regularized composite models. The main difficulties in implementing this in practice are associated with…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Patrick Knöbelreiter , Christian Sormann , Alexander Shekhovtsov , Friedrich Fraundorfer , Thomas Pock

Belief Propagation (BP) is an important message-passing algorithm for various reasoning tasks over graphical models, including solving the Constraint Optimization Problems (COPs). It has been shown that BP can achieve state-of-the-art…

Artificial Intelligence · Computer Science 2022-09-27 Yanchen Deng , Shufeng Kong , Caihua Liu , Bo An

Belief propagation is known to perform extremely well in many practical statistical inference and learning problems using graphical models, even in the presence of multiple loops. The iterative use of belief propagation algorithm on loopy…

Information Theory · Computer Science 2013-02-13 Xiangqiong Shi , Dan Schonfeld , Daniela Tuninetti

We consider the general problem of finding the minimum weight $\bm$-matching on arbitrary graphs. We prove that, whenever the linear programming (LP) relaxation of the problem has no fractional solutions, then the belief propagation (BP)…

Information Theory · Computer Science 2015-03-13 Mohsen Bayati , Christian Borgs , Jennifer Chayes , Riccardo Zecchina

Belief propagation is a widely used message passing method for the solution of probabilistic models on networks such as epidemic models, spin models, and Bayesian graphical models, but it suffers from the serious shortcoming that it works…

Statistical Mechanics · Physics 2021-04-27 Alec Kirkley , George T. Cantwell , M. E. J. Newman

Gaussian belief propagation (GaBP) is an iterative message-passing algorithm for inference in Gaussian graphical models. It is known that when GaBP converges it converges to the correct MAP estimate of the Gaussian random vector and simple…

Information Theory · Computer Science 2010-03-23 Jason K. Johnson , Danny Bickson , Danny Dolev

Belief Propagation (BP) is a popular, distributed heuristic for performing MAP computations in Graphical Models. BP can be interpreted, from a variational perspective, as minimizing the Bethe Free Energy (BFE). BP can also be used to solve…

Artificial Intelligence · Computer Science 2013-05-20 Andrew Gelfand , Jinwoo Shin , Michael Chertkov

The belief propagation (BP) algorithm is an efficient way to solve "inference" problems in graphical models, such as Bayesian networks and Markov random fields. The system-state probability distribution of CSMA wireless networks is a Markov…

Networking and Internet Architecture · Computer Science 2011-07-15 Cai Hong Kai , Soung Chang Liew

Gaussian belief propagation (BP) is a computationally efficient method to approximate the marginal distribution and has been widely used for inference with high dimensional data as well as distributed estimation in large-scale networks.…

Information Theory · Computer Science 2017-11-29 Jian Du , Soummya Kar , José M. F. Moura

We apply belief propagation (BP) to multi--user detection in a spread spectrum system, under the assumption of Gaussian symbols. We prove that BP is both convergent and allows to estimate the correct conditional expectation of the input…

Information Theory · Computer Science 2007-07-13 Andrea Montanari , Balaji Prabhakar , David Tse

Describing nonequilibrium quantum dynamics remains a significant computational challenge due to the growth of spatial entanglement. The tensor network influence functional (TN-IF) approach mitigates this problem for computing the time…

Quantum Physics · Physics 2025-11-26 Gunhee Park , Johnnie Gray , Garnet Kin-Lic Chan

Effectively compressing and optimizing tensor networks requires reliable methods for fixing the latent degrees of freedom of the tensors, known as the gauge. Here we introduce a new algorithm for gauging tensor networks using belief…

Quantum Physics · Physics 2025-03-03 Joseph Tindall , Matthew T. Fishman