English
Related papers

Related papers: Belief Propagation Converges to Gaussian Distribut…

200 papers

Belief propagation (BP) is a message-passing heuristic for statistical inference in graphical models such as Bayesian networks and Markov random fields. BP is used to compute marginal distributions or maximum likelihood assignments and has…

Data Structures and Algorithms · Computer Science 2012-11-15 Tobias Brunsch , Kamiel Cornelissen , Bodo Manthey , Heiko Röglin

We apply belief propagation (BP) to multi--user detection in a spread spectrum system, under the assumption of Gaussian symbols. We prove that BP is both convergent and allows to estimate the correct conditional expectation of the input…

Information Theory · Computer Science 2007-07-13 Andrea Montanari , Balaji Prabhakar , David Tse

This paper focuses on the distributed static estimation problem and a Belief Propagation (BP) based estimation algorithm is proposed. We provide a complete analysis for convergence and accuracy of it. More precisely, we offer conditions…

Systems and Control · Electrical Eng. & Systems 2020-04-07 Damián Marelli , Tianju Sui , Minyue Fu , Ximing Sun

Belief propagation (BP) provides a scalable heuristic for contracting tensor networks on loopy graphs, but its success in quantum many-body settings has largely rested on empirical evidence. Developing upon a recently introduced…

Quantum Physics · Physics 2026-04-06 Siddhant Midha , Grace M. Sommers , Joseph Tindall , Dmitry A. Abanin

We present a novel distributed Gauss-Newton method for the non-linear state estimation (SE) model based on a probabilistic inference method called belief propagation (BP). The main novelty of our work comes from applying BP sequentially…

Information Theory · Computer Science 2018-08-28 Mirsad Cosovic , Dejan Vukobratovic

Gaussian Mixture Models (GMMs) commonly arise in communication systems, particularly in bilinear joint estimation and detection problems. Although the product of GMMs is still a GMM, as the number of factors increases, the number of…

Signal Processing · Electrical Eng. & Systems 2026-02-04 Zilu Zhao , Dirk Slock

A graphical model is a structured representation of locally dependent random variables. A traditional method to reason over these random variables is to perform inference using belief propagation. When provided with the true data generating…

Machine Learning · Computer Science 2021-03-17 Victor Garcia Satorras , Max Welling

Factor graphs are important models for succinctly representing probability distributions in machine learning, coding theory, and statistical physics. Several computational problems, such as computing marginals and partition functions, arise…

Machine Learning · Computer Science 2017-08-09 Damian Straszak , Nisheeth K. Vishnoi

Gaussian belief propagation (GaBP) is an iterative algorithm for computing the mean of a multivariate Gaussian distribution, or equivalently, the minimum of a multivariate positive definite quadratic function. Sufficient conditions, such as…

Information Theory · Computer Science 2014-01-07 Nicholas Ruozzi , Sekhar Tatikonda

Message-passing algorithms based on the Belief Propagation (BP) equations constitute a well-known distributed computational scheme. It is exact on tree-like graphical models and has also proven to be effective in many problems defined on…

Machine Learning · Computer Science 2022-07-20 Carlo Lucibello , Fabrizio Pittorino , Gabriele Perugini , Riccardo Zecchina

Probabilistic graphical models are a powerful concept for modeling high-dimensional distributions. Besides modeling distributions, probabilistic graphical models also provide an elegant framework for performing statistical inference;…

Artificial Intelligence · Computer Science 2022-09-13 Christian Knoll

Belief propagation (BP) is a useful probabilistic inference algorithm for efficiently computing approximate marginal probability densities of random variables. However, in its standard form, BP is only applicable to the vector-type random…

Artificial Intelligence · Computer Science 2024-04-05 Hyowon Kim , Angel F. García-Fernández , Yu Ge , Yuxuan Xia , Lennart Svensson , Henk Wymeersch

Belief Propagation (BP) is a widely used approximation for exact probabilistic inference in graphical models, such as Markov Random Fields (MRFs). In graphs with cycles, however, no exact convergence guarantees for BP are known, in general.…

Artificial Intelligence · Computer Science 2016-12-28 Wolfgang Gatterbauer

Belief propagation is a fundamental message-passing algorithm for numerous applications in machine learning. It is known that belief propagation algorithm is exact on tree graphs. However, belief propagation is run on loopy graphs in most…

Machine Learning · Computer Science 2021-12-14 Yitao Chen , Deepanshu Vasal

A number of problems in statistical physics and computer science can be expressed as the computation of marginal probabilities over a Markov random field. Belief propagation, an iterative message-passing algorithm, computes exactly such…

Machine Learning · Statistics 2012-10-23 Victorin Martin , Jean-Marc Lasgouttes , Cyril Furtlehner

Bayesian inference offers a principled account of information processing in natural agents. However, it remains an open question how neural mechanisms perform their abstract operations. We investigate a hypothesis where a distributed form…

Neural and Evolutionary Computing · Computer Science 2025-12-12 Sepideh Adamiat , Wouter M. Kouw , Bert de Vries

Belief Propagation algorithms are instruments used broadly to solve graphical model optimization and statistical inference problems. In the general case of a loopy Graphical Model, Belief Propagation is a heuristic which is quite successful…

Machine Learning · Statistics 2021-09-15 Andrii Riazanov , Yury Maximov , Michael Chertkov

We often encounter probability distributions given as unnormalized products of non-negative functions. The factorization structures are represented by hypergraphs called factor graphs. Such distributions appear in various fields, including…

Discrete Mathematics · Computer Science 2011-03-24 Yusuke Watanabe

The sum-product or belief propagation (BP) algorithm is a widely used message-passing technique for computing approximate marginals in graphical models. We introduce a new technique, called stochastic orthogonal series message-passing…

Information Theory · Computer Science 2012-12-18 Nima Noorshams , Martin J. Wainwright

We present a detailed study on application of factor graphs and the belief propagation (BP) algorithm to the power system state estimation (SE) problem. We start from the BP solution for the linear DC model, for which we provide a detailed…

Information Theory · Computer Science 2018-11-21 Mirsad Cosovic