English
Related papers

Related papers: Belief-Propagation for Weighted b-Matchings on Arb…

200 papers

Belief propagation -- a powerful heuristic method to solve inference problems involving a large number of random variables -- was recently generalized to quantum theory. Like its classical counterpart, this algorithm is exact on trees when…

Quantum Physics · Physics 2009-11-13 David Poulin , Ersen Bilgin

Belief Propagation (BP) is an efficient message-passing algorithm widely used for inference in graphical models and for solving various problems in statistical physics. However, BP often yields inaccurate estimates of order parameters and…

Social and Information Networks · Computer Science 2025-10-23 Seongmin Kim , Alec Kirkley

The belief propagation (BP) based algorithm is investigated as a potential decoder for both of error correcting codes and lossy compression, which are based on non-monotonic tree-like multilayer perceptron encoders. We discuss that whether…

Information Theory · Computer Science 2015-03-18 Kazushi Mimura , Florent Cousseau , Masato Okada

Inference problems in graphical models can be represented as a constrained optimization of a free energy function. It is known that when the Bethe free energy is used, the fixedpoints of the belief propagation (BP) algorithm correspond to…

Machine Learning · Computer Science 2012-06-18 Tamir Hazan , Amnon Shashua

Gaussian belief propagation (GBP) is a recursive computation method that is widely used in inference for computing marginal distributions efficiently. Depending on how the factorization of the underlying joint Gaussian distribution is…

Information Theory · Computer Science 2018-01-22 Jian Du , Shaodan Ma , Yik-Chung Wu , Soummya Kar , José M. F. Moura

In this paper, we investigate distributed inference schemes, over binary-valued Markov random fields, which are realized by the belief propagation (BP) algorithm. We first show that a decision variable obtained by the BP algorithm in a…

Information Theory · Computer Science 2019-09-19 Younes Abdi , Tapani Ristaniemi

Belief Propagation (BP) is a simple probabilistic inference algorithm, consisting of passing messages between nodes of a graph representing a probability distribution. Its analogy with a neural network suggests that it could have…

Artificial Intelligence · Computer Science 2024-03-20 Vincent Bouttier , Renaud Jardri , Sophie Deneve

When belief propagation (BP) converges, it does so to a stationary point of the Bethe free energy $F$, and is often strikingly accurate. However, it may converge only to a local optimum or may not converge at all. An algorithm was recently…

Machine Learning · Computer Science 2014-01-03 Adrian Weller , Tony Jebara

We address the question of convergence in the loopy belief propagation (LBP) algorithm. Specifically, we relate convergence of LBP to the existence of a weak limit for a sequence of Gibbs measures defined on the LBP s associated computation…

Artificial Intelligence · Computer Science 2013-01-07 Sekhar Tatikonda , Michael I. Jordan

We often encounter probability distributions given as unnormalized products of non-negative functions. The factorization structures are represented by hypergraphs called factor graphs. Such distributions appear in various fields, including…

Discrete Mathematics · Computer Science 2011-03-24 Yusuke Watanabe

In this paper we present a synthesis of the work performed on two inference algorithms: the Pearl's belief propagation (BP) algorithm applied to Bayesian networks without loops (i.e. polytree) and the Loopy belief propagation (LBP)…

Artificial Intelligence · Computer Science 2012-06-06 Amen Ajroud , Mohamed Nazih Omri , Habib Youssef , Salem Benferhat

Max-product "belief propagation" is an iterative, local, message-passing algorithm for finding the maximum a posteriori (MAP) assignment of a discrete probability distribution specified by a graphical model. Despite the spectacular success…

Information Theory · Computer Science 2012-03-06 Mohsen Bayati , Devavrat Shah , Mayank Sharma

Gaussian belief propagation (GaBP) is an iterative algorithm for computing the mean of a multivariate Gaussian distribution, or equivalently, the minimum of a multivariate positive definite quadratic function. Sufficient conditions, such as…

Information Theory · Computer Science 2014-01-07 Nicholas Ruozzi , Sekhar Tatikonda

The sum-product or belief propagation (BP) algorithm is a widely-used message-passing algorithm for computing marginal distributions in graphical models with discrete variables. At the core of the BP message updates, when applied to a…

Information Theory · Computer Science 2012-05-28 Nima Noorshams , Martin J. Wainwright

Inference for probabilistic graphical models is still very much a practical challenge in large domains. The commonly used and effective belief propagation (BP) algorithm and its generalizations often do not converge when applied to hard,…

Artificial Intelligence · Computer Science 2012-07-02 Gal Elidan , Ian McGraw , Daphne Koller

We study text summarization from the viewpoint of maximum coverage problem. In graph theory, the task of text summarization is regarded as maximum coverage problem on bipartite graph with weighted nodes. In recent study, belief-propagation…

Computation and Language · Computer Science 2020-04-20 Hiroki Kitano , Koujin Takeda

Belief Propagation (BP) is an important message-passing algorithm for various reasoning tasks over graphical models, including solving the Constraint Optimization Problems (COPs). It has been shown that BP can achieve state-of-the-art…

Artificial Intelligence · Computer Science 2022-09-27 Yanchen Deng , Shufeng Kong , Caihua Liu , Bo An

The Graph Burning Problem (GBP) is a combinatorial optimization problem that has gained relevance as a tool for quantifying a graph's vulnerability to contagion. Although it is based on a very simple propagation model, its decision version…

A number of problems in statistical physics and computer science can be expressed as the computation of marginal probabilities over a Markov random field. Belief propagation, an iterative message-passing algorithm, computes exactly such…

Machine Learning · Statistics 2012-10-23 Victorin Martin , Jean-Marc Lasgouttes , Cyril Furtlehner

We present new message passing algorithms for performing inference with graphical models. Our methods are designed for the most difficult inference problems where loopy belief propagation and other heuristics fail to converge. Belief…

Artificial Intelligence · Computer Science 2022-07-19 Anna Grim , Pedro Felzenszwalb