English
Related papers

Related papers: Belief propagation for graph partitioning

200 papers

We define and study an inference algorithm based on "belief propagation" (BP) and the Bethe approximation. The idea is to encode into a graph an a priori information composed of correlations or marginal probabilities of variables, and to…

Physics and Society · Physics 2007-05-23 Cyril Furtlehner , Jean-Marc Lasgouttes , Arnaud De La Fortelle

We propose an approach to do learning in Gaussian factor graphs. We treat all relevant quantities (inputs, outputs, parameters, latents) as random variables in a graphical model, and view both training and prediction as inference problems…

Machine Learning · Computer Science 2024-07-18 Seth Nabarro , Mark van der Wilk , Andrew J Davison

This paper develops methods of distributed Bayesian hypothesis tests for fault detection and diagnosis that are based on belief propagation and optimization in graphical models. The main challenges in developing distributed statistical…

Systems and Control · Computer Science 2015-01-20 Kwang-Ki K. Kim

Belief Propagation algorithms are instruments used broadly to solve graphical model optimization and statistical inference problems. In the general case of a loopy Graphical Model, Belief Propagation is a heuristic which is quite successful…

Machine Learning · Statistics 2021-09-15 Andrii Riazanov , Yury Maximov , Michael Chertkov

We study the problem of approximating the partition function of the ferromagnetic Ising model in graphs and hypergraphs. Our first result is a deterministic approximation scheme (an FPTAS) for the partition function in bounded degree graphs…

Data Structures and Algorithms · Computer Science 2018-12-26 Jingcheng Liu , Alistair Sinclair , Piyush Srivastava

The belief propagation (BP) algorithm is widely applied to perform approximate inference on arbitrary graphical models, in part due to its excellent empirical properties and performance. However, little is known theoretically about when…

Artificial Intelligence · Computer Science 2012-06-26 Alexander T. Ihler

Belief Propagation (BP) is a popular, distributed heuristic for performing MAP computations in Graphical Models. BP can be interpreted, from a variational perspective, as minimizing the Bethe Free Energy (BFE). BP can also be used to solve…

Artificial Intelligence · Computer Science 2013-05-20 Andrew Gelfand , Jinwoo Shin , Michael Chertkov

We present a novel inference algorithm for arbitrary, binary, undirected graphs. Unlike loopy belief propagation, which iterates fixed point equations, we directly descend on the Bethe free energy. The algorithm consists of two phases,…

Artificial Intelligence · Computer Science 2013-01-14 Max Welling , Yee Whye Teh

In this article, we present a visual introduction to Gaussian Belief Propagation (GBP), an approximate probabilistic inference algorithm that operates by passing messages between the nodes of arbitrarily structured factor graphs. A special…

Artificial Intelligence · Computer Science 2021-07-07 Joseph Ortiz , Talfan Evans , Andrew J. Davison

We consider the problem of reconstructing sparse symmetric block models with two blocks and connection probabilities $a/n$ and $b/n$ for inter- and intra-block edge probabilities, respectively. It was recently shown that one can do better…

Probability · Mathematics 2016-09-28 Elchanan Mossel , Joe Neeman , Allan Sly

We consider a variation of the prototype combinatorial-optimisation problem known as graph-colouring. Our optimisation goal is to colour the vertices of a graph with a fixed number of colours, in a way to maximise the number of different…

Statistical Mechanics · Physics 2015-05-27 Alessandro Pelizzola , Marco Pretti , Jort van Mourik

A fundamental computation for statistical inference and accurate decision-making is to compute the marginal probabilities or most probable states of task-relevant variables. Probabilistic graphical models can efficiently represent the…

Machine Learning · Computer Science 2019-06-28 KiJung Yoon , Renjie Liao , Yuwen Xiong , Lisa Zhang , Ethan Fetaya , Raquel Urtasun , Richard Zemel , Xaq Pitkow

We propose a hybrid message passing method for distributed cooperative localization and tracking of mobile agents. Belief propagation and mean field message passing are employed for, respectively, the motion-related and measurement-related…

Systems and Control · Computer Science 2016-05-25 Burak Çakmak , Daniel N. Urup , Florian Meyer , Troels Pedersen , Bernard H. Fleury , Franz Hlawatsch

In the quest for scalable Bayesian computational algorithms we need to exploit the full potential of existing methodologies. In this note we point out that message passing algorithms, which are very well developed for inference in graphical…

Computation · Statistics 2017-09-05 Omiros Papaspiliopoulos , Giacomo Zanella

We study text summarization from the viewpoint of maximum coverage problem. In graph theory, the task of text summarization is regarded as maximum coverage problem on bipartite graph with weighted nodes. In recent study, belief-propagation…

Computation and Language · Computer Science 2020-04-20 Hiroki Kitano , Koujin Takeda

A new approximation of the cluster variational method is introduced for the three-dimensional Ising model on the simple cubic lattice. The maximal cluster is, as far as we know, the largest ever used in this method. A message-passing…

Statistical Mechanics · Physics 2014-01-22 Alessandro Pelizzola

The belief propagation (BP) algorithm is an efficient way to solve "inference" problems in graphical models, such as Bayesian networks and Markov random fields. The system-state probability distribution of CSMA wireless networks is a Markov…

Networking and Internet Architecture · Computer Science 2011-07-15 Cai Hong Kai , Soung Chang Liew

We present a new approach to a classical problem in statistical physics: estimating the partition function and other thermodynamic quantities of the ferromagnetic Ising model. Markov chain Monte Carlo methods for this problem have been…

Statistical Mechanics · Physics 2013-06-20 Amanda Streib , Noah Streib , Isabel Beichl , Francis Sullivan

Effectively compressing and optimizing tensor networks requires reliable methods for fixing the latent degrees of freedom of the tensors, known as the gauge. Here we introduce a new algorithm for gauging tensor networks using belief…

Quantum Physics · Physics 2025-03-03 Joseph Tindall , Matthew T. Fishman

This work describes a method of approximating matrix permanents efficiently using belief propagation. We formulate a probability distribution whose partition function is exactly the permanent, then use Bethe free energy to approximate this…

Machine Learning · Computer Science 2009-08-13 Bert Huang , Tony Jebara