English
Related papers

Related papers: $\alpha$ Belief Propagation as Fully Factorized Ap…

200 papers

We apply belief propagation (BP) to multi--user detection in a spread spectrum system, under the assumption of Gaussian symbols. We prove that BP is both convergent and allows to estimate the correct conditional expectation of the input…

Information Theory · Computer Science 2007-07-13 Andrea Montanari , Balaji Prabhakar , David Tse

Belief propagation is an algorithm that is known from statistical physics and computer science. It provides an efficient way of calculating marginals that involve large sums of products which are efficiently rearranged into nested products…

Artificial Intelligence · Computer Science 2020-12-22 Tim Ritmeester , Hildegard Meyer-Ortmanns

Belief Propagation (BP) is an important message-passing algorithm for various reasoning tasks over graphical models, including solving the Constraint Optimization Problems (COPs). It has been shown that BP can achieve state-of-the-art…

Artificial Intelligence · Computer Science 2022-09-27 Yanchen Deng , Shufeng Kong , Caihua Liu , Bo An

Gaussian Belief Propagation (BP) algorithm is one of the most important distributed algorithms in signal processing and statistical learning involving Markov networks. It is well known that the algorithm correctly computes marginal density…

Machine Learning · Statistics 2019-03-08 Zhaorong Zhang , Minyue Fu

Variational inference algorithms such as belief propagation have had tremendous impact on our ability to learn and use graphical models, and give many insights for developing or understanding exact and approximate inference. However,…

Artificial Intelligence · Computer Science 2012-10-19 Qiang Liu , Alexander T. Ihler

We propose an approach to do learning in Gaussian factor graphs. We treat all relevant quantities (inputs, outputs, parameters, latents) as random variables in a graphical model, and view both training and prediction as inference problems…

Machine Learning · Computer Science 2024-07-18 Seth Nabarro , Mark van der Wilk , Andrew J Davison

In a complete bipartite graph with vertex sets of cardinalities $n$ and $m$, assign random weights from exponential distribution with mean 1, independently to each edge. We show that, as $n\rightarrow\infty$, with $m = \lceil…

Probability · Mathematics 2014-05-07 Mustafa Khandwawala

This work proves a new result on the correct convergence of Min-Sum Loopy Belief Propagation (LBP) in an interpolation problem on a square grid graph. The focus is on the notion of local solutions, a numerical quantity attached to each site…

Other Computer Science · Computer Science 2017-02-22 Yutong Wang , Matthew G. Reyes , David L. Neuhoff

Recently, researchers have demonstrated that loopy belief propagation - the use of Pearls polytree algorithm IN a Bayesian network WITH loops OF error- correcting codes.The most dramatic instance OF this IS the near Shannon - limit…

Artificial Intelligence · Computer Science 2013-01-30 Kevin Murphy , Yair Weiss , Michael I. Jordan

Belief propagation (BP) is an iterative method to perform approximate inference on arbitrary graphical models. Whether BP converges and if the solution is a unique fixed point depends on both the structure and the parametrization of the…

Machine Learning · Statistics 2017-05-31 Christian Knoll , Franz Pernkopf , Dhagash Mehta , Tianran Chen

Max-product Belief Propagation (BP) is a popular message-passing algorithm for computing a Maximum-A-Posteriori (MAP) assignment over a distribution represented by a Graphical Model (GM). It has been shown that BP can solve a number of…

Data Structures and Algorithms · Computer Science 2015-09-24 Sungsoo Ahn , Sejun Park , Michael Chertkov , Jinwoo Shin

We first present an empirical study of the Belief Propagation (BP) algorithm, when run on the random field Ising model defined on random regular graphs in the zero temperature limit. We introduce the notion of maximal solutions for the BP…

Disordered Systems and Neural Networks · Physics 2018-02-01 Gabriele Perugini , Federico Ricci-Tersenghi

Location-aware networks will introduce innovative services and applications for modern convenience, applied ocean sciences, and public safety. In this paper, we establish a hybrid method for model-based and data-driven inference. We…

Machine Learning · Computer Science 2021-05-28 Mingchao Liang , Florian Meyer

Attack graphs provide compact representations of the attack paths that an attacker can follow to compromise network resources by analysing network vulnerabilities and topology. These representations are a powerful tool for security risk…

Cryptography and Security · Computer Science 2016-06-23 Luis Muñoz-González , Daniele Sgandurra , Andrea Paudice , Emil C. Lupu

In the context of inference with expectation constraints, we propose an approach based on the "loopy belief propagation" algorithm LBP, as a surrogate to an exact Markov Random Field MRF modelling. A prior information composed of…

Machine Learning · Computer Science 2015-05-13 Cyril Furtlehner , Jean-Marc Lasgouttes , Anne Auger

While loopy belief propagation (LBP) performs reasonably well for inference in some Gaussian graphical models with cycles, its performance is unsatisfactory for many others. In particular for some models LBP does not converge, and in…

Machine Learning · Statistics 2015-05-28 Ying Liu , Venkat Chandrasekaran , Animashree Anandkumar , Alan S. Willsky

The sigma point (SP) filter, also known as unscented Kalman filter, is an attractive alternative to the extended Kalman filter and the particle filter. Here, we extend the SP filter to nonsequential Bayesian inference corresponding to loopy…

Artificial Intelligence · Computer Science 2023-07-19 Florian Meyer , Ondrej Hlinka , Franz Hlawatsch

We study the belief propagation algorithm for the graph bi-partitioning problem, i.e. the ground state of the ferromagnetic Ising model at a fixed magnetization. Application of a message passing scheme to a model with a fixed global…

Disordered Systems and Neural Networks · Physics 2010-06-16 P. Sulc , L. Zdeborova

It has been proposed by many researchers that combining deep neural networks with graphical models can create more efficient and better regularized composite models. The main difficulties in implementing this in practice are associated with…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Patrick Knöbelreiter , Christian Sormann , Alexander Shekhovtsov , Friedrich Fraundorfer , Thomas Pock

Gaussian belief propagation (BP) is a computationally efficient method to approximate the marginal distribution and has been widely used for inference with high dimensional data as well as distributed estimation in large-scale networks.…

Information Theory · Computer Science 2017-11-29 Jian Du , Soummya Kar , José M. F. Moura