English
Related papers

Related papers: Circular Belief Propagation for Approximate Probab…

200 papers

We consider a class of spreading processes on networks, which generalize commonly used epidemic models such as the SIR model or the SIS model with a bounded number of re-infections. We analyse the related problem of inference of the…

Disordered Systems and Neural Networks · Physics 2024-07-22 D. Ghio , A. L. M. Aragon , I. Biazzo , L. Zdeborova

In this paper, we provide a distributed frequency offset estimation algorithm based on a variant of belief propagation (BP). Each agent in the network pre-compensates its carrier frequency individually so that there is no frequency offset…

Information Theory · Computer Science 2018-02-13 Jian Du , Shaodan Ma

Belief propagation is a powerful tool in statistical physics, machine learning, and modern coding theory. As a decoding method, it is ubiquitous in classical error correction and has also been applied to stabilizer-based quantum error…

Quantum Physics · Physics 2017-07-31 Joseph M. Renes

In this paper we derive the equations for Loop Corrected Belief Propagation on a continuous variable Gaussian model. Using the exactness of the averages for belief propagation for Gaussian models, a different way of obtaining the…

Artificial Intelligence · Computer Science 2007-06-01 Bastian Wemmenhove , Bert Kappen

In various scenarios motivated by real life, such as medical data analysis, autonomous driving, and adversarial training, we are interested in robust deep networks. A network is robust when a relatively small perturbation of the input…

Machine Learning · Computer Science 2024-10-07 Patryk Krukowski , Daniel Wilczak , Jacek Tabor , Anna Bielawska , Przemysław Spurek

Traditional learning methods for training Markov random fields require doing inference over all variables to compute the likelihood gradient. The iteration complexity for those methods therefore scales with the size of the graphical models.…

Machine Learning · Computer Science 2018-11-12 You Lu , Zhiyuan Liu , Bert Huang

This paper presents an enhanced belief propagation (BP) decoding algorithm and a reinforcement learning-based BP decoding algorithm for polar codes. The enhanced BP algorithm weighs each Processing Element (PE) input based on their signals…

Information Theory · Computer Science 2021-11-02 L. M. Oliveira , R. M. Oliveira , R. C. de Lamare

In this work, we tackle the problem of hidden community detection. We consider Belief Propagation (BP) applied to the problem of detecting a hidden Erd\H{o}s-R\'enyi (ER) graph embedded in a larger and sparser ER graph, in the presence of…

Machine Learning · Computer Science 2017-03-07 Arun Kadavankandy , Konstantin Avrachenkov , Laura Cottatellucci , Rajesh Sundaresan

We introduce the lifted Generalized Belief Propagation (GBP) message passing algorithm, for the computation of sum-product queries in Probabilistic Relational Models (e.g. Markov logic network). The algorithm forms a compact region graph…

Artificial Intelligence · Computer Science 2016-10-06 Udi Apsel

As belief networks are used to model increasingly complex situations, the need to automatically construct them from large databases will become paramount. This paper concentrates on solving a part of the belief network induction problem:…

Artificial Intelligence · Computer Science 2013-03-08 Ron Musick

We propose an approach to do learning in Gaussian factor graphs. We treat all relevant quantities (inputs, outputs, parameters, latents) as random variables in a graphical model, and view both training and prediction as inference problems…

Machine Learning · Computer Science 2024-07-18 Seth Nabarro , Mark van der Wilk , Andrew J Davison

This paper presents a new deterministic approximation technique in Bayesian networks. This method, "Expectation Propagation", unifies two previous techniques: assumed-density filtering, an extension of the Kalman filter, and loopy belief…

Artificial Intelligence · Computer Science 2013-01-14 Thomas P. Minka

Expectation Propagation (EP) is a widely used message-passing algorithm that decomposes a global inference problem into multiple local ones. It approximates marginal distributions (beliefs) using intermediate functions (messages). While…

Information Theory · Computer Science 2026-01-30 Zilu Zhao , Fangqing Xiao , Dirk Slock

Target Propagation (TP) algorithms compute targets instead of gradients along neural networks and propagate them backward in a way that is similar yet different than gradient back-propagation (BP). The idea was first presented as a…

Machine Learning · Computer Science 2021-12-03 Vincent Roulet , Zaid Harchaoui

We study the Maximum Weight Matching (MWM) problem for general graphs through the max-product Belief Propagation (BP) and related Linear Programming (LP). The BP approach provides distributed heuristics for finding the Maximum A Posteriori…

Data Structures and Algorithms · Computer Science 2018-01-03 Sungsoo Ahn , Michael Chertkov , Andrew E. Gelfand , Sejun Park , Jinwoo Shin

Scene graph generation aims to interpret an input image by explicitly modelling the potential objects and their relationships, which is predominantly solved by the message passing neural network models in previous methods. Currently, such…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Daqi Liu , Miroslaw Bober , Josef Kittler

It is known that fixed points of loopy belief propagation (BP) correspond to stationary points of the Bethe variational problem, where we minimize the Bethe free energy subject to normalization and marginalization constraints.…

Machine Learning · Computer Science 2012-03-19 Tomas Werner

Recently, researchers have demonstrated that loopy belief propagation - the use of Pearls polytree algorithm IN a Bayesian network WITH loops OF error- correcting codes.The most dramatic instance OF this IS the near Shannon - limit…

Artificial Intelligence · Computer Science 2013-01-30 Kevin Murphy , Yair Weiss , Michael I. Jordan

Factor graphs are important models for succinctly representing probability distributions in machine learning, coding theory, and statistical physics. Several computational problems, such as computing marginals and partition functions, arise…

Machine Learning · Computer Science 2017-08-09 Damian Straszak , Nisheeth K. Vishnoi

A Bayesian Belief Network (BN) is a model of a joint distribution over a setof n variables, with a DAG structure to represent the immediate dependenciesbetween the variables, and a set of parameters (aka CPTables) to represent thelocal…

Artificial Intelligence · Computer Science 2013-01-14 Tim Van Allen , Russell Greiner , Peter Hooper