中文
相关论文

相关论文: Fixing Convergence of Gaussian Belief Propagation

200 篇论文

Belief propagation is known to perform extremely well in many practical statistical inference and learning problems using graphical models, even in the presence of multiple loops. The iterative use of belief propagation algorithm on loopy…

信息论 · 计算机科学 2013-02-13 Xiangqiong Shi , Dan Schonfeld , Daniela Tuninetti

Efficient inference in high-dimensional models is a central challenge in machine learning. We introduce the Gaussian Ensemble Belief Propagation (GEnBP) algorithm, which combines the strengths of the Ensemble Kalman Filter (EnKF) and…

机器学习 · 计算机科学 2025-02-12 Dan MacKinlay , Russell Tsuchida , Dan Pagendam , Petra Kuhnert

In this paper we derive the equations for Loop Corrected Belief Propagation on a continuous variable Gaussian model. Using the exactness of the averages for belief propagation for Gaussian models, a different way of obtaining the…

人工智能 · 计算机科学 2007-06-01 Bastian Wemmenhove , Bert Kappen

We present a new view of Gaussian belief propagation (GaBP) based on a representation of the determinant as a product over orbits of a graph. We show that the GaBP determinant estimate captures totally backtracking orbits of the graph and…

统计理论 · 数学 2009-05-06 Jason K. Johnson , Vladimir Y. Chernyak , Michael Chertkov

We consider the general problem of finding the minimum weight $\bm$-matching on arbitrary graphs. We prove that, whenever the linear programming (LP) relaxation of the problem has no fractional solutions, then the belief propagation (BP)…

信息论 · 计算机科学 2015-03-13 Mohsen Bayati , Christian Borgs , Jennifer Chayes , Riccardo Zecchina

While loopy belief propagation (LBP) performs reasonably well for inference in some Gaussian graphical models with cycles, its performance is unsatisfactory for many others. In particular for some models LBP does not converge, and in…

机器学习 · 统计学 2015-05-28 Ying Liu , Venkat Chandrasekaran , Animashree Anandkumar , Alan S. Willsky

Belief propagation (BP) can do exact inference in loop-free graphs, but its performance could be poor in graphs with loops, and the understanding of its solution is limited. This work gives an interpretable belief propagation rule that is…

机器学习 · 计算机科学 2019-08-26 Dong Liu , Nima N. Moghadam , Lars K. Rasmussen , Jinliang Huang , Saikat Chatterjee

We address the question of convergence in the loopy belief propagation (LBP) algorithm. Specifically, we relate convergence of LBP to the existence of a weak limit for a sequence of Gibbs measures defined on the LBP s associated computation…

人工智能 · 计算机科学 2013-01-07 Sekhar Tatikonda , Michael I. Jordan

Belief Propagation (BP) is an important message-passing algorithm for various reasoning tasks over graphical models, including solving the Constraint Optimization Problems (COPs). It has been shown that BP can achieve state-of-the-art…

人工智能 · 计算机科学 2022-09-27 Yanchen Deng , Shufeng Kong , Caihua Liu , Bo An

We consider the estimation of an i.i.d.\ random vector observed through a linear transform followed by a componentwise, probabilistic (possibly nonlinear) measurement channel. A novel algorithm, called generalized approximate message…

信息论 · 计算机科学 2012-08-15 Sundeep Rangan

Belief Propagation (BP) is one of the most popular methods for inference in probabilistic graphical models. BP is guaranteed to return the correct answer for tree structures, but can be incorrect or non-convergent for loopy graphical…

人工智能 · 计算机科学 2012-06-22 Siamak Ravanbakhsh , Chun-Nam Yu , Russell Greiner

Belief Propagation (BP) is a popular, distributed heuristic for performing MAP computations in Graphical Models. BP can be interpreted, from a variational perspective, as minimizing the Bethe Free Energy (BFE). BP can also be used to solve…

人工智能 · 计算机科学 2013-05-20 Andrew Gelfand , Jinwoo Shin , Michael Chertkov

Belief propagation (BP) is a popular method for performing probabilistic inference on graphical models. In this work, we enhance BP and propose self-guided belief propagation (SBP) that incorporates the pairwise potentials only gradually.…

机器学习 · 统计学 2024-10-30 Christian Knoll , Adrian Weller , Franz Pernkopf

In this work, we present a novel construction for solving the linear multiuser detection problem using the Gaussian Belief Propagation algorithm. Our algorithm yields an efficient, iterative and distributed implementation of the MMSE…

信息论 · 计算机科学 2009-04-16 Danny Bickson , Danny Dolev , Ori Shental , Paul H. Siegel , Jack K. Wolf

Tensor network contraction on arbitrary graphs is a fundamental computational challenge with applications ranging from quantum simulation to error correction. While belief propagation (BP) provides a powerful approximation algorithm for…

量子物理 · 物理学 2025-10-28 Siddhant Midha , Yifan F. Zhang

The belief propagation (BP) algorithm is widely applied to perform approximate inference on arbitrary graphical models, in part due to its excellent empirical properties and performance. However, little is known theoretically about when…

人工智能 · 计算机科学 2012-06-26 Alexander T. Ihler

Belief Propagation (BP) is a simple probabilistic inference algorithm, consisting of passing messages between nodes of a graph representing a probability distribution. Its analogy with a neural network suggests that it could have…

人工智能 · 计算机科学 2024-03-20 Vincent Bouttier , Renaud Jardri , Sophie Deneve

Loopy Belief Propagation (LBP) is a widely used approximate inference algorithm in probabilistic graphical models, with applications in computer vision, error correction codes, protein folding, program analysis, etc. However, LBP faces…

软件工程 · 计算机科学 2025-09-29 Haoyu Feng , Xin Zhang

This paper considers a discrete-valued signal estimation scheme based on a low-complexity Bayesian optimal message passing algorithm (MPA) for solving massive linear inverse problems under highly correlated measurements. Gaussian belief…

信号处理 · 电气工程与系统科学 2024-11-14 Tomoharu Furudoi , Takumi Takahashi , Shinsuke Ibi , Hideki Ochiai

Max-product Belief Propagation (BP) is a popular message-passing algorithm for computing a Maximum-A-Posteriori (MAP) assignment over a distribution represented by a Graphical Model (GM). It has been shown that BP can solve a number of…

数据结构与算法 · 计算机科学 2015-09-24 Sungsoo Ahn , Sejun Park , Michael Chertkov , Jinwoo Shin