English
Related papers

Related papers: Primal View on Belief Propagation

200 papers

A scheme to provide various mean-field-type approximation algorithms is presented by employing the Bethe free energy formalism to a family of replicated systems in conjunction with analytical continuation with respect to the number of…

Disordered Systems and Neural Networks · Physics 2009-11-11 Yoshiyuki Kabashima

We present a novel distributed Gauss-Newton method for the non-linear state estimation (SE) model based on a probabilistic inference method called belief propagation (BP). The main novelty of our work comes from applying BP sequentially…

Information Theory · Computer Science 2018-08-28 Mirsad Cosovic , Dejan Vukobratovic

The Bethe approximation is a successful method for approximating partition functions of probabilistic models associated with a graph. Recently, Chertkov and Chernyak derived an interesting formula called Loop Series Expansion, which is an…

Mathematical Physics · Physics 2008-12-25 Yusuke Watanabe , Kenji Fukumizu

Gaussian belief propagation (BP) is a computationally efficient method to approximate the marginal distribution and has been widely used for inference with high dimensional data as well as distributed estimation in large-scale networks.…

Information Theory · Computer Science 2017-11-29 Jian Du , Soummya Kar , José M. F. Moura

Compared to the linear MIMO detectors, the Belief Propagation (BP) detector has shown greater capabilities in achieving near optimal performance and better nature to iteratively cooperate with channel decoders. Aiming at real applications,…

Information Theory · Computer Science 2022-06-28 Wenyue Zhou , Yifei Shen , Liping Li , Yongming Huang , Chuan Zhang , Xiaohu You

In the study of Ising models on large locally tree-like graphs, in both rigorous and non-rigorous methods one is often led to understanding the so-called belief propagation distributional recursions and its fixed points. We prove that there…

Information Theory · Computer Science 2023-08-01 Qian Yu , Yury Polyanskiy

Considering a discrete and finite statistical model of a general position we introduce an exact expression for the partition function in terms of a finite series. The leading term in the series is the Bethe-Peierls (Belief Propagation)-BP…

Statistical Mechanics · Physics 2009-11-11 Michael Chertkov , Vladimir Y. Chernyak

This paper focuses on the distributed static estimation problem and a Belief Propagation (BP) based estimation algorithm is proposed. We provide a complete analysis for convergence and accuracy of it. More precisely, we offer conditions…

Systems and Control · Electrical Eng. & Systems 2020-04-07 Damián Marelli , Tianju Sui , Minyue Fu , Ximing Sun

Many inference problems in structured prediction are naturally solved by augmenting a tractable dependency structure with complex, non-local auxiliary objectives. This includes the mean field family of variational inference algorithms,…

Machine Learning · Statistics 2016-11-29 Luke Vilnis , David Belanger , Daniel Sheldon , Andrew McCallum

Approximating marginals of a graphical model is one of the fundamental problems in the theory of networks. In a recent paper a method was shown to construct a variational free energy such that the linear response estimates, and maximum…

Disordered Systems and Neural Networks · Physics 2014-05-01 Jack Raymond , Federico Ricci-Tersenghi

Belief updating in Bayes nets, a well known computationally hard problem, has recently been approximated by several deterministic algorithms, and by various randomized approximation algorithms. Deterministic algorithms usually provide…

Artificial Intelligence · Computer Science 2013-02-18 Eugene Santos , Solomon Eyal Shimony , Edward Williams

This work proves a new result on the correct convergence of Min-Sum Loopy Belief Propagation (LBP) in an interpolation problem on a square grid graph. The focus is on the notion of local solutions, a numerical quantity attached to each site…

Other Computer Science · Computer Science 2017-02-22 Yutong Wang , Matthew G. Reyes , David L. Neuhoff

Belief Propagation algorithms are instruments used broadly to solve graphical model optimization and statistical inference problems. In the general case of a loopy Graphical Model, Belief Propagation is a heuristic which is quite successful…

Machine Learning · Statistics 2021-09-15 Andrii Riazanov , Yury Maximov , Michael Chertkov

We propose a principled framework for nonparametric empirical Bayes (EB) estimation, based on the idea that the prior should be consistent with the observed posterior and that Bayesian updating should be stable. Focusing on discretized…

Methodology · Statistics 2025-07-14 Valentino Dardanoni , Stefano Demichelis

We address the problem of uncertainty propagation in the discrete Fourier transform by modeling the fast Fourier transform as a factor graph. Building on this representation, we propose an efficient framework for approximate Bayesian…

Machine Learning · Computer Science 2025-06-09 Luca Schmid , Charlotte Muth , Laurent Schmalen

We derive novel conditions that guarantee convergence of the Sum-Product algorithm (also known as Loopy Belief Propagation or simply Belief Propagation) to a unique fixed point, irrespective of the initial messages. The computational…

Information Theory · Computer Science 2007-12-18 Joris M. Mooij , Hilbert J. Kappen

Data association, the reasoning over correspondence between targets and measurements, is a problem of fundamental importance in target tracking. Recently, belief propagation (BP) has emerged as a promising method for estimating the marginal…

Artificial Intelligence · Computer Science 2018-01-25 Jason L. Williams , Roslyn A. Lau

The generalized belief propagation (GBP), introduced by Yedidia et al., is an extension of the belief propagation (BP) algorithm, which is widely used in different problems involved in calculating exact or approximate marginals of…

Machine Learning · Computer Science 2016-05-09 Farzin Haddadpour , Mahdi Jafari Siavoshani , Morteza Noshad

A major benefit of graphical models is that most knowledge is captured in the model structure. Many models, however, produce inference problems with a lot of symmetries not reflected in the graphical structure and hence not exploitable by…

Artificial Intelligence · Computer Science 2012-05-14 Kristian Kersting , Babak Ahmadi , Sriraam Natarajan

We prove that the classic logarithmic barrier problem is equivalent to a particular logarithmic barrier positive relaxation problem with barrier and scaling parameters. Based on the equivalence, a line-search primal-dual interior-point…

Optimization and Control · Mathematics 2018-07-10 Xin-Wei Liu , Yu-Hong Dai