English
Related papers

Related papers: Belief Propagation for Linear Programming

200 papers

The sum-product or belief propagation (BP) algorithm is a widely used message-passing technique for computing approximate marginals in graphical models. We introduce a new technique, called stochastic orthogonal series message-passing…

Information Theory · Computer Science 2012-12-18 Nima Noorshams , Martin J. Wainwright

Due to the intractable nature of exact lifted inference, research has recently focused on the discovery of accurate and efficient approximate inference algorithms in Statistical Relational Models (SRMs), such as Lifted First-Order Belief…

Artificial Intelligence · Computer Science 2016-07-01 David Smith , Parag Singla , Vibhav Gogate

A common divide-and-conquer approach for Bayesian computation with big data is to partition the data, perform local inference for each piece separately, and combine the results to obtain a global posterior approximation. While being…

We present a novel distributed Gauss-Newton method for the non-linear state estimation (SE) model based on a probabilistic inference method called belief propagation (BP). The main novelty of our work comes from applying BP sequentially…

Information Theory · Computer Science 2018-08-28 Mirsad Cosovic , Dejan Vukobratovic

Typical behavior of the linear programming (LP) problem is studied as a relaxation of the minimum vertex cover, a type of integer programming (IP) problem. A lattice-gas model on the Erd\"os-R\'enyi random graphs of $\alpha$-uniform…

Disordered Systems and Neural Networks · Physics 2016-06-01 Satoshi Takabe , Koji Hukushima

We introduce the lifted Generalized Belief Propagation (GBP) message passing algorithm, for the computation of sum-product queries in Probabilistic Relational Models (e.g. Markov logic network). The algorithm forms a compact region graph…

Artificial Intelligence · Computer Science 2016-10-06 Udi Apsel

We present a distributed anytime algorithm for performing MAP inference in graphical models. The problem is formulated as a linear programming relaxation over the edges of a graph. The resulting program has a constraint structure that…

Artificial Intelligence · Computer Science 2012-02-20 Joop van de Ven , Fabio Ramos

Belief Propagation has been widely used for marginal inference, however it is slow on problems with large-domain variables and high-order factors. Previous work provides useful approximations to facilitate inference on such models, but…

Machine Learning · Statistics 2013-11-15 Sameer Singh , Sebastian Riedel , Andrew McCallum

This paper focuses on the distributed static estimation problem and a Belief Propagation (BP) based estimation algorithm is proposed. We provide a complete analysis for convergence and accuracy of it. More precisely, we offer conditions…

Systems and Control · Electrical Eng. & Systems 2020-04-07 Damián Marelli , Tianju Sui , Minyue Fu , Ximing Sun

It was recently shown that the problem of decoding messages transmitted through a noisy channel can be formulated as a belief updating task over a probabilistic network [McEliece]. Moreover, it was observed that iterative application of the…

Artificial Intelligence · Computer Science 2013-02-01 Irina Rish , Kalev Kask , Rina Dechter

In a complete bipartite graph with vertex sets of cardinalities $n$ and $m$, assign random weights from exponential distribution with mean 1, independently to each edge. We show that, as $n\rightarrow\infty$, with $m = \lceil…

Probability · Mathematics 2014-05-07 Mustafa Khandwawala

We design iterative receiver schemes for a generic wireless communication system by treating channel estimation and information decoding as an inference problem in graphical models. We introduce a recently proposed inference framework that…

Quantum stabilizer codes constructed from sparse matrices have good performance and can be efficiently decoded by belief propagation (BP). A conventional BP decoding algorithm treats binary stabilizer codes as additive codes over GF(4).…

Quantum Physics · Physics 2020-10-21 Kao-Yueh Kuo , Ching-Yi Lai

Simulating many-body quantum systems on a classical computer is difficult due to the large number of degrees of freedom, causing the computational complexity to grow exponentially with system size. Tensor Networks (TN) is a framework that…

Quantum Physics · Physics 2026-03-17 Nir Gutman

In this paper, we model an extended DC state estimation (SE) in an electric power system as a factor graph (FG) and solve it using belief propagation (BP) algorithm. The DC model comprises bus voltage angles as state variables, while the…

Information Theory · Computer Science 2016-11-15 Mirsad Cosovic , Dejan Vukobratovic

We apply Guo and Wang's relaxed belief propagation (BP) method to the estimation of a random vector from linear measurements followed by a componentwise probabilistic measurement channel. Relaxed BP uses a Gaussian approximation in standard…

Information Theory · Computer Science 2010-05-19 Sundeep Rangan

In Non - ergodic belief networks the posterior belief OF many queries given evidence may become zero.The paper shows that WHEN belief propagation IS applied iteratively OVER arbitrary networks(the so called, iterative OR loopy belief…

Artificial Intelligence · Computer Science 2012-12-12 Rina Dechter , Robert Mateescu

Maximum a posteriori (MAP) inference is a fundamental computational paradigm for statistical inference. In the setting of graphical models, MAP inference entails solving a combinatorial optimization problem to find the most likely…

Machine Learning · Computer Science 2020-03-03 Jonathan N. Lee , Aldo Pacchiano , Michael I. Jordan

We consider the problem of maximum likelihood estimation in linear models represented by factor graphs and solved via the Gaussian belief propagation algorithm. Motivated by massive internet of things (IoT) networks and edge computing, we…

Information Theory · Computer Science 2023-05-31 Mirsad Cosovic , Dragisa Miskovic , Muhamed Delalic , Darijo Raca , Dejan Vukobratovic

We consider the CDMA (code-division multiple-access) multi-user detection problem for binary signals and additive white gaussian noise. We propose a spreading sequences scheme based on random sparse signatures, and a detection algorithm…

Information Theory · Computer Science 2007-07-13 Andrea Montanari , David Tse