English
Related papers

Related papers: Gaussian Belief Propagation: Theory and Aplication

200 papers

The canonical problem of solving a system of linear equations arises in numerous contexts in information theory, communication theory, and related fields. In this contribution, we develop a solution based upon Gaussian belief propagation…

Information Theory · Computer Science 2008-10-08 Ori Shental , Danny Bickson , Paul H. Siegel , Jack K. Wolf , Danny Dolev

The canonical problem of solving a system of linear equations arises in numerous contexts in information theory, communication theory, and related fields. In this contribution, we develop a solution based upon Gaussian belief propagation…

Information Theory · Computer Science 2009-04-16 Ori Shental , Paul H. Siegel , Jack K. Wolf , Danny Bickson , Danny Dolev

Gaussian belief propagation (GaBP) is an iterative message-passing algorithm for inference in Gaussian graphical models. It is known that when GaBP converges it converges to the correct MAP estimate of the Gaussian random vector and simple…

Information Theory · Computer Science 2010-03-23 Jason K. Johnson , Danny Bickson , Danny Dolev

This paper studies the convergence rate of a message-passing distributed algorithm for solving a large-scale linear system. This problem is generalised from the celebrated Gaussian Belief Propagation (BP) problem for statistical learning…

Systems and Control · Electrical Eng. & Systems 2020-04-15 Zhaorong Zhang , Qianqian Cai , Minyue Fu

Gaussian belief propagation (BP) has been widely used for distributed inference in large-scale networks such as the smart grid, sensor networks, and social networks, where local measurements/observations are scattered over a wide…

Machine Learning · Computer Science 2017-11-21 Jian Du , Shaodan Ma , Yik-Chung Wu , Soummya Kar , José M. F. Moura

We consider the problem of maximum likelihood estimation in linear models represented by factor graphs and solved via the Gaussian belief propagation algorithm. Motivated by massive internet of things (IoT) networks and edge computing, we…

Information Theory · Computer Science 2023-05-31 Mirsad Cosovic , Dragisa Miskovic , Muhamed Delalic , Darijo Raca , Dejan Vukobratovic

This paper considers inference over distributed linear Gaussian models using factor graphs and Gaussian belief propagation (BP). The distributed inference algorithm involves only local computation of the information matrix and of the mean…

Machine Learning · Statistics 2018-01-01 Jian Du , Shaodan Ma , Yik-Chung Wu , Soummya Kar , José M. F. Moura

Gaussian belief propagation (BP) has been widely used for distributed estimation in large-scale networks such as the smart grid, communication networks, and social networks, where local measurements/observations are scattered over a wide…

Machine Learning · Computer Science 2017-04-14 Jian Du , Shaodan Ma , Yik-Chung Wu , Soummya Kar , José M. F. Moura

Interior-point methods are state-of-the-art algorithms for solving linear programming (LP) problems with polynomial complexity. Specifically, the Karmarkar algorithm typically solves LP problems in time O(n^{3.5}), where $n$ is the number…

Information Theory · Computer Science 2009-04-16 Danny Bickson , Yoav Tock , Ori Shental , Danny Dolev

Gaussian belief propagation (GaBP) is an iterative algorithm for computing the mean of a multivariate Gaussian distribution, or equivalently, the minimum of a multivariate positive definite quadratic function. Sufficient conditions, such as…

Information Theory · Computer Science 2014-01-07 Nicholas Ruozzi , Sekhar Tatikonda

Gaussian belief propagation (BP) is a computationally efficient method to approximate the marginal distribution and has been widely used for inference with high dimensional data as well as distributed estimation in large-scale networks.…

Information Theory · Computer Science 2017-11-29 Jian Du , Soummya Kar , José M. F. Moura

Efficient inference in high-dimensional models is a central challenge in machine learning. We introduce the Gaussian Ensemble Belief Propagation (GEnBP) algorithm, which combines the strengths of the Ensemble Kalman Filter (EnKF) and…

Machine Learning · Computer Science 2025-02-12 Dan MacKinlay , Russell Tsuchida , Dan Pagendam , Petra Kuhnert

In this paper, we argue for the utility of deterministic inference in the classical problem of numerical linear algebra, that of solving a linear system. We show how the Gaussian belief propagation solver, known to work for symmetric…

Numerical Analysis · Mathematics 2020-02-26 Vladimir Fanaskov

Recent result shows how to compute distributively and efficiently the linear MMSE for the multiuser detection problem, using the Gaussian BP algorithm. In the current work, we extend this construction, and show that operating this algorithm…

Information Theory · Computer Science 2009-04-16 Danny Bickson , Ori Shental , Danny Dolev

Gaussian belief propagation (GBP) is a recursive computation method that is widely used in inference for computing marginal distributions efficiently. Depending on how the factorization of the underlying joint Gaussian distribution is…

Information Theory · Computer Science 2018-01-22 Jian Du , Shaodan Ma , Yik-Chung Wu , Soummya Kar , José M. F. Moura

We present a novel distributed Gauss-Newton method for the non-linear state estimation (SE) model based on a probabilistic inference method called belief propagation (BP). The main novelty of our work comes from applying BP sequentially…

Information Theory · Computer Science 2018-08-28 Mirsad Cosovic , Dejan Vukobratovic

Graphical models use the intuitive and well-studied methods of graph theory to implicitly represent dependencies between variables in large systems. They can model the global behaviour of a complex system by specifying only local factors.…

Artificial Intelligence · Computer Science 2015-08-21 Siamak Ravanbakhsh

Belief Propagation (BP) is a powerful algorithm for distributed inference in probabilistic graphical models, however it quickly becomes infeasible for practical compute and memory budgets. Many efficient, non-parametric forms of BP have…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-30 Tom Yates , Yuzhou Cheng , Ignacio Alzugaray , Danyal Akarca , Pedro A. M. Mediano , Andrew J. Davison

Gaussian belief propagation (GaBP) is a technique that relies on linearized error and input-output models to yield low-complexity solutions to complex estimation problems, which has been recently shown to be effective in the design of…

Signal Processing · Electrical Eng. & Systems 2026-02-05 Niclas Führling , Hyeon Seok Rou , Giuseppe Abreu , David González G. , Osvaldo Gonsa

Message-passing algorithms based on the Belief Propagation (BP) equations constitute a well-known distributed computational scheme. It is exact on tree-like graphical models and has also proven to be effective in many problems defined on…

Machine Learning · Computer Science 2022-07-20 Carlo Lucibello , Fabrizio Pittorino , Gabriele Perugini , Riccardo Zecchina
‹ Prev 1 2 3 10 Next ›