English
Related papers

Related papers: Distributed Gauss-Newton Method for State Estimati…

200 papers

Message-passing algorithms based on the Belief Propagation (BP) equations constitute a well-known distributed computational scheme. It is exact on tree-like graphical models and has also proven to be effective in many problems defined on…

Machine Learning · Computer Science 2022-07-20 Carlo Lucibello , Fabrizio Pittorino , Gabriele Perugini , Riccardo Zecchina

This paper considers the problem of tracking a large-scale number of group targets. Usually, multi-target in most tracking scenarios are assumed to have independent motion and are well-separated. However, for group target tracking (GTT),…

Machine Learning · Computer Science 2022-08-26 Xuqi Zhang , Fanqin Meng , Haiqi Liu , Xiaojing Shen , Yunmin Zhu

Gaussian belief propagation (GaBP) is an iterative message-passing algorithm for inference in Gaussian graphical models. It is known that when GaBP converges it converges to the correct MAP estimate of the Gaussian random vector and simple…

Information Theory · Computer Science 2010-03-23 Jason K. Johnson , Danny Bickson , Danny Dolev

The distribution system state estimation problem seeks to determine the network state from available measurements. Widely used Gauss-Newton approaches are very sensitive to the initialization and often not suitable for real-time estimation.…

Optimization and Control · Mathematics 2019-07-16 Ahmed S. Zamzam , Nicholas D. Sidiropoulos

Efficient inference in high-dimensional models is a central challenge in machine learning. We introduce the Gaussian Ensemble Belief Propagation (GEnBP) algorithm, which combines the strengths of the Ensemble Kalman Filter (EnKF) and…

Machine Learning · Computer Science 2025-02-12 Dan MacKinlay , Russell Tsuchida , Dan Pagendam , Petra Kuhnert

In this paper, we provide a distributed frequency offset estimation algorithm based on a variant of belief propagation (BP). Each agent in the network pre-compensates its carrier frequency individually so that there is no frequency offset…

Information Theory · Computer Science 2018-02-13 Jian Du , Shaodan Ma

Gaussian belief propagation (GaBP) is an iterative algorithm for computing the mean of a multivariate Gaussian distribution, or equivalently, the minimum of a multivariate positive definite quadratic function. Sufficient conditions, such as…

Information Theory · Computer Science 2014-01-07 Nicholas Ruozzi , Sekhar Tatikonda

We define and study an inference algorithm based on "belief propagation" (BP) and the Bethe approximation. The idea is to encode into a graph an a priori information composed of correlations or marginal probabilities of variables, and to…

Physics and Society · Physics 2007-05-23 Cyril Furtlehner , Jean-Marc Lasgouttes , Arnaud De La Fortelle

Gaussian belief propagation (GBP) is a recursive computation method that is widely used in inference for computing marginal distributions efficiently. Depending on how the factorization of the underlying joint Gaussian distribution is…

Information Theory · Computer Science 2018-01-22 Jian Du , Shaodan Ma , Yik-Chung Wu , Soummya Kar , José M. F. Moura

We consider belief propagation (BP) as an efficient and scalable tool for state estimation and optimization problems in supply networks such as power grids. BP algorithms make use of factor graph representations, whose assignment to the…

Artificial Intelligence · Computer Science 2022-06-09 Tim Ritmeester , Hildegard Meyer-Ortmanns

In this note we study an iterative belief propagation (IBP) algorithm and demonstrate it's ability to solve sparse combinatorial optimization problems. Similar to simulated annealing (SA), our IBP algorithm attempts to sample from the…

Optimization and Control · Mathematics 2024-11-04 Sam Reifenstein , Timothée Leleu

Support vector machines (SVMs) are an extremely successful type of classification and regression algorithms. Building an SVM entails solving a constrained convex quadratic programming problem, which is quadratic in the number of training…

Machine Learning · Computer Science 2008-11-15 Danny Bickson , Elad Yom-Tov , Danny Dolev

Interior-point methods are state-of-the-art algorithms for solving linear programming (LP) problems with polynomial complexity. Specifically, the Karmarkar algorithm typically solves LP problems in time O(n^{3.5}), where $n$ is the number…

Information Theory · Computer Science 2009-04-16 Danny Bickson , Yoav Tock , Ori Shental , Danny Dolev

We present a differentiable approach to learn the probabilistic factors used for inference by a nonparametric belief propagation algorithm. Existing nonparametric belief propagation methods rely on domain-specific features encoded in the…

This paper studies the convergence rate of a message-passing distributed algorithm for solving a large-scale linear system. This problem is generalised from the celebrated Gaussian Belief Propagation (BP) problem for statistical learning…

Systems and Control · Electrical Eng. & Systems 2020-04-15 Zhaorong Zhang , Qianqian Cai , Minyue Fu

We present a differentiable approach to learn the probabilistic factors used for inference by a nonparametric belief propagation algorithm. Existing nonparametric belief propagation methods rely on domain-specific features encoded in the…

In this paper, we introduce a new support recovery algorithm from noisy measurements called Bayesian hypothesis test via belief propagation (BHT-BP). BHT-BP focuses on sparse support recovery rather than sparse signal estimation. The key…

Information Theory · Computer Science 2013-02-27 Jaewook Kang , Heung-No Lee , Kiseon Kim

The framework of statistical inference has been successfully used to detect the meso-scale structures in complex networks, such as community structure, core-periphery (CP) structure. The main principle is that the stochastic block model…

Physics and Society · Physics 2018-08-29 Chuang Ma , Bing-Bing Xiang , Han-Shuang Chen , Hai-Feng Zhang

The belief propagation (BP) algorithm is widely applied to perform approximate inference on arbitrary graphical models, in part due to its excellent empirical properties and performance. However, little is known theoretically about when…

Artificial Intelligence · Computer Science 2012-06-26 Alexander T. Ihler

Generalized belief propagation (GBP) has proven to be a promising technique for approximate inference tasks in AI and machine learning. However, the choice of a good set of clusters to be used in GBP has remained more of an art then a…

Artificial Intelligence · Computer Science 2012-07-19 Max Welling