English
Related papers

Related papers: Accuracy Bounds for Belief Propagation

200 papers

We consider the problem of approximating the reachability probabilities in Markov decision processes (MDP) with uncountable (continuous) state and action spaces. While there are algorithms that, for special classes of such MDP, provide a…

Systems and Control · Electrical Eng. & Systems 2022-07-13 Kush Grover , Jan Křetínský , Tobias Meggendorfer , Maximilian Weininger

It is well known that an arbitrary graphical model of statistical inference defined on a tree, i.e. on a graph without loops, is solved exactly and efficiently by an iterative Belief Propagation (BP) algorithm convergent to unique minimum…

Statistical Mechanics · Physics 2009-11-13 Michael Chertkov

We propose a hybrid message passing method for distributed cooperative localization and tracking of mobile agents. Belief propagation and mean field message passing are employed for, respectively, the motion-related and measurement-related…

Systems and Control · Computer Science 2016-05-25 Burak Çakmak , Daniel N. Urup , Florian Meyer , Troels Pedersen , Bernard H. Fleury , Franz Hlawatsch

A number of algorithms have been developed to solve probabilistic inference problems on belief networks. These algorithms can be divided into two main groups: exact techniques which exploit the conditional independence revealed when the…

Artificial Intelligence · Computer Science 2013-04-08 Ross D. Shachter , Mark Alan Peot

This study investigated typical performance of approximation algorithms known as belief propagation, greedy algorithm, and linear-programming relaxation for maximum coverage problems on sparse biregular random graphs. After using the cavity…

Disordered Systems and Neural Networks · Physics 2018-02-27 Satoshi Takabe , Takanori Maehara , Koji Hukushima

We introduce novel results for approximate inference on planar graphical models using the loop calculus framework. The loop calculus (Chertkov and Chernyak, 2006b) allows to express the exact partition function Z of a graphical model as a…

Artificial Intelligence · Computer Science 2014-08-12 Vicenc Gomez , Hilbert Kappen , Michael Chertkov

We consider a class of spreading processes on networks, which generalize commonly used epidemic models such as the SIR model or the SIS model with a bounded number of re-infections. We analyse the related problem of inference of the…

Disordered Systems and Neural Networks · Physics 2024-07-22 D. Ghio , A. L. M. Aragon , I. Biazzo , L. Zdeborova

Effectively compressing and optimizing tensor networks requires reliable methods for fixing the latent degrees of freedom of the tensors, known as the gauge. Here we introduce a new algorithm for gauging tensor networks using belief…

Quantum Physics · Physics 2025-03-03 Joseph Tindall , Matthew T. Fishman

Compared to the linear MIMO detectors, the Belief Propagation (BP) detector has shown greater capabilities in achieving near optimal performance and better nature to iteratively cooperate with channel decoders. Aiming at real applications,…

Information Theory · Computer Science 2022-06-28 Wenyue Zhou , Yifei Shen , Liping Li , Yongming Huang , Chuan Zhang , Xiaohu You

We derive two related novel bounds on single-variable marginal probability distributions in factor graphs with discrete variables. The first method propagates bounds over a subtree of the factor graph rooted in the variable, and the second…

Probability · Mathematics 2008-01-25 Joris M. Mooij , Hilbert J. Kappen

Independence-based (IB) assignments to Bayesian belief networks were originally proposed as abductive explanations. IB assignments assign fewer variables in abductive explanations than do schemes assigning values to all evidentially…

Artificial Intelligence · Computer Science 2013-02-28 Eugene Santos , Solomon Eyal Shimony

Loopy belief propagation (LBP), which is equivalent to the Bethe approximation in statistical mechanics, is a message-passing-type inference method that is widely used to analyze systems based on Markov random fields (MRFs). In this paper,…

Machine Learning · Statistics 2015-11-16 Muneki Yasuda , Shun Kataoka , Kazuyuki Tanaka

It is known that fixed points of loopy belief propagation (BP) correspond to stationary points of the Bethe variational problem, where we minimize the Bethe free energy subject to normalization and marginalization constraints.…

Machine Learning · Computer Science 2012-03-19 Tomas Werner

We propose consensus propagation, an asynchronous distributed protocol for averaging numbers across a network. We establish convergence, characterize the convergence rate for regular graphs, and demonstrate that the protocol exhibits better…

Information Theory · Computer Science 2007-07-13 Ciamac C. Moallemi , Benjamin Van Roy

The belief network is a well-known graphical structure for representing independences in a joint probability distribution. The methods, which perform probabilistic inference in belief networks, often treat the conditional probabilities…

Artificial Intelligence · Computer Science 2013-03-26 Richard E. Neapolitan , James Kenevan

We study two-layer belief networks of binary random variables in which the conditional probabilities Pr[childlparents] depend monotonically on weighted sums of the parents. In large networks where exact probabilistic inference is…

Machine Learning · Computer Science 2013-02-01 Michael Kearns , Lawrence Saul

Location-aware networks will introduce innovative services and applications for modern convenience, applied ocean sciences, and public safety. In this paper, we establish a hybrid method for model-based and data-driven inference. We…

Machine Learning · Computer Science 2021-05-28 Mingchao Liang , Florian Meyer

Recently, researchers have demonstrated that loopy belief propagation - the use of Pearls polytree algorithm IN a Bayesian network WITH loops OF error- correcting codes.The most dramatic instance OF this IS the near Shannon - limit…

Artificial Intelligence · Computer Science 2013-01-30 Kevin Murphy , Yair Weiss , Michael I. Jordan

In this paper, we present BERN-NN as an efficient tool to perform bound propagation of Neural Networks (NNs). Bound propagation is a critical step in wide range of NN model checkers and reachability analysis tools. Given a bounded input…

Machine Learning · Computer Science 2022-11-29 Wael Fatnassi , Haitham Khedr , Valen Yamamoto , Yasser Shoukry

A susceptibility propagation that is constructed by combining a belief propagation and a linear response method is used for approximate computation for Markov random fields. Herein, we formulate a new, improved susceptibility propagation by…

Statistical Mechanics · Physics 2017-12-04 Muneki Yasuda , Kazuyuki Tanaka