English
Related papers

Related papers: Approximate inference on planar graphs using Loop …

200 papers

Approximate linear programming (ALP) is an efficient approach to solving large factored Markov decision processes (MDPs). The main idea of the method is to approximate the optimal value function by a set of basis functions and optimize…

Artificial Intelligence · Computer Science 2012-06-18 Branislav Kveton , Milos Hauskrecht

Belief Propagation algorithms acting on Graphical Models of classical probability distributions, such as Markov Networks, Factor Graphs and Bayesian Networks, are amongst the most powerful known methods for deriving probabilistic inferences…

Quantum Physics · Physics 2009-11-13 Matthew Leifer , David Poulin

Graphical models use graphs to compactly capture stochastic dependencies amongst a collection of random variables. Inference over graphical models corresponds to finding marginal probability distributions given joint probability…

Machine Learning · Statistics 2013-04-02 Divyanshu Vats , José M. F. Moura

Belief propagation is a well-studied algorithm for approximating local marginals of multivariate probability distribution over complex networks, while tensor network states are powerful tools for quantum and classical many-body problems.…

Quantum Physics · Physics 2023-09-08 Chu Guo , Dario Poletti , Itai Arad

In this paper, we introduce a method for approximating the solution to inference and optimization tasks in uncertain and deterministic reasoning. Such tasks are in general intractable for exact algorithms because of the large number of…

Artificial Intelligence · Computer Science 2012-12-12 David Ephraim Larkin

We present an exact Bayesian inference method for inferring posterior distributions encoded by probabilistic programs featuring possibly unbounded loops. Our method is built on a denotational semantics represented by probability generating…

Programming Languages · Computer Science 2024-03-06 Lutz Klinkenberg , Christian Blumenthal , Mingshuai Chen , Darion Haase , Joost-Pieter Katoen

Computing the partition function, $Z$, of an Ising model over a graph of $N$ \enquote{spins} is most likely exponential in $N$. Efficient variational methods, such as Belief Propagation (BP) and Tree Re-Weighted (TRW) algorithms, compute…

Machine Learning · Computer Science 2024-11-14 Hamidreza Behjoo , Michael Chertkov

Traditional learning methods for training Markov random fields require doing inference over all variables to compute the likelihood gradient. The iteration complexity for those methods therefore scales with the size of the graphical models.…

Machine Learning · Computer Science 2018-11-12 You Lu , Zhiyuan Liu , Bert Huang

The Bethe approximation is a well-known approximation of the partition function used in statistical physics. Recently, an equality relating the partition function and its Bethe approximation was obtained for graphical models with binary…

Information Theory · Computer Science 2014-12-22 Ryuhei Mori

This paper focuses on the equivalent expression of fractional integrals/derivatives with an infinite series. A universal framework for fractional Taylor series is developed by expanding an analytic function at the initial instant or the…

General Mathematics · Mathematics 2022-12-07 Yiheng Wei , YangQuan Chen , Qing Gao , Yong Wang

In this paper, we investigate distributed inference schemes, over binary-valued Markov random fields, which are realized by the belief propagation (BP) algorithm. We first show that a decision variable obtained by the BP algorithm in a…

Information Theory · Computer Science 2019-09-19 Younes Abdi , Tapani Ristaniemi

Probabilistic graphical models offer a powerful framework to account for the dependence structure between variables, which is represented as a graph. However, the dependence between variables may render inference tasks intractable. In this…

In this paper we introduce a new approach for approximately counting in bounded degree systems with higher-order constraints. Our main result is an algorithm to approximately count the number of solutions to a CNF formula $\Phi$ when the…

Data Structures and Algorithms · Computer Science 2017-03-17 Ankur Moitra

The approximate uniform sampling of graphs with a given degree sequence is a well-known, extensively studied problem in theoretical computer science and has significant applications, e.g., in the analysis of social networks. In this work we…

Discrete Mathematics · Computer Science 2023-01-05 Georgios Amanatidis , Pieter Kleer

Variational inference algorithms such as belief propagation have had tremendous impact on our ability to learn and use graphical models, and give many insights for developing or understanding exact and approximate inference. However,…

Artificial Intelligence · Computer Science 2012-10-19 Qiang Liu , Alexander T. Ihler

Message-passing algorithms based on belief-propagation (BP) are successfully used in many applications including decoding error correcting codes and solving constraint satisfaction and inference problems. BP-based algorithms operate over…

Information Theory · Computer Science 2013-07-16 Guy Even , Nissim Halabi

We give polynomial-time algorithms for the exact computation of lowest-energy (ground) states, worst margin violators, log partition functions, and marginal edge probabilities in certain binary undirected graphical models. Our approach…

Machine Learning · Computer Science 2009-09-29 Nicol N. Schraudolph , Dmitry Kamenetsky

In this paper we present a synthesis of the work performed on two inference algorithms: the Pearl's belief propagation (BP) algorithm applied to Bayesian networks without loops (i.e. polytree) and the Loopy belief propagation (LBP)…

Artificial Intelligence · Computer Science 2012-06-06 Amen Ajroud , Mohamed Nazih Omri , Habib Youssef , Salem Benferhat

Belief propagation (BP) is a message-passing method for solving probabilistic graphical models. It is very successful in treating disordered models (such as spin glasses) on random graphs. On the other hand, finite-dimensional lattice…

Statistical Mechanics · Physics 2016-02-17 Hai-Jun Zhou , Wei-Mou Zheng

Belief propagation is a widely used message passing method for the solution of probabilistic models on networks such as epidemic models, spin models, and Bayesian graphical models, but it suffers from the serious shortcoming that it works…

Statistical Mechanics · Physics 2021-04-27 Alec Kirkley , George T. Cantwell , M. E. J. Newman