English
Related papers

Related papers: Stochastic Loop Corrections to Belief Propagation …

200 papers

We present new message passing algorithms for performing inference with graphical models. Our methods are designed for the most difficult inference problems where loopy belief propagation and other heuristics fail to converge. Belief…

Artificial Intelligence · Computer Science 2022-07-19 Anna Grim , Pedro Felzenszwalb

The Bethe approximation, discovered in statistical physics, gives an efficient algorithm called belief propagation (BP) for approximating a partition function. BP empirically gives an accurate approximation for many problems, e.g.,…

Information Theory · Computer Science 2012-10-11 Ryuhei Mori , Toshiyuki Tanaka

The generalized belief propagation (GBP), introduced by Yedidia et al., is an extension of the belief propagation (BP) algorithm, which is widely used in different problems involved in calculating exact or approximate marginals of…

Machine Learning · Computer Science 2016-05-09 Farzin Haddadpour , Mahdi Jafari Siavoshani , Morteza Noshad

The $p$-tensor Ising model is a one-parameter discrete exponential family for modeling dependent binary data, where the sufficient statistic is a multi-linear form of degree $p \geq 2$. This is a natural generalization of the matrix Ising…

Statistics Theory · Mathematics 2020-09-01 Somabha Mukherjee , Jaesung Son , Bhaswar B. Bhattacharya

Computing marginal distributions of discrete or semidiscrete Markov random fields (MRFs) is a fundamental, generally intractable problem with a vast number of applications in virtually all fields of science. We present a new family of…

Statistical Mechanics · Physics 2019-07-24 Alfredo Braunstein , Giovanni Catania , Luca Dall'Asta

Belief propagation is an algorithm that is known from statistical physics and computer science. It provides an efficient way of calculating marginals that involve large sums of products which are efficiently rearranged into nested products…

Artificial Intelligence · Computer Science 2020-12-22 Tim Ritmeester , Hildegard Meyer-Ortmanns

We introduce a Metropolis-Hastings Markov chain for Boltzmann distributions of classical spin systems. It relies on approximate tensor network contractions to propose correlated collective updates at each step of the evolution. We present…

Probabilistic inference is a fundamental task in modern machine learning. Recent advances in tensor network (TN) contraction algorithms have enabled the development of better exact inference methods. However, many common inference tasks in…

Machine Learning · Computer Science 2024-09-10 Martin Roa-Villescas , Xuanzhao Gao , Sander Stuijk , Henk Corporaal , Jin-Guo Liu

Gaussian belief propagation (BP) has been widely used for distributed inference in large-scale networks such as the smart grid, sensor networks, and social networks, where local measurements/observations are scattered over a wide…

Machine Learning · Computer Science 2017-11-21 Jian Du , Shaodan Ma , Yik-Chung Wu , Soummya Kar , José M. F. Moura

An important part of problems in statistical physics and computer science can be expressed as the computation of marginal probabilities over a Markov Random Field. The belief propagation algorithm, which is an exact procedure to compute…

Machine Learning · Computer Science 2011-01-24 Victorin Martin , Jean-Marc Lasgouttes , Cyril Furtlehner

In this article, we present a visual introduction to Gaussian Belief Propagation (GBP), an approximate probabilistic inference algorithm that operates by passing messages between the nodes of arbitrarily structured factor graphs. A special…

Artificial Intelligence · Computer Science 2021-07-07 Joseph Ortiz , Talfan Evans , Andrew J. Davison

For the minimum cardinality vertex cover and maximum cardinality matching problems, the max-product form of belief propagation (BP) is known to perform poorly on general graphs. In this paper, we present an iterative loopy annealing BP…

Discrete Mathematics · Computer Science 2014-07-09 Marc Lelarge

Sampling problems are promising candidates for demonstrating quantum advantage, and one approach known as quantum-enhanced Markov chain Monte Carlo [Layden, D. et al., Nature 619, 282-287 (2023)] uses quantum samples as a proposal…

Quantum Physics · Physics 2026-04-23 Yuya Kawamata , Yuichiro Nakano , Keisuke Fujii

This paper is motivated by two applications, namely i) generalizations of cuckoo hashing, a computationally simple approach to assigning keys to objects, and ii) load balancing in content distribution networks, where one is interested in…

Probability · Mathematics 2012-07-09 Mathieu Leconte , Marc Lelarge , Laurent Massoulié

We present a detailed study on application of factor graphs and the belief propagation (BP) algorithm to the power system state estimation (SE) problem. We start from the BP solution for the linear DC model, for which we provide a detailed…

Information Theory · Computer Science 2018-11-21 Mirsad Cosovic

The Bethe approximation, or loopy belief propagation algorithm is a successful method for approximating partition functions of probabilistic models associated with a graph. Chertkov and Chernyak derived an interesting formula called Loop…

Discrete Mathematics · Computer Science 2009-11-14 Yusuke Watanabe , Kenji Fukumizu

General multivariate distributions are notoriously expensive to sample from, particularly the high-dimensional posterior distributions in PDE-constrained inverse problems. This paper develops a sampler for arbitrary continuous multivariate…

Numerical Analysis · Mathematics 2019-07-05 Sergey Dolgov , Karim Anaya-Izquierdo , Colin Fox , Robert Scheichl

This paper proposes a belief propagation (BP)-based algorithm for sequential detection and estimation of multipath component (MPC) parameters based on radio signals. Under dynamic channel conditions with moving transmitter/receiver, the…

Information Theory · Computer Science 2022-05-24 Xuhong Li , Erik Leitinger , Alexander Venus , Fredrik Tufvesson

A fault-tolerant approach to reliable quantum memory is essential for scalable quantum computing, as physical qubits are susceptible to noise. Quantum error correction (QEC) must be continuously performed to prolong the memory lifetime. In…

Quantum Physics · Physics 2024-09-30 Kao-Yueh Kuo , Ching-Yi Lai

We present a novel distributed Gauss-Newton method for the non-linear state estimation (SE) model based on a probabilistic inference method called belief propagation (BP). The main novelty of our work comes from applying BP sequentially…

Information Theory · Computer Science 2018-08-28 Mirsad Cosovic , Dejan Vukobratovic