English
Related papers

Related papers: Algorithmic Locality via Provable Convergence in Q…

200 papers

Machine learning based approaches are being increasingly used for designing decoders for next generation communication systems. One widely used framework is neural belief propagation (NBP), which unfolds the belief propagation (BP)…

Information Theory · Computer Science 2024-04-23 Sudarshan Adiga , Xin Xiao , Ravi Tandon , Bane Vasic , Tamal Bose

We present a differentiable approach to learn the probabilistic factors used for inference by a nonparametric belief propagation algorithm. Existing nonparametric belief propagation methods rely on domain-specific features encoded in the…

We propose a nonparametric generalization of belief propagation, Kernel Belief Propagation (KBP), for pairwise Markov random fields. Messages are represented as functions in a reproducing kernel Hilbert space (RKHS), and message updates are…

Machine Learning · Computer Science 2011-05-30 Le Song , Arthur Gretton , Danny Bickson , Yucheng Low , Carlos Guestrin

We present an exact method of greatly speeding up belief propagation (BP) for a wide variety of potential functions in pairwise MRFs and other graphical models. Specifically, our technique applies whenever the pairwise potentials have been…

Computer Vision and Pattern Recognition · Computer Science 2010-10-04 James M. Coughlan , Huiying Shen

Distributional assumptions have been shown to be necessary for the robust learnability of concept classes when considering the exact-in-the-ball robust risk and access to random examples by Gourdeau et al. (2019). In this paper, we study…

Machine Learning · Computer Science 2023-07-21 Pascale Gourdeau , Varun Kanade , Marta Kwiatkowska , James Worrell

We study the behavior of the belief-propagation (BP) algorithm affected by erroneous data exchange in a wireless sensor network (WSN). The WSN conducts a distributed binary hypothesis test where the joint statistical behavior of the sensor…

Information Theory · Computer Science 2020-04-14 Younes Abdi , Tapani Ristaniemi

We present a differentiable approach to learn the probabilistic factors used for inference by a nonparametric belief propagation algorithm. Existing nonparametric belief propagation methods rely on domain-specific features encoded in the…

Graph neural network models have been extensively used to learn node representations for graph structured data in an end-to-end setting. These models often rely on localized first order approximations of spectral graph convolutions and…

Machine Learning · Computer Science 2020-10-20 Mohammed Haroon Dupty , Wee Sun Lee

Modularity is a popular measure of community structure. However, maximizing the modularity can lead to many competing partitions, with almost the same modularity, that are poorly correlated with each other. It can also produce illusory…

Physics and Society · Physics 2014-12-30 Pan Zhang , Cristopher Moore

Interacting quantum many-body systems are usually expected to thermalise, in the sense that the evolution of local expectation values approach a stationary value resembling a thermal ensemble. This intuition is notably contradicted in…

Quantum Physics · Physics 2015-12-09 M. Friesdorf , A. H. Werner , M. Goihl , J. Eisert , W. Brown

Compared to the linear MIMO detectors, the Belief Propagation (BP) detector has shown greater capabilities in achieving near optimal performance and better nature to iteratively cooperate with channel decoders. Aiming at real applications,…

Information Theory · Computer Science 2022-06-28 Wenyue Zhou , Yifei Shen , Liping Li , Yongming Huang , Chuan Zhang , Xiaohu You

We address the question of convergence in the loopy belief propagation (LBP) algorithm. Specifically, we relate convergence of LBP to the existence of a weak limit for a sequence of Gibbs measures defined on the LBP s associated computation…

Artificial Intelligence · Computer Science 2013-01-07 Sekhar Tatikonda , Michael I. Jordan

We present a novel distributed Gauss-Newton method for the non-linear state estimation (SE) model based on a probabilistic inference method called belief propagation (BP). The main novelty of our work comes from applying BP sequentially…

Information Theory · Computer Science 2018-08-28 Mirsad Cosovic , Dejan Vukobratovic

We present Neural Bayesian Filtering (NBF), an algorithm for maintaining distributions over hidden states, called beliefs, in partially observable systems. NBF is trained to find a good latent representation of the beliefs induced by a…

This work describes a method of approximating matrix permanents efficiently using belief propagation. We formulate a probability distribution whose partition function is exactly the permanent, then use Bethe free energy to approximate this…

Machine Learning · Computer Science 2009-08-13 Bert Huang , Tony Jebara

Tensor networks establish an adaptable framework for the emulation of quantum circuits. By partitioning exponentially large registers and gates into smaller tensors, this unlocks fast transformations through tensor algebra, and grants fine…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-13 Jakub Adamski , Oliver Thomson Brown

We give an algorithm that converts any tensor network (TN) into a sequence of local unitaries whose composition block-encodes the network contraction, suitable for Quantum Eigenvalue / Singular Value Transformation (QET/QSVT). The…

Quantum Physics · Physics 2026-01-13 Sebastian Issel

This paper considers the noisy group testing problem where among a large population of items some are defective. The goal is to identify all defective items by testing groups of items, with the minimum possible number of tests. The focus of…

Information Theory · Computer Science 2021-10-20 Esmaeil Karimi , Anoosheh Heidarzadeh , Krishna R. Narayanan , Alex Sprintson

The decoding of Low-Density Parity-Check codes by the Belief Propagation (BP) algorithm is revisited. We check the iterative algorithm for its convergence to a codeword (termination), we run Monte Carlo simulations to find the probability…

Information Theory · Computer Science 2007-07-13 M. G. Stepanov , M. Chertkov

In Non - ergodic belief networks the posterior belief OF many queries given evidence may become zero.The paper shows that WHEN belief propagation IS applied iteratively OVER arbitrary networks(the so called, iterative OR loopy belief…

Artificial Intelligence · Computer Science 2012-12-12 Rina Dechter , Robert Mateescu