English
Related papers

Related papers: Optimizing Reweighted Belief Propagation for Distr…

200 papers

Compared to the linear MIMO detectors, the Belief Propagation (BP) detector has shown greater capabilities in achieving near optimal performance and better nature to iteratively cooperate with channel decoders. Aiming at real applications,…

Information Theory · Computer Science 2022-06-28 Wenyue Zhou , Yifei Shen , Liping Li , Yongming Huang , Chuan Zhang , Xiaohu You

The task of CDMA multiuser detection is to simultaneously estimate binary symbols of $K$ synchronous users from the received $N$ base-band CDMA signals. Mathematically, this can be formulated as an inference problem on a complete bipartite…

Disordered Systems and Neural Networks · Physics 2016-11-17 Yoshiyuki Kabashima

This paper considers a distributed adaptive optimization problem, where all agents only have access to their local cost functions with a common unknown parameter, whereas they mean to collaboratively estimate the true parameter and find the…

Optimization and Control · Mathematics 2025-09-03 Yaqun Yang , Jinlong Lei , Guanghui Wen , Yiguang Hong

Many models of interest in the natural and social sciences have no closed-form likelihood function, which means that they cannot be treated using the usual techniques of statistical inference. In the case where such models can be…

Computation · Statistics 2012-07-19 Simon Barthelmé , Nicolas Chopin

Belief Propagation has been widely used for marginal inference, however it is slow on problems with large-domain variables and high-order factors. Previous work provides useful approximations to facilitate inference on such models, but…

Machine Learning · Statistics 2013-11-15 Sameer Singh , Sebastian Riedel , Andrew McCallum

We introduce an efficient message passing scheme for solving Constraint Satisfaction Problems (CSPs), which uses stochastic perturbation of Belief Propagation (BP) and Survey Propagation (SP) messages to bypass decimation and directly…

Artificial Intelligence · Computer Science 2016-01-05 Siamak Ravanbakhsh , Russell Greiner

We present a Bayesian approach for the Contamination Source Detection problem in Water Distribution Networks. Given an observation of contaminants in one or more nodes in the network, we try to give probable explanation for it assuming that…

Data Analysis, Statistics and Probability · Physics 2018-09-28 Ernesto Ortega , Alfredo Braunstein , Alejandro Lage-Castellanos

The sigma point (SP) filter, also known as unscented Kalman filter, is an attractive alternative to the extended Kalman filter and the particle filter. Here, we extend the SP filter to nonsequential Bayesian inference corresponding to loopy…

Artificial Intelligence · Computer Science 2023-07-19 Florian Meyer , Ondrej Hlinka , Franz Hlawatsch

We study the belief propagation algorithm for the graph bi-partitioning problem, i.e. the ground state of the ferromagnetic Ising model at a fixed magnetization. Application of a message passing scheme to a model with a fixed global…

Disordered Systems and Neural Networks · Physics 2010-06-16 P. Sulc , L. Zdeborova

The Graph Burning Problem (GBP) is a combinatorial optimization problem that has gained relevance as a tool for quantifying a graph's vulnerability to contagion. Although it is based on a very simple propagation model, its decision version…

Traditional learning methods for training Markov random fields require doing inference over all variables to compute the likelihood gradient. The iteration complexity for those methods therefore scales with the size of the graphical models.…

Machine Learning · Computer Science 2018-11-12 You Lu , Zhiyuan Liu , Bert Huang

Probabilistic graphical models compactly represent joint distributions by decomposing them into factors over subsets of random variables. In Bayesian networks, the factors are conditional probability distributions. For many problems, common…

Machine Learning · Computer Science 2018-08-21 Weirui Kong , Wenyi Wang

In this paper, we model an extended DC state estimation (SE) in an electric power system as a factor graph (FG) and solve it using belief propagation (BP) algorithm. The DC model comprises bus voltage angles as state variables, while the…

Information Theory · Computer Science 2016-11-15 Mirsad Cosovic , Dejan Vukobratovic

We study iterative blind symbol detection for block-fading linear inter-symbol interference channels. Based on the factor graph framework, we design a joint channel estimation and detection scheme that combines the expectation maximization…

Information Theory · Computer Science 2024-08-06 Luca Schmid , Tomer Raviv , Nir Shlezinger , Laurent Schmalen

Attributions aim to identify input pixels that are relevant to the decision-making process. A popular approach involves using modified backpropagation (BP) rules to reverse decisions, which improves interpretability compared to the original…

Machine Learning · Computer Science 2025-03-17 Guanhua Zheng , Jitao Sang , Changsheng Xu

We propose a method for an agent to revise its incomplete probabilistic beliefs when a new piece of propositional information is observed. In this work, an agent's beliefs are represented by a set of probabilistic formulae -- a belief base.…

Artificial Intelligence · Computer Science 2016-04-08 Gavin Rens , Thomas Meyer , Giovanni Casini

We explore training Binary Neural Networks (BNNs) as a discrete variable inference problem over a factor graph. We study the behaviour of this conversion in an under-parameterized BNN setting and propose stochastic versions of Belief…

Machine Learning · Computer Science 2022-04-06 Amir Khoshaman , Giuseppe Castiglione , Christopher Srinivasa

Federated inference enhances LLM performance in edge computing through weighted averaging of distributed model predictions. However, autoregressive LLM inference requires frequent full-model forward passes across workers, severely limiting…

Signal Processing · Electrical Eng. & Systems 2026-04-29 Ce Zheng , Xinghan Wang , Jiahong Ning , Yuxuan Shi , Ning Huang , Tingting Yang

Inference problems in graphical models can be represented as a constrained optimization of a free energy function. It is known that when the Bethe free energy is used, the fixedpoints of the belief propagation (BP) algorithm correspond to…

Machine Learning · Computer Science 2012-06-18 Tamir Hazan , Amnon Shashua

Decentralized coordination for multi-robot systems involves planning in challenging, high-dimensional spaces. The planning problem is particularly challenging in the presence of obstacles and different sources of uncertainty such as…

Robotics · Computer Science 2024-03-13 Jana Pavlasek , Joshua Jing Zhi Mah , Ruihan Xu , Odest Chadwicke Jenkins , Fabio Ramos