English
Related papers

Related papers: Passing Expectation Propagation Messages with Kern…

200 papers

We propose an efficient nonparametric strategy for learning a message operator in expectation propagation (EP), which takes as input the set of incoming messages to a factor node, and produces an outgoing message as output. This learned…

Expectation Propagation (EP) is a widely used message-passing algorithm that decomposes a global inference problem into multiple local ones. It approximates marginal distributions (beliefs) using intermediate functions (messages). While…

Information Theory · Computer Science 2026-01-30 Zilu Zhao , Fangqing Xiao , Dirk Slock

Expectation propagation (EP) is a powerful approximate inference algorithm. However, a critical barrier in applying EP is that the moment matching in message updates can be intractable. Handcrafting approximations is usually tricky, and…

Machine Learning · Statistics 2019-11-11 Zheng Wang , Shandian Zhe

Expectation Propagation (EP) is a widely used iterative message-passing algorithm that decomposes a global inference problem into multiple local ones. It approximates marginal distributions as ``beliefs'' using intermediate functions called…

Machine Learning · Statistics 2026-04-07 Zilu Zhao , Jichao Chen , Dirk Slock

In the context of signal detection in the presence of an unknown time-varying channel parameter, receivers based on the Expectation Propagation (EP) framework appear to be very promising. EP is a message-passing algorithm based on factor…

Signal Processing · Electrical Eng. & Systems 2024-04-09 Elisa Conti , Armando Vannucci , Amina Piemontese , Giulio Colavolpe

The paper proposes a new message passing algorithm for cycle-free factor graphs. The proposed "entropy message passing" (EMP) algorithm may be viewed as sum-product message passing over the entropy semiring, which has previously appeared in…

Machine Learning · Computer Science 2016-11-18 Velimir M. Ilic , Miomir S. Stankovic , Branimir T. Todorovic

In cell-free massive MIMO networks, an efficient distributed detection algorithm is of significant importance. In this paper, we propose a distributed expectation propagation (EP) detector for cell-free massive MIMO. The detector is…

Information Theory · Computer Science 2021-08-24 Hengtao He , Hanqing Wang , Xianghao Yu , Jun Zhang , S. H. Song , Khaled B. Letaief

We design iterative receiver schemes for a generic wireless communication system by treating channel estimation and information decoding as an inference problem in graphical models. We introduce a recently proposed inference framework that…

We propose a framework for the derivation and evaluation of distributed iterative algorithms for receiver cooperation in interference-limited wireless systems. Our approach views the processing within and collaboration between receivers as…

Information Theory · Computer Science 2012-04-18 Mihai-Alin Badiu , Carles Navarro Manchón , Vasile Bota , Bernard Henri Fleury

We study asymptotic properties of expectation propagation (EP) -- a method for approximate inference originally developed in the field of machine learning. Applied to generalized linear models, EP iteratively computes a multivariate…

Information Theory · Computer Science 2018-05-11 Burak Çakmak , Manfred Opper

It is shown how expectation maximization (EM) may be viewed as a message passing algorithm in factor graphs. In particular, a general EM message computation rule is identified. As a factor graph tool, EM may be used to break cycles in a…

Information Theory · Computer Science 2009-10-16 Justin Dauwels , Andrew Eckford , Sascha Korl , Hans-Andrea Loeliger

We show how the notion of message passing can be used to streamline the algebra and computer coding for fast approximate inference in large Bayesian semiparametric regression models. In particular, this approach is amenable to handling…

Methodology · Statistics 2016-04-07 M. P. Wand

Generative models provide a powerful framework for probabilistic reasoning. However, in many domains their use has been hampered by the practical difficulties of inference. This is particularly the case in computer vision, where models of…

Computer Vision and Pattern Recognition · Computer Science 2015-01-28 Varun Jampani , S. M. Ali Eslami , Daniel Tarlow , Pushmeet Kohli , John Winn

This paper addresses the problem of learning the impulse responses characterizing forward models by means of a regularized kernel-based Prediction Error Method (PEM). The common approach to accomplish that is to approximate the system with…

Optimization and Control · Mathematics 2024-09-20 Giulio Fattore , Marco Peruzzo , Giacomo Sartori , Mattia Zorzi

Efficient feature selection from high-dimensional datasets is a very important challenge in many data-driven fields of science and engineering. We introduce a statistical mechanics inspired strategy that addresses the problem of sparse…

Machine Learning · Statistics 2021-04-07 Alfredo Braunstein , Thomas Gueudré , Andrea Pagnani , Mirko Pieropan

We study the expectation propagation (EP) algorithm for symbol detection in massive multiple-input multiple-output (MIMO) systems. The EP detector shows excellent performance but suffers from a high computational complexity due to the…

Information Theory · Computer Science 2024-08-23 Luca Schmid , Dominik Sulz , Laurent Schmalen

Bayesian learning is often hampered by large computational expense. As a powerful generalization of popular belief propagation, expectation propagation (EP) efficiently approximates the exact Bayesian computation. Nevertheless, EP can be…

Machine Learning · Computer Science 2012-08-30 Yuan Qi , Yandong Guo

Based on prior work by Eckford, it is shown how expectation maximization (EM) may be viewed, and used, as a message passing algorithm in factor graphs.

Information Theory · Computer Science 2016-11-17 J. Dauwels , S. Korl , H. -A. Loeliger

Variational message passing (VMP), belief propagation (BP) and expectation propagation (EP) have found their wide applications in complex statistical signal processing problems. In addition to viewing them as a class of algorithms operating…

Information Theory · Computer Science 2021-01-20 Dan Zhang , Xiaohang Song , Wenjin Wang , Gerhard Fettweis , Xiqi Gao

We present the design of an autoregressive active inference agent in the form of message passing on a factor graph. Expected free energy is derived and distributed across a planning graph. The proposed agent is validated on a robot…

Artificial Intelligence · Computer Science 2026-01-21 Wouter M. Kouw , Tim N. Nisslbeck , Wouter L. N. Nuijten
‹ Prev 1 2 3 10 Next ›