English
Related papers

Related papers: On Approximate Nonlinear Gaussian Message Passing …

200 papers

Graph neural networks (GNNs) have achieved champion in wide applications. Neural message passing is a typical key module for feature propagation by aggregating neighboring features. In this work, we propose a new message passing based on…

Machine Learning · Computer Science 2023-03-01 Xinliang Liu , Bingxin Zhou , Chutian Zhang , Yu Guang Wang

This paper proposes Graph Signal Adaptive Message Passing (GSAMP), a novel message passing method that simultaneously conducts online prediction, missing data imputation, and noise removal on time-varying graph signals. Unlike conventional…

Signal Processing · Electrical Eng. & Systems 2024-11-26 Yi Yan , Changran Peng , Ercan Engin Kuruoglu

Many important schemes in signal processing and communications, ranging from the BCJR algorithm to the Kalman filter, are instances of factor graph methods. This family of algorithms is based on recursive message passing-based computations…

Machine Learning · Statistics 2020-02-06 Nir Shlezinger , Nariman Farsad , Yonina C. Eldar , Andrea J. Goldsmith

Factor analysis models are widely utilized in social and behavioral sciences, such as psychology, education, and marketing, to measure unobservable latent traits. In this article, we introduce a nonlinear structured latent factor analysis…

Methodology · Statistics 2025-01-07 Yimang Zhang , Xiaorui Wang , Jian Qing Shi

We introduce a Fourier-based fast algorithm for Gaussian process regression in low dimensions. It approximates a translationally-invariant covariance kernel by complex exponentials on an equispaced Cartesian frequency grid of $M$ nodes.…

Computation · Statistics 2023-05-19 Philip Greengard , Manas Rachh , Alex Barnett

We consider the estimation of an i.i.d.\ random vector observed through a linear transform followed by a componentwise, probabilistic (possibly nonlinear) measurement channel. A novel algorithm, called generalized approximate message…

Information Theory · Computer Science 2012-08-15 Sundeep Rangan

Stacking probabilistic building blocks into deeper architectures typically breaks closed-form inference. We show that closed-form inference can be preserved. We identify five factor-graph primitives: a bilinear factor, an exponential link,…

Machine Learning · Computer Science 2026-05-29 Mykola Lukashchuk , Kyrylo Yemets , Wouter M. Kouw , Dmitry Bagaev , İsmail Şenöz , Jeff Beck , Bert de Vries

Graph Neural Networks (GNNs) have emerged as powerful tools for learning on graph-structured data, but often struggle to balance local and global information. While graph Transformers aim to address this by enabling long-range interactions,…

Machine Learning · Computer Science 2025-11-18 Jeongwhan Choi , Seungjun Park , Sumin Park , Sung-Bae Cho , Noseong Park

Gaussian processes (GPs) are crucial in machine learning for quantifying uncertainty in predictions. However, their associated covariance matrices, defined by kernel functions, are typically dense and large-scale, posing significant…

Machine Learning · Computer Science 2025-04-02 Theresa Wagner , Tianshi Xu , Franziska Nestler , Yuanzhe Xi , Martin Stoll

We present the Graph Forward-Forward (GFF) algorithm, an extension of the Forward-Forward procedure to graphs, able to handle features distributed over a graph's nodes. This allows training graph neural networks with forward passes only,…

Machine Learning · Computer Science 2023-02-13 Daniele Paliotta , Mathieu Alain , Bálint Máté , François Fleuret

Graph signal processing (GSP) is a framework to analyze and process graph-structured data. Many research works focus on developing tools such as Graph Fourier transforms (GFT), filters, and neural network models to handle graph signals.…

Signal Processing · Electrical Eng. & Systems 2023-03-13 Feng Ji , Wee Peng Tay

Label imbalance and homophily-heterophily mixture are the fundamental problems encountered when applying Graph Neural Networks (GNNs) to Graph Fraud Detection (GFD) tasks. Existing GNN-based GFD models are designed to augment graph…

Artificial Intelligence · Computer Science 2024-12-03 Wei Zhuo , Zemin Liu , Bryan Hooi , Bingsheng He , Guang Tan , Rizal Fathony , Jia Chen

Uncertainty propagation and filtering can be interpreted as gradient flows with respect to suitable metrics in the infinite dimensional manifold of probability density functions. Such a viewpoint has been put forth in recent literature, and…

Optimization and Control · Mathematics 2017-10-31 Abhishek Halder , Tryphon T. Georgiou

Pairwise Markov Random Fields (MRFs) or undirected graphical models are parsimonious representations of joint probability distributions. Variables correspond to nodes of a graph, with edges between nodes corresponding to conditional…

Statistics Theory · Mathematics 2018-09-18 Eric Janofsky

We propose a low complexity, graph based linear minimum mean square error (LMMSE) filter in which the non-white characteristics of a random process are taken into account. Our method corresponds to block LMMSE filtering, and has the…

Information Theory · Computer Science 2014-05-14 Pinar Sen , Ali Ozgur Yilmaz

Inference in nonlinear continuous stochastic processes on trees is challenging, particularly when observations are sparse and the topology is complex. Exact smoothing via Doob's $h$-transform is intractable for general nonlinear dynamics.…

Machine Learning · Statistics 2026-05-18 Gefan Yang , Frank van der Meulen , Stefan Sommer

State estimation in non-linear models is performed by tracking the posterior distribution recursively. A plethora of algorithms have been proposed for this task. Among them, the Gaussian particle filter uses a weighted set of particles to…

Signal Processing · Electrical Eng. & Systems 2022-07-05 Karthik Comandur , Yunpeng Li , Santosh Nannuru

Multilayer (or deep) networks are powerful probabilistic models based on multiple stages of a linear transform followed by a non-linear (possibly random) function. In general, the linear transforms are defined by matrices and the non-linear…

Information Theory · Computer Science 2017-10-13 Galen Reeves

We consider the problem of recovering an unknown signal ${\mathbf x}\in {\mathbb R}^n$ from general nonlinear measurements obtained through a generalized linear model (GLM), i.e., ${\mathbf y}= f\left({\mathbf A}{\mathbf x}+{\mathbf…

Information Theory · Computer Science 2022-10-18 Jiang Zhu , Xiangming Meng , Xupeng Lei , Qinghua Guo

We study the filtering and smoothing problem for continuous-time linear Gaussian systems. While classical approaches such as the Kalman-Bucy filter and the Rauch-Tung-Striebel (RTS) smoother provide recursive formulas for the conditional…

Statistics Theory · Mathematics 2026-01-06 Masahiro Kurisaki