English
Related papers

Related papers: Reactive Message Passing for Scalable Bayesian Inf…

200 papers

This paper introduces a novel message-passing (MP) framework for the collaborative filtering (CF) problem associated with recommender systems. We model the movie-rating prediction problem popularized by the Netflix Prize, using a…

Information Theory · Computer Science 2010-04-08 Byung-Hak Kim , Arvind Yedla , Henry D. Pfister

Graph neural networks (GNNs) are a powerful inductive bias for modelling algorithmic reasoning procedures and data structures. Their prowess was mainly demonstrated on tasks featuring Markovian dynamics, where querying any associated data…

Machine Learning · Computer Science 2021-04-28 Heiko Strathmann , Mohammadamin Barekatain , Charles Blundell , Petar Veličković

Generative modeling provides a powerful framework for learning data distributions. These models initially relied on probabilistic methods such as Gaussian Processes (GP) for uncertainty-aware predictions and shifted towards larger trainable…

Generative models provide a powerful framework for probabilistic reasoning. However, in many domains their use has been hampered by the practical difficulties of inference. This is particularly the case in computer vision, where models of…

Computer Vision and Pattern Recognition · Computer Science 2015-01-28 Varun Jampani , S. M. Ali Eslami , Daniel Tarlow , Pushmeet Kohli , John Winn

Approximate message passing (AMP) is a low-cost iterative parameter-estimation technique for certain high-dimensional linear systems with non-Gaussian distributions. However, AMP only applies to independent identically distributed (IID)…

Information Theory · Computer Science 2021-06-07 Lei Liu , Shunqi Huang , Brian M. Kurkoski

Bayesian neural networks (BNNs) offer the potential for reliable uncertainty quantification and interpretability, which are critical for trustworthy AI in high-stakes domains. However, existing methods often struggle with issues such as…

Machine Learning · Computer Science 2025-01-28 Romeo Sommerfeld , Christian Helms , Ralf Herbrich

Machine learned interatomic potentials, particularly equivariant message-passing (MP) models, have demonstrated high fidelity in representing first-principles data, revolutionizing computational studies in materials science, biophysics, and…

Chemical Physics · Physics 2025-09-01 Yaolong Zhang , Hua Guo

We propose an efficient nonparametric strategy for learning a message operator in expectation propagation (EP), which takes as input the set of incoming messages to a factor node, and produces an outgoing message as output. This learned…

We consider the problem of reconstructing the signal and the hidden variables from observations coming from a multi-layer network with rotationally invariant weight matrices. The multi-layer structure models inference from deep generative…

Machine Learning · Statistics 2022-12-06 Yizhou Xu , TianQi Hou , ShanSuo Liang , Marco Mondelli

A new message-passing (MP) method is considered for the matrix completion problem associated with recommender systems. We attack the problem using a (generative) factor graph model that is related to a probabilistic low-rank matrix…

Information Theory · Computer Science 2010-07-06 Byung-Hak Kim , Arvind Yedla , Henry D. Pfister

Graphical models use the intuitive and well-studied methods of graph theory to implicitly represent dependencies between variables in large systems. They can model the global behaviour of a complex system by specifying only local factors.…

Artificial Intelligence · Computer Science 2015-08-21 Siamak Ravanbakhsh

We present the design of an autoregressive active inference agent in the form of message passing on a factor graph. Expected free energy is derived and distributed across a planning graph. The proposed agent is validated on a robot…

Artificial Intelligence · Computer Science 2026-01-21 Wouter M. Kouw , Tim N. Nisslbeck , Wouter L. N. Nuijten

Message passing algorithms, whose iterative nature captures well complicated interactions among interconnected variables in complex systems and extracts information from the fixed point of iterated messages, provide a powerful toolkit in…

Disordered Systems and Neural Networks · Physics 2022-02-28 Chun-Yan Zhao , Yan-Rong Fu , Jin-Hua Zhao

In this paper, we propose a novel hierarchical representation via message propagation (HRMP) method for robust model fitting, which simultaneously takes advantages of both the consensus analysis and the preference analysis to estimate the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Shuyuan Lin , Xing Wang , Guobao Xiao , Yan Yan , Hanzi Wang

Agents have demonstrated their potential in scientific reasoning tasks through large language models. However, they often face challenges such as insufficient accuracy and degeneration of thought when handling complex reasoning tasks, which…

Computation and Language · Computer Science 2025-01-06 Chengbo He , Bochao Zou , Xin Li , Jiansheng Chen , Junliang Xing , Huimin Ma

Characterizing the distribution of high-dimensional statistical estimators is a challenging task, due to the breakdown of classical asymptotic theory in high dimension. This paper makes progress towards this by developing non-asymptotic…

Statistics Theory · Mathematics 2024-01-09 Gen Li , Yuting Wei

We propose a recursive Bayesian estimation procedure for multivariate autoregressive models with exogenous inputs based on message passing in a factor graph. Unlike recursive least-squares, our method produces full posterior distributions…

Signal Processing · Electrical Eng. & Systems 2025-06-04 T. N. Nisslbeck , Wouter M. Kouw

Gaussian Process (GP) formulation of continuoustime trajectory offers a fast solution to the motion planning problem via probabilistic inference on factor graph. However, often the solution converges to in-feasible local minima and the…

Robotics · Computer Science 2022-03-08 Salman Bari , Volker Gabler , Dirk Wollherr

In this paper, we propose a new message passing algorithm that utilizes hybrid vector message passing (HVMP) to solve the generalized bilinear factorization (GBF) problem. The proposed GBF-HVMP algorithm integrates expectation propagation…

Signal Processing · Electrical Eng. & Systems 2024-01-09 Hao Jiang , Xiaojun Yuan , Qinghua Guo

Quantile estimation and regression within the Bayesian framework is challenging as the choice of likelihood and prior is not obvious. In this paper, we introduce a novel Bayesian nonparametric method for quantile estimation and regression…

Methodology · Statistics 2026-02-16 Edwin Fong , Andrew Yiu