English
Related papers

Related papers: On the Geometry of Message Passing Algorithms for …

200 papers

We introduce a general Bayesian framework for graph matching grounded in a new theory of exchangeable random permutations. Leveraging the cycle representation of permutations and the literature on exchangeable random partitions, we define,…

Methodology · Statistics 2026-02-03 Francesco Gaffi , Nathaniel Josephs , Lizhen Lin

Bayesian methods have become a popular way to incorporate prior knowledge and a notion of uncertainty into machine learning models. At the same time, the complexity of modern machine learning makes it challenging to comprehend a model's…

Machine Learning · Computer Science 2021-09-09 Sarem Seitz

We propose consensus propagation, an asynchronous distributed protocol for averaging numbers across a network. We establish convergence, characterize the convergence rate for regular graphs, and demonstrate that the protocol exhibits better…

Information Theory · Computer Science 2007-07-13 Ciamac C. Moallemi , Benjamin Van Roy

Due to its state-of-the-art estimation performance complemented by rigorous and non-conservative uncertainty bounds, Gaussian process regression is a popular tool for enhancing dynamical system models and coping with their inaccuracies.…

Systems and Control · Electrical Eng. & Systems 2025-02-05 Anna Scampicchio , Elena Arcari , Amon Lahr , Melanie N. Zeilinger

Gaussian Processes are widely used for regression tasks. A known limitation in the application of Gaussian Processes to regression tasks is that the computation of the solution requires performing a matrix inversion. The solution also…

Machine Learning · Computer Science 2017-08-22 Sourish Das , Sasanka Roy , Rajiv Sambasivan

A message passing algorithm is derived for recovering communities within a graph generated by a variation of the Barab\'{a}si-Albert preferential attachment model. The estimator is assumed to know the arrival times, or order of attachment,…

Machine Learning · Statistics 2018-07-24 Bruce Hajek , Suryanarayana Sankagiri

Credible forecasting and representation learning of dynamical systems are of ever-increasing importance for reliable decision-making. To that end, we propose a family of Gaussian processes (GP) for dynamical systems with linear…

Machine Learning · Computer Science 2025-02-11 Petar Bevanda , Max Beier , Armin Lederer , Alexandre Capone , Stefan Sosnowski , Sandra Hirche

Graph Gaussian Processes (GGPs) provide a data-efficient solution on graph structured domains. Existing approaches have focused on static structures, whereas many real graph data represent a dynamic structure, limiting the applications of…

Machine Learning · Computer Science 2021-11-04 David Blanco-Mulero , Markus Heinonen , Ville Kyrki

Gaussian processes are used in machine learning to learn input-output mappings from observed data. Gaussian process regression is based on imposing a Gaussian process prior on the unknown regressor function and statistically conditioning it…

Machine Learning · Statistics 2019-07-16 Simo Särkkä

Gaussian Processes (GPs) are widely used tools in statistics, machine learning, robotics, computer vision, and scientific computation. However, despite their popularity, they can be difficult to apply; all but the simplest classification or…

Machine Learning · Computer Science 2016-01-06 Ulrich Schaechtle , Ben Zinberg , Alexey Radul , Kostas Stathis , Vikash K. Mansinghka

Gaussian processes (GP) are a widely used model for regression problems in supervised machine learning. Implementation of GP regression typically requires $O(n^3)$ logic gates. We show that the quantum linear systems algorithm [Harrow et…

Quantum Physics · Physics 2019-05-29 Zhikuan Zhao , Jack K. Fitzsimons , Joseph F. Fitzsimons

Multi-output Gaussian Processes provide principled uncertainty-aware learning of vector-valued fields but are difficult to deploy in large-scale, distributed, and streaming settings due to their computational and centralized nature. This…

Machine Learning · Computer Science 2026-04-14 Yogesh Prasanna Kumar Rao , Tamas Keviczky , Raj Thilak Rajan

Message passing, also known as belief propagation, is a versatile framework for analyzing models defined on graphs. Its most prototypical application is percolation; yet, the interpretation of the message passing formulation of percolation…

Physics and Society · Physics 2026-04-08 Takayuki Hiraoka

Given time series data, how can we answer questions like "what will happen in the future?" and "how did we get here?" These sorts of probabilistic inference questions are challenging when observations are high-dimensional. In this paper, we…

Machine Learning · Computer Science 2025-05-22 Benjamin Eysenbach , Vivek Myers , Ruslan Salakhutdinov , Sergey Levine

We consider inference problems for a class of continuous state collective hidden Markov models, where the data is recorded in aggregate (collective) form generated by a large population of individuals following the same dynamics. We propose…

Machine Learning · Statistics 2021-07-27 Rahul Singh , Yongxin Chen

Gaussian processes are a versatile framework for learning unknown functions in a manner that permits one to utilize prior information about their properties. Although many different Gaussian process models are readily available when the…

A method to perform unfolding with Gaussian processes (GPs) is presented. Using Bayesian regression, we define an estimator for the underlying truth distribution as the mode of the posterior. We show that in the case where the bin contents…

Data Analysis, Statistics and Probability · Physics 2018-11-07 Adam Bozson , Glen Cowan , Francesco Spanò

The proliferation of capable and efficient machine learning (ML) models marks one of the strongest methodological shifts in signal processing (SP) in its nearly 100-year history. ML models support the development of SP systems that…

Signal Processing · Electrical Eng. & Systems 2026-05-01 Daniel Waxman , Fernando Llorente , Petar M. Djurić

This paper considers inference over distributed linear Gaussian models using factor graphs and Gaussian belief propagation (BP). The distributed inference algorithm involves only local computation of the information matrix and of the mean…

Machine Learning · Statistics 2018-01-01 Jian Du , Shaodan Ma , Yik-Chung Wu , Soummya Kar , José M. F. Moura

Recently nonparametric functional model with functional responses has been proposed within the functional reproducing kernel Hilbert spaces (fRKHS) framework. Motivated by its superior performance and also its limitations, we propose a…

Methodology · Statistics 2010-08-11 Heng Lian