English
Related papers

Related papers: State Space Expectation Propagation: Efficient Inf…

200 papers

Expectation Propagation (Minka, 2001) is a widely successful algorithm for variational inference. EP is an iterative algorithm used to approximate complicated distributions, typically to find a Gaussian approximation of posterior…

Computation · Statistics 2016-04-01 Guillaume Dehaene , Simon Barthelmé

Generalized linear models (GLMs) arguably represent the standard approach for statistical regression beyond the Gaussian likelihood scenario. When Bayesian formulations are employed, the general absence of a tractable posterior distribution…

Computation · Statistics 2024-07-03 Niccolò Anceschi , Augusto Fasano , Beatrice Franzolini , Giovanni Rebaudo

This paper is considered with joint estimation of state and time-varying noise covariance matrices in non-linear stochastic state space models. We present a variational Bayes and Gaussian filtering based algorithm for efficient computation…

Methodology · Statistics 2013-02-05 Simo Särkkä Jouni Hartikainen

This paper presents a new deterministic approximation technique in Bayesian networks. This method, "Expectation Propagation", unifies two previous techniques: assumed-density filtering, an extension of the Kalman filter, and loopy belief…

Artificial Intelligence · Computer Science 2013-01-14 Thomas P. Minka

A method for large scale Gaussian process classification has been recently proposed based on expectation propagation (EP). Such a method allows Gaussian process classifiers to be trained on very large datasets that were out of the reach of…

Sparsity constraints on the control inputs of a linear dynamical system naturally arise in several practical applications such as networked control, computer vision, seismic signal processing, and cyber-physical systems. In this work, we…

Systems and Control · Electrical Eng. & Systems 2024-09-11 Rupam Kalyan Chakraborty , Geethu Joseph , Chandra R. Murthy

Smoothing is a specialized form of Bayesian inference for state-space models that characterizes the posterior distribution of a collection of states given an associated sequence of observations. Ramgraber et al. (2023) proposes a general…

Methodology · Statistics 2023-11-23 Maximilian Ramgraber , Ricardo Baptista , Dennis McLaughlin , Youssef Marzouk

Expectation Propagation (EP) is a widely used message-passing algorithm that decomposes a global inference problem into multiple local ones. It approximates marginal distributions (beliefs) using intermediate functions (messages). While…

Information Theory · Computer Science 2026-01-30 Zilu Zhao , Fangqing Xiao , Dirk Slock

This work introduces the Gaussian integration to address a smoothing problem of a nonlinear stochastic state space model. The probability densities of states at each time instant are assumed to be Gaussian, and their means and covariances…

Signal Processing · Electrical Eng. & Systems 2025-01-14 Rohit Kumar Singh , Kundan Kumar , Shovan Bhaumik

We study asymptotic properties of expectation propagation (EP) -- a method for approximate inference originally developed in the field of machine learning. Applied to generalized linear models, EP iteratively computes a multivariate…

Information Theory · Computer Science 2018-05-11 Burak Çakmak , Manfred Opper

Expectation propagation (EP) is a family of algorithms for performing approximate inference in probabilistic models. The updates of EP involve the evaluation of moments -- expectations of certain functions -- which can be estimated from…

Machine Learning · Statistics 2024-10-30 Jonathan So , Richard E. Turner

In this work we study the non-parametric reconstruction of spatio-temporal dynamical Gaussian processes (GPs) via GP regression from sparse and noisy data. GPs have been mainly applied to spatial regression where they represent one of the…

Machine Learning · Computer Science 2020-10-06 Marco Todescato , Andrea Carron , Ruggero Carli , Gianluigi Pillonetto , Luca Schenato

Bayesian filtering is a general framework for recursively estimating the state of a dynamical system. Classical solutions such that Kalman filter and Particle filter are introduced in this report. Gaussian processes have been introduced as…

Information Theory · Computer Science 2010-11-04 Mr. Chong Han , Dr. Ido Nevat , Dr. Gareth Peters , Prof. Jinhong Yuan

This paper introduces a new sparse spatio-temporal structured Gaussian process regression framework for online and offline Bayesian inference. This is the first framework that gives a time-evolving representation of the interdependencies…

Machine Learning · Statistics 2018-08-01 Danil Kuzin , Olga Isupova , Lyudmila Mihaylova

We propose a novel algorithm to solve the expectation propagation relaxation of Bayesian inference for continuous-variable graphical models. In contrast to most previous algorithms, our method is provably convergent. By marrying convergent…

Machine Learning · Statistics 2010-12-17 Matthias W. Seeger , Hannes Nickisch

Gaussian processes (GPs) are flexible distributions over functions that enable high-level assumptions about unknown functions to be encoded in a parsimonious, flexible and general way. Although elegant, the application of GPs is limited by…

Machine Learning · Statistics 2017-10-06 Thang D. Bui , Josiah Yan , Richard E. Turner

Rich and complex time-series data, such as those generated from engineering systems, financial markets, videos or neural recordings, are now a common feature of modern data analysis. Explaining the phenomena underlying these diverse data…

Machine Learning · Statistics 2016-08-18 Marc Peter Deisenroth , Shakir Mohamed

Many parameter estimation problems arising in applications are best cast in the framework of Bayesian inversion. This allows not only for an estimate of the parameters, but also for the quantification of uncertainties in the estimates.…

Computation · Statistics 2020-10-28 Emmet Cleary , Alfredo Garbuno-Inigo , Shiwei Lan , Tapio Schneider , Andrew M Stuart

We introduce a scalable approach to Gaussian process inference that combines spatio-temporal filtering with natural gradient variational inference, resulting in a non-conjugate GP method for multivariate data that scales linearly with…

Machine Learning · Computer Science 2021-11-03 Oliver Hamelijnck , William J. Wilkinson , Niki A. Loppi , Arno Solin , Theodoros Damoulas

Expectation propagation (EP) is a deterministic approximation algorithm that is often used to perform approximate Bayesian parameter learning. EP approximates the full intractable posterior distribution through a set of local approximations…

Machine Learning · Statistics 2015-11-19 Yingzhen Li , Jose Miguel Hernandez-Lobato , Richard E. Turner