English
Related papers

Related papers: Expectation Propagation in Gaussian Process Dynami…

200 papers

This paper studies the convergence rate of a message-passing distributed algorithm for solving a large-scale linear system. This problem is generalised from the celebrated Gaussian Belief Propagation (BP) problem for statistical learning…

Systems and Control · Electrical Eng. & Systems 2020-04-15 Zhaorong Zhang , Qianqian Cai , Minyue Fu

A method to perform unfolding with Gaussian processes (GPs) is presented. Using Bayesian regression, we define an estimator for the underlying truth distribution as the mode of the posterior. We show that in the case where the bin contents…

Data Analysis, Statistics and Probability · Physics 2018-11-07 Adam Bozson , Glen Cowan , Francesco Spanò

The composition of multiple Gaussian Processes as a Deep Gaussian Process (DGP) enables a deep probabilistic nonparametric approach to flexibly tackle complex machine learning problems with sound quantification of uncertainty. Existing…

Machine Learning · Statistics 2017-03-02 Kurt Cutajar , Edwin V. Bonilla , Pietro Michiardi , Maurizio Filippone

Scalable Gaussian process (GP) inference is essential for sequential decision-making tasks, yet improving GP scalability remains a challenging problem with many open avenues of research. This paper focuses on iterative GPs, where iterative…

Machine Learning · Computer Science 2025-11-21 Alan Yufei Dong , Jihao Andreas Lin , José Miguel Hernández-Lobato

Data assimilation is a core component of numerical weather prediction systems. The large quantity of data processed during assimilation requires the computation to be distributed across increasingly many compute nodes, yet existing…

Machine Learning · Computer Science 2025-01-15 Oscar Key , So Takao , Daniel Giles , Marc Peter Deisenroth

We consider the accuracy of an approximate posterior distribution in nonparametric regression problems by combining posterior distributions computed on subsets of the data defined by the locations of the independent variables. We show that…

Statistics Theory · Mathematics 2025-04-29 Botond Szabo , Amine Hadji , Aad van der Vaart

The Gaussian process (GP) is a nonparametric prior distribution over functions indexed by time, space, or other high-dimensional index set. The GP is a flexible model yet its limitation is given by its very nature: it can only model…

Machine Learning · Statistics 2019-07-15 Gonzalo Rios , Felipe Tobar

The Dynamical Gaussian Process Latent Variable Models provide an elegant non-parametric framework for learning the low dimensional representations of the high-dimensional time-series. Real world observational studies, however, are often…

Machine Learning · Computer Science 2019-09-26 Thanh Le , Vasant Honavar

We propose a novel sparse spectrum approximation of Gaussian process (GP) tailored for Bayesian optimization. Whilst the current sparse spectrum methods provide desired approximations for regression problems, it is observed that this…

Machine Learning · Computer Science 2020-06-09 Ang Yang , Cheng Li , Santu Rana , Sunil Gupta , Svetha Venkatesh

Gaussian Processes (GPs) have been widely used in machine learning to model distributions over functions, with applications including multi-modal regression, time-series prediction, and few-shot learning. GPs are particularly useful in the…

Gaussian processes (GPs) have gained popularity as flexible machine learning models for regression and function approximation with an in-built method for uncertainty quantification. However, GPs suffer when the amount of training data is…

Machine Learning · Statistics 2025-11-26 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

In this paper, we present a novel distributed expectation propagation algorithm for multiple sensors, multiple objects tracking in cluttered environments. The proposed framework enables each sensor to operate locally while collaboratively…

Signal Processing · Electrical Eng. & Systems 2025-06-09 Qing Li , Runze Gan , James R. Hopgood , Michael E. Davies , Simon J. Godsill

Transformed Gaussian Processes (TGPs) are stochastic processes specified by transforming samples from the joint distribution from a prior process (typically a GP) using an invertible transformation; increasing the flexibility of the base…

Machine Learning · Computer Science 2023-11-03 Francisco Javier Sáez-Maldonado , Juan Maroñas , Daniel Hernández-Lobato

Efficient Reinforcement Learning usually takes advantage of demonstration or good exploration strategy. By applying posterior sampling in model-free RL under the hypothesis of GP, we propose Gaussian Process Posterior Sampling Reinforcement…

Machine Learning · Computer Science 2018-12-12 Ying Fan , Letian Chen , Yizhou Wang

We introduce a Gaussian process-based model for handling of non-stationarity. The warping is achieved non-parametrically, through imposing a prior on the relative change of distance between subsequent observation inputs. The model allows…

Machine Learning · Statistics 2019-12-06 David Tolpin

Probabilistic approaches for handling count-valued time sequences have attracted amounts of research attentions because their ability to infer explainable latent structures and to estimate uncertainties, and thus are especially suitable for…

Machine Learning · Computer Science 2024-05-24 Jiahao Wang , Sikun Yang , Heinz Koeppl , Xiuzhen Cheng , Pengfei Hu , Guoming Zhang

A new algorithm is developed to tackle the issue of sampling non-Gaussian model parameter posterior probability distributions that arise from solutions to Bayesian inverse problems. The algorithm aims to mitigate some of the hurdles faced…

Machine Learning · Statistics 2019-11-19 Leen Alawieh , Jonathan Goodman , John B. Bell

Learning dynamical models from data is not only fundamental but also holds great promise for advancing principle discovery, time-series prediction, and controller design. Among various approaches, Gaussian Process State-Space Models…

Machine Learning · Computer Science 2025-10-20 Tengjie Zheng , Haipeng Chen , Lin Cheng , Shengping Gong , Xu Huang

In speech emotion recognition tasks, models learn emotional representations from datasets. We find the data distribution in the IEMOCAP dataset is very imbalanced, which may harm models to learn a better representation. To address this…

Sound · Computer Science 2023-02-20 Xuefeng Liang , Hexin Jiang , Wenxin Xu , Ying Zhou

We consider the estimation of an i.i.d. (possibly non-Gaussian) vector $\xbf \in \R^n$ from measurements $\ybf \in \R^m$ obtained by a general cascade model consisting of a known linear transform followed by a probabilistic componentwise…

Information Theory · Computer Science 2012-12-04 Ulugbek S. Kamilov , Sundeep Rangan , Alyson K. Fletcher , Michael Unser