English
Related papers

Related papers: Variational Latent Gaussian Process for Recovering…

200 papers

This paper presents an efficient variational inference framework for deriving a family of structured gaussian process regression network (SGPRN) models. The key idea is to incorporate auxiliary inducing variables in latent functions and…

Machine Learning · Computer Science 2021-11-19 Rui Meng , Herbie Lee , Kristofer Bouchard

Planning is a powerful approach to control problems with known environment dynamics. In unknown environments the agent needs to learn a model of the system dynamics to make planning applicable. This is particularly challenging when the…

Machine Learning · Computer Science 2020-05-11 Nathanael Bosch , Jan Achterhold , Laura Leal-Taixé , Jörg Stückler

We propose a method (TT-GP) for approximate inference in Gaussian Process (GP) models. We build on previous scalable GP research including stochastic variational inference based on inducing inputs, kernel interpolation, and structure…

Machine Learning · Computer Science 2018-01-18 Pavel Izmailov , Alexander Novikov , Dmitry Kropotov

Studying the complex interactions between different brain regions is crucial in neuroscience. Various statistical methods have explored the latent communication across multiple brain regions. Two main categories are the Gaussian Process…

Neurons and Cognition · Quantitative Biology 2024-05-31 Weihan Li , Chengrui Li , Yule Wang , Anqi Wu

Recent advances in the estimation of deep directed graphical models and recurrent networks let us contribute to the removal of a blind spot in the area of probabilistc modelling of time series. The proposed methods i) can infer distributed…

Machine Learning · Statistics 2014-10-01 Justin Bayer , Christian Osendorfer

Gaussian processes (GPs) are a powerful tool for probabilistic inference over functions. They have been applied to both regression and non-linear dimensionality reduction, and offer desirable properties such as uncertainty estimates,…

Machine Learning · Statistics 2014-10-01 Yarin Gal , Mark van der Wilk , Carl E. Rasmussen

Multi-output Gaussian process (MGP) is commonly used as a transfer learning method to leverage information among multiple outputs. A key advantage of MGP is providing uncertainty quantification for prediction, which is highly important for…

Machine Learning · Statistics 2024-09-06 Wang Xinming , Li Yongxiang , Yue Xiaowei , Wu Jianguo

High dimensional time series are endemic in applications of machine learning such as robotics (sensor data), computational biology (gene expression data), vision (video sequences) and graphics (motion capture data). Practical nonlinear…

Machine Learning · Statistics 2011-07-26 Andreas C. Damianou , Michalis K. Titsias , Neil D. Lawrence

We cast motion planning under uncertainty as a stochastic optimal control problem, where the optimal posterior distribution has an explicit form. To approximate this posterior, this work frames an optimization problem in the space of…

Robotics · Computer Science 2026-01-06 Zinuo Chang , Hongzhe Yu , Patricio Vela , Yongxin Chen

In this tutorial we explain the inference procedures developed for the sparse Gaussian process (GP) regression and Gaussian process latent variable model (GPLVM). Due to page limit the derivation given in Titsias (2009) and Titsias &…

Machine Learning · Statistics 2014-10-01 Yarin Gal , Mark van der Wilk

The Gaussian process (GP) is a powerful tool for nonparametric modeling, but its sensitivity to outliers limits its applicability to data distributions with heavy-tails. Studentt processes offer a robust alternative for heavy tail modeling,…

Machine Learning · Computer Science 2026-03-11 Jian Xu , Delu Zeng , John Paisley

The combination of new recording techniques in neuroscience and powerful inference methods recently held the promise to recover useful effective models, at the single neuron or network level, directly from observed data. The value of a…

Neurons and Cognition · Quantitative Biology 2018-04-09 Cristiano Capone , Guido Gigante , Paolo Del Giudice

The development of robust generative models for highly varied non-stationary time series data is a complex yet important problem. Traditional models for time series data prediction, such as Long Short-Term Memory (LSTM), are inefficient and…

Machine Learning · Computer Science 2024-11-18 Anton Johansson , Arunselvan Ramaswamy

A body of recent work in modeling neural activity focuses on recovering low-dimensional latent features that capture the statistical structure of large-scale neural populations. Most such approaches have focused on linear generative models,…

Neurons and Cognition · Quantitative Biology 2016-10-26 Yuanjun Gao , Evan Archer , Liam Paninski , John P. Cunningham

Gaussian processes (GPs) are ubiquitously used in sciences and engineering as metamodels. Standard GPs, however, can only handle numerical or quantitative variables. In this paper, we introduce latent map Gaussian processes (LMGPs) that…

Machine Learning · Statistics 2021-10-13 Nicholas Oune , Ramin Bostanabad

The partially observable generalized linear model (POGLM) is a powerful tool for understanding neural connectivity under the assumption of existing hidden neurons. With spike trains only recorded from visible neurons, existing works use…

Machine Learning · Computer Science 2024-02-08 Chengrui Li , Weihan Li , Yule Wang , Anqi Wu

A variational inference-based framework for training a multi-output Gaussian process latent variable model, specifically tailored to the tails-up spatio-temporal stream network, is developed. Training, given a censored observational data…

Methodology · Statistics 2026-05-21 Marno Basson , Tobias M. Louw , Theresa R. Smith

We address the problem of continual learning in multi-task Gaussian process (GP) models for handling sequential input-output observations. Our approach extends the existing prior-posterior recursion of online Bayesian inference, i.e.\ past…

Machine Learning · Statistics 2019-11-04 Pablo Moreno-Muñoz , Antonio Artés-Rodríguez , Mauricio A. Álvarez

Gaussian process (GP) surrogate modeling for large computer experiments is limited by cubic runtimes, especially with data from stochastic simulations with input-dependent noise. A popular workaround to reduce computational complexity…

Methodology · Statistics 2022-06-01 D Austin Cole , Robert B Gramacy , Mike Ludkovski

With the advent of artificial intelligence and machine learning, various domains of science and engineering communities have leveraged data-driven surrogates to model complex systems through fusing numerous sources of information (data)…