English
Related papers

Related papers: Output-Dependent Gaussian Process State-Space Mode…

200 papers

Probabilistic inference in high-dimensional state-space models is computationally challenging. For many spatiotemporal systems, however, prior knowledge about the dependency structure of state variables is available. We leverage this…

Machine Learning · Computer Science 2024-08-09 Fiona Lippert , Bart Kranstauber , E. Emiel van Loon , Patrick Forré

Gaussian process (GP) regression has been widely used in supervised machine learning due to its flexibility and inherent ability to describe uncertainty in function estimation. In the context of control, it is seeing increasing use for…

Systems and Control · Computer Science 2020-01-01 Lukas Hewing , Juraj Kabzan , Melanie N. Zeilinger

In nonlinear latent variable models or dynamic models, if we consider the latent variables as confounders (common causes), the noise dependencies imply further relations between the observed variables. Such models are then closely related…

Machine Learning · Computer Science 2012-03-19 Kun Zhang , Bernhard Schoelkopf , Dominik Janzing

In Gaussian graphical models, conditional independence and partial correlations are natural inferential targets for understanding direct relationships in multivariate data. No comparable framework exists for spatial processes, where…

Methodology · Statistics 2026-04-14 Michele Peruzzi

We provide a comprehensive overview and tooling for GP modeling with non-Gaussian likelihoods using state space methods. The state space formulation allows for solving one-dimensional GP models in $\mathcal{O}(n)$ time and memory…

Machine Learning · Statistics 2018-07-06 Hannes Nickisch , Arno Solin , Alexander Grigorievskiy

We introduce a Bayesian Gaussian process latent variable model that explicitly captures spatial correlations in data using a parameterized spatial kernel and leveraging structure-exploiting algebra on the model covariance matrices for…

Machine Learning · Statistics 2018-05-23 Steven Atkinson , Nicholas Zabaras

Multi-output Gaussian Processes provide principled uncertainty-aware learning of vector-valued fields but are difficult to deploy in large-scale, distributed, and streaming settings due to their computational and centralized nature. This…

Machine Learning · Computer Science 2026-04-14 Yogesh Prasanna Kumar Rao , Tamas Keviczky , Raj Thilak Rajan

Many modern time-series datasets contain large numbers of output response variables sampled for prolonged periods of time. For example, in neuroscience, the activities of 100s-1000's of neurons are recorded during behaviors and in response…

Machine Learning · Computer Science 2022-03-15 Rui Meng , Kristofer Bouchard

Gaussian process latent variable models (GPLVM) are a flexible and non-linear approach to dimensionality reduction, extending classical Gaussian processes to an unsupervised learning context. The Bayesian incarnation of the GPLVM Titsias…

Machine Learning · Computer Science 2022-10-31 Vidhi Lalchand , Aditya Ravuri , Neil D. Lawrence

Markov chain Monte Carlo (MCMC) allows one to generate dependent replicates from a posterior distribution for effectively any Bayesian hierarchical model. However, MCMC can produce a significant computational burden. This motivates us to…

Methodology · Statistics 2023-05-22 Jonathan R. Bradley , Madelyn Clinch

Classification is a vital tool that is important for modelling many complex numerical models. A model or system may be such that, for certain areas of input space, the output either does not exist, or is not in a quantifiable form. Here, we…

Methodology · Statistics 2020-02-04 Louise Kimpton , Peter Challenor , Daniel Williamson

This tutorial provides a systematic introduction to Gaussian process learning-based model predictive control (GP-MPC), an advanced approach integrating Gaussian process (GP) with model predictive control (MPC) for enhanced control in…

Robotics · Computer Science 2024-04-08 Jie Wang , Youmin Zhang

Gaussian process (GP) regression with 1D inputs can often be performed in linear time via a stochastic differential equation formulation. However, for non-Gaussian likelihoods, this requires application of approximate inference methods…

Machine Learning · Computer Science 2020-07-20 Paul E. Chang , William J. Wilkinson , Mohammad Emtiyaz Khan , Arno Solin

We compute probabilistic controlled invariant sets for nonlinear systems using Gaussian process state space models, which are data-driven models that account for unmodeled and unknown nonlinear dynamics. We propose a semidefinite…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Paul Griffioen , Bingzhuo Zhong , Murat Arcak , Majid Zamani , Marco Caccamo

In this paper we introduce a novel online time series forecasting model we refer to as the pM-GP filter. We show that our model is equivalent to Gaussian process regression, with the advantage that both online forecasting and online…

Machine Learning · Statistics 2015-10-13 Yves-Laurent Kom Samo , Stephen J. Roberts

State space models (SSMs) are a flexible approach to modeling complex time series. However, inference in SSMs is often computationally prohibitive for long time series. Stochastic gradient MCMC (SGMCMC) is a popular method for scalable…

Machine Learning · Statistics 2019-07-11 Christopher Aicher , Yi-An Ma , Nicholas J. Foti , Emily B. Fox

This paper deals with the problem of adaptive output regulation for multivariable nonlinear systems by presenting a learning-based adaptive internal model-based design strategy. The approach builds on the recently proposed adaptive internal…

Systems and Control · Electrical Eng. & Systems 2022-10-31 Lorenzo Gentilini , Michelangelo Bin , Lorenzo Marconi

Gaussian processes (GPs) are frequently used in machine learning and statistics to construct powerful models. However, when employing GPs in practice, important considerations must be made, regarding the high computational burden,…

Computation · Statistics 2021-03-08 Karla Monterrubio-Gómez , Sara Wade

Dependent generalized extreme value (dGEV) models have attracted much attention due to the dependency structure that often appears in real datasets. To construct a dGEV model, a natural approach is to assume that some parameters in the…

Methodology · Statistics 2017-03-06 Bo Ning , Peter Bloomfield

Learning of low dimensional structure in multidimensional data is a canonical problem in machine learning. One common approach is to suppose that the observed data are close to a lower-dimensional smooth manifold. There are a rich variety…

Machine Learning · Statistics 2015-06-12 Ye Wang , David B. Dunson