English
Related papers

Related papers: Transformed Latent Variable Multi-Output Gaussian …

200 papers

Early approaches to multiple-output Gaussian processes (MOGPs) relied on linear combinations of independent, latent, single-output Gaussian processes (GPs). This resulted in cross-covariance functions with limited parametric interpretation,…

Machine Learning · Statistics 2017-11-07 Gabriel Parra , Felipe Tobar

We introduce a novel kernel that models input-dependent couplings across multiple latent processes. The pairwise joint kernel measures covariance along inputs and across different latent signals in a mutually-dependent fashion. A latent…

Machine Learning · Statistics 2017-10-04 Sami Remes , Markus Heinonen , Samuel Kaski

The Gaussian process state-space model (GPSSM) has attracted extensive attention for modeling complex nonlinear dynamical systems. However, the existing GPSSM employs separate Gaussian processes (GPs) for each latent state dimension,…

Machine Learning · Computer Science 2023-09-06 Zhidi Lin , Juan Maroñas , Ying Li , Feng Yin , Sergios Theodoridis

This paper presents a novel extension of multi-task Gaussian Cox processes for modeling multiple heterogeneous correlated tasks jointly, e.g., classification and regression, via multi-output Gaussian processes (MOGP). A MOGP prior over the…

Machine Learning · Computer Science 2023-08-30 Feng Zhou , Quyu Kong , Zhijie Deng , Fengxiang He , Peng Cui , Jun Zhu

In learning from demonstrations, it is often desirable to adapt the behavior of the robot as a function of the variability retrieved from human demonstrations and the (un)certainty encoded in different parts of the task. In this paper, we…

Robotics · Computer Science 2019-10-14 Noémie Jaquier , David Ginsbourger , Sylvain Calinon

This paper explores a federated learning approach that automatically selects the number of latent processes in multi-output Gaussian processes (MGPs). The MGP has seen great success as a transfer learning tool when data is generated from…

Machine Learning · Statistics 2024-07-25 Jingyi Gao , Seokhyun Chung

Multi-output Gaussian process (MGP) is commonly used as a transfer learning method to leverage information among multiple outputs. A key advantage of MGP is providing uncertainty quantification for prediction, which is highly important for…

Machine Learning · Statistics 2024-09-06 Wang Xinming , Li Yongxiang , Yue Xiaowei , Wu Jianguo

The Gaussian Process Latent Variable Model (GP-LVM) is a non-linear probabilistic method of embedding a high dimensional dataset in terms low dimensional `latent' variables. In this paper we illustrate that maximum a posteriori (MAP)…

Machine Learning · Statistics 2013-07-02 James Barrett , Anthony C. C. Coolen

For natural frequency optimization of engineering structures, cellular composites have been shown to possess an edge over solid. However, existing multiscale design methods for cellular composites are either computationally exhaustive or…

Computational Engineering, Finance, and Science · Computer Science 2021-06-14 Liwei Wang , Anton van Beek , Daicong Da , Yu-Chin Chan , Ping Zhu , Wei Chen

Multi-task Gaussian process (MTGP) is a well-known non-parametric Bayesian model for learning correlated tasks effectively by transferring knowledge across tasks. But current MTGPs are usually limited to the multi-task scenario defined in…

Machine Learning · Statistics 2024-10-28 Haitao Liu , Kai Wu , Yew-Soon Ong , Chao Bian , Xiaomo Jiang , Xiaofang Wang

The Gaussian process latent variable model (GP-LVM) is a popular approach to non-linear probabilistic dimensionality reduction. One design choice for the model is the number of latent variables. We present a spike and slab prior for the…

Machine Learning · Statistics 2015-05-12 Zhenwen Dai , James Hensman , Neil Lawrence

We introduce a novel stochastic variational inference method for Gaussian process ($\mathcal{GP}$) regression, by deriving a posterior over a learnable set of coresets: i.e., over pseudo-input/output, weighted pairs. Unlike former free-form…

Machine Learning · Computer Science 2025-03-06 Mert Ketenci , Adler Perotte , Noémie Elhadad , Iñigo Urteaga

We introduce a framework and early results for massively scalable Gaussian processes (MSGP), significantly extending the KISS-GP approach of Wilson and Nickisch (2015). The MSGP framework enables the use of Gaussian processes (GPs) on…

Machine Learning · Computer Science 2015-11-06 Andrew Gordon Wilson , Christoph Dann , Hannes Nickisch

For a learning task, Gaussian process (GP) is interested in learning the statistical relationship between inputs and outputs, since it offers not only the prediction mean but also the associated variability. The vanilla GP however struggles…

Machine Learning · Statistics 2020-09-01 Haitao Liu , Yew-Soon Ong , Xiaomo Jiang , Xiaofang Wang

We present a novel extension of multi-output Gaussian processes for handling heterogeneous outputs. We assume that each output has its own likelihood function and use a vector-valued Gaussian process prior to jointly model the parameters in…

Machine Learning · Statistics 2019-01-04 Pablo Moreno-Muñoz , Antonio Artés-Rodríguez , Mauricio A. Álvarez

The interpretation of complex high-dimensional data typically requires the use of dimensionality reduction techniques to extract explanatory low-dimensional representations. However, in many real-world problems these representations may not…

Machine Learning · Statistics 2019-06-25 Kaspar Märtens , Kieran R. Campbell , Christopher Yau

We introduce Latent Gaussian Process Regression which is a latent variable extension allowing modelling of non-stationary multi-modal processes using GPs. The approach is built on extending the input space of a regression problem with a…

Machine Learning · Statistics 2017-09-19 Erik Bodin , Neill D. F. Campbell , Carl Henrik Ek

Accurate time series forecasting is crucial for optimizing resource allocation, industrial production, and urban management, particularly with the growth of cyber-physical and IoT systems. However, limited training sample availability in…

Machine Learning · Computer Science 2025-06-24 Yunyao Cheng , Chenjuan Guo , Kaixuan Chen , Kai Zhao , Bin Yang , Jiandong Xie , Christian S. Jensen , Feiteng Huang , Kai Zheng

This work introduces the Efficient Transformed Gaussian Process (ETGP), a new way of creating C stochastic processes characterized by: 1) the C processes are non-stationary, 2) the C processes are dependent by construction without needing a…

Machine Learning · Computer Science 2022-06-01 Juan Maroñas , Daniel Hernández-Lobato

The Gaussian process latent variable model (GP-LVM) provides a flexible approach for non-linear dimensionality reduction that has been widely applied. However, the current approach for training GP-LVMs is based on maximum likelihood, where…

Machine Learning · Statistics 2014-09-09 Andreas C. Damianou , Michalis K. Titsias , Neil D. Lawrence