English
Related papers

Related papers: Multitask Gaussian Process with Hierarchical Laten…

200 papers

Modern engineering and scientific workflows often require simultaneous predictions across related tasks and fidelity levels, where high-fidelity data is scarce and expensive, while low-fidelity data is more abundant. This paper introduces…

A latent function decomposition method is proposed for forecasting the capacity of lithium-ion battery cells. The method uses the Multi-Output Gaussian Process, a generative machine learning framework for multi-task and transfer learning.…

Signal Processing · Electrical Eng. & Systems 2021-12-28 Abdallah A. Chehade , Ala A. Hussein

Early approaches to multiple-output Gaussian processes (MOGPs) relied on linear combinations of independent, latent, single-output Gaussian processes (GPs). This resulted in cross-covariance functions with limited parametric interpretation,…

Machine Learning · Statistics 2017-11-07 Gabriel Parra , Felipe Tobar

Neural Processes (NPs) consider a task as a function realized from a stochastic process and flexibly adapt to unseen tasks through inference on functions. However, naive NPs can model data from only a single stochastic process and are…

Machine Learning · Computer Science 2022-03-28 Donggyun Kim , Seongwoong Cho , Wonkwang Lee , Seunghoon Hong

Multi-output Gaussian processes (MOGPs) are an extension of Gaussian Processes (GPs) for predicting multiple output variables (also called channels, tasks) simultaneously. In this paper we use the convolution theorem to design a new kernel…

Machine Learning · Computer Science 2021-10-11 Kai Chen , Twan van Laarhoven , Perry Groot , Jinsong Chen , Elena Marchiori

Studying the complex interactions between different brain regions is crucial in neuroscience. Various statistical methods have explored the latent communication across multiple brain regions. Two main categories are the Gaussian Process…

Neurons and Cognition · Quantitative Biology 2024-05-31 Weihan Li , Chengrui Li , Yule Wang , Anqi Wu

We generalize the log Gaussian Cox process (LGCP) framework to model multiple correlated point data jointly. The observations are treated as realizations of multiple LGCPs, whose log intensities are given by linear combinations of latent…

Machine Learning · Statistics 2019-03-18 Virginia Aglietti , Theodoros Damoulas , Edwin Bonilla

We propose a representation of Gaussian processes (GPs) based on powers of the integral operator defined by a kernel function, we call these stochastic processes integral Gaussian processes (IGPs). Sample paths from IGPs are functions…

Machine Learning · Statistics 2019-03-08 Zilong Tan , Sayan Mukherjee

Despite the widespread utilization of Gaussian process models for versatile nonparametric modeling, they exhibit limitations in effectively capturing abrupt changes in function smoothness and accommodating relationships with heteroscedastic…

Machine Learning · Statistics 2023-09-01 Taehee Lee , Jun S. Liu

We present a novel extension of multi-output Gaussian processes for handling heterogeneous outputs. We assume that each output has its own likelihood function and use a vector-valued Gaussian process prior to jointly model the parameters in…

Machine Learning · Statistics 2019-01-04 Pablo Moreno-Muñoz , Antonio Artés-Rodríguez , Mauricio A. Álvarez

Gaussian processes (GPs) are pervasive in functional data analysis, machine learning, and spatial statistics for modeling complex dependencies. Modern scientific data sets are typically heterogeneous and often contain multiple known…

Methodology · Statistics 2021-10-19 Didong Li , Andrew Jones , Sudipto Banerjee , Barbara E. Engelhardt

Recent advances in Deep Gaussian Processes (DGPs) show the potential to have more expressive representation than that of traditional Gaussian Processes (GPs). However, there exists a pathology of deep Gaussian processes that their learning…

Machine Learning · Computer Science 2020-12-22 Anh Tong , Jaesik Choi

The multi-output Gaussian process ($\mathcal{MGP}$) is based on the assumption that outputs share commonalities, however, if this assumption does not hold negative transfer will lead to decreased performance relative to learning outputs…

Machine Learning · Statistics 2023-07-04 Moyan Li , Raed Kontar

Various data mining tasks have been proposed to study Community Question Answering (CQA) platforms like Stack Overflow. The relatedness between some of these tasks provides useful learning signals to each other via Multi-Task Learning…

Computation and Language · Computer Science 2021-10-06 Zizheng Lin , Haowen Ke , Ngo-Yin Wong , Jiaxin Bai , Yangqiu Song , Huan Zhao , Junpeng Ye

Recently there has been an increasing interest in the multivariate Gaussian process (MGP) which extends the Gaussian process (GP) to deal with multiple outputs. One approach to construct the MGP and account for non-trivial commonalities…

Machine Learning · Statistics 2023-07-04 Raed Kontar , Garvesh Raskutti , Shiyu Zhou

Multimodal learning combines multiple data modalities, broadening the types and complexity of data our models can utilize: for example, from plain text to image-caption pairs. Most multimodal learning algorithms focus on modeling simple…

Artificial Intelligence · Computer Science 2023-10-13 Minji Yoon , Jing Yu Koh , Bryan Hooi , Ruslan Salakhutdinov

Multi-Output Gaussian Processes (MOGPs) provide a principled probabilistic framework for modelling correlated outputs but face scalability bottlenecks when applied to datasets with high-dimensional output spaces. To maintain tractability,…

Machine Learning · Computer Science 2026-05-29 Xiaoyu Jiang , Xinxing Shi , Sokratia Georgaka , Magnus Rattray , Mauricio A Álvarez

Additive Gaussian process (GP) models offer flexible tools for modelling complex non-linear relationships and interaction effects among covariates. While most studies have focused on predictive performance, relatively little attention has…

Methodology · Statistics 2025-10-30 Sahoko Ishida , Francesca Panero , Wicher Bergsma

We consider evidence integration from potentially dependent observation processes under varying spatio-temporal sampling resolutions and noise levels. We develop a multi-resolution multi-task (MRGP) framework while allowing for both…

Machine Learning · Statistics 2019-11-06 Oliver Hamelijnck , Theodoros Damoulas , Kangrui Wang , Mark Girolami

Often in machine learning, data are collected as a combination of multiple conditions, e.g., the voice recordings of multiple persons, each labeled with an ID. How could we build a model that captures the latent information related to these…

Machine Learning · Statistics 2017-05-30 Zhenwen Dai , Mauricio A. Álvarez , Neil D. Lawrence