English
Related papers

Related papers: Multitask Gaussian Process with Hierarchical Laten…

200 papers

Multitask learning (MTL) aims to develop a unified model that can handle a set of closely related tasks simultaneously. By optimizing the model across multiple tasks, MTL generally surpasses its non-MTL counterparts in terms of…

Machine Learning · Computer Science 2023-10-11 Chin-Chia Michael Yeh , Xin Dai , Yan Zheng , Junpeng Wang , Huiyuan Chen , Yujie Fan , Audrey Der , Zhongfang Zhuang , Liang Wang , Wei Zhang

In multi-task learning (MTL), we improve the performance of key machine learning algorithms by training various tasks jointly. When the number of tasks is large, modeling task structure can further refine the task relationship model. For…

Machine Learning · Computer Science 2020-11-25 Xiangyu Niu , Yifan Sun , Jinyuan Sun

Deep Gaussian processes (DGPs) are popular surrogate models for complex nonstationary computer experiments. DGPs use one or more latent Gaussian processes (GPs) to warp the input space into a plausibly stationary regime, then use typical GP…

Methodology · Statistics 2025-12-23 Annie S. Booth

Multi-output Gaussian processes (GPs) are a flexible Bayesian nonparametric framework that has proven useful in jointly modeling the physiological states of patients in medical time series data. However, capturing the short-term effects of…

We study the average case performance of multi-task Gaussian process (GP) regression as captured in the learning curve, i.e. the average Bayes error for a chosen task versus the total number of examples $n$ for all tasks. For GP covariances…

Machine Learning · Computer Science 2012-11-05 Simon R. F. Ashton , Peter Sollich

We propose a novel Bayesian nonparametric method to learn translation-invariant relationships on non-Euclidean domains. The resulting graph convolutional Gaussian processes can be applied to problems in machine learning for which the input…

Machine Learning · Computer Science 2019-05-15 Ian Walker , Ben Glocker

We learn multiple hypotheses for related tasks under a latent hierarchical relationship between tasks. We exploit the intuition that for domain adaptation, we wish to share classifier structure, but for multitask learning, we wish to share…

Machine Learning · Computer Science 2014-08-12 Hal Daume

We learn multiple hypotheses for related tasks under a latent hierarchical relationship between tasks. We exploit the intuition that for domain adaptation, we wish to share classifier structure, but for multitask learning, we wish to share…

Machine Learning · Computer Science 2009-07-07 Hal Daumé

Deep Gaussian Processes (DGP) are hierarchical generalizations of Gaussian Processes (GP) that have proven to work effectively on a multiple supervised regression tasks. They combine the well calibrated uncertainty estimates of GPs with the…

Machine Learning · Statistics 2018-01-10 Marton Havasi , José Miguel Hernández-Lobato , Juan José Murillo-Fuentes

In recent years, there has been considerable interest in developing machine learning models on graphs to account for topological inductive biases. In particular, recent attention has been given to Gaussian processes on such structures since…

Machine Learning · Computer Science 2024-08-20 Mathieu Alain , So Takao , Brooks Paige , Marc Peter Deisenroth

Graph convolutional networks have been widely used for skeleton-based action recognition due to their excellent modeling ability of non-Euclidean data. As the graph convolution is a local operation, it can only utilize the short-range joint…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Zhan Chen , Sicheng Li , Bing Yang , Qinghan Li , Hong Liu

Classical consensus-based strategies for federated and decentralized learning are statistically suboptimal in the presence of heterogeneous local data or task distributions. As a result, in recent years, there has been growing interest in…

Machine Learning · Computer Science 2025-10-14 Zirui Wan , Stefan Vlaski

Simultaneously solving multiple related learning tasks is beneficial under a variety of circumstances, but the prior knowledge necessary to correctly model task relationships is rarely available in practice. In this paper, we develop a…

Machine Learning · Computer Science 2013-07-02 Francesco Dinuzzo

Exploring the dynamic co-evolution of multiplex graphs and nodal attributes is a compelling question in criminal and terrorism networks. This article is motivated by the study of dynamically evolving interactions among prominent terrorist…

Applications · Statistics 2026-03-24 Jose Rodriguez-Acosta , Sharmistha Guha , Lekha Patel , Kurtis Shuler

We address the problem of continual learning in multi-task Gaussian process (GP) models for handling sequential input-output observations. Our approach extends the existing prior-posterior recursion of online Bayesian inference, i.e.\ past…

Machine Learning · Statistics 2019-11-04 Pablo Moreno-Muñoz , Antonio Artés-Rodríguez , Mauricio A. Álvarez

Graph Convolutional Networks (GCNs) have recently been shown to be quite successful in modeling graph-structured data. However, the primary focus has been on handling simple undirected graphs. Multi-relational graphs are a more general and…

Machine Learning · Computer Science 2020-01-22 Shikhar Vashishth , Soumya Sanyal , Vikram Nitin , Partha Talukdar

We introduce graph gamma process (GGP) linear dynamical systems to model real-valued multivariate time series. For temporal pattern discovery, the latent representation under the model is used to decompose the time series into a…

Methodology · Statistics 2020-07-28 Rahi Kalantari , Mingyuan Zhou

Signal processing over single-layer graphs has become a mainstream tool owing to its power in revealing obscure underlying structures within data signals. However, many real-life datasets and systems, {including those in Internet of Things…

Signal Processing · Electrical Eng. & Systems 2022-11-02 Songyang Zhang , Qinwen Deng , Zhi Ding

Despite remarkable progress in Multimodal Large Language Models (MLLMs), these models still struggle with fine-grained understanding tasks. In this work, we propose Procedurally Generated Tasks (PGT), a simple data-driven framework that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Rim Assouel , Amir Bar , Michal Drozdzal , Adriana Romero-Soriano

Multi-task learning models using Gaussian processes (GP) have been developed and successfully applied in various applications. The main difficulty with this approach is the computational cost of inference using the union of examples from…

Machine Learning · Computer Science 2012-11-29 Yuyang Wang , Roni Khardon