English
Related papers

Related papers: Aligned Multi-Task Gaussian Process

200 papers

Multi-task regression attempts to exploit the task similarity in order to achieve knowledge transfer across related tasks for performance improvement. The application of Gaussian process (GP) in this scenario yields the non-parametric yet…

Machine Learning · Statistics 2021-09-21 Haitao Liu , Jiaqi Ding , Xinyu Xie , Xiaomo Jiang , Yusong Zhao , Xiaofang Wang

Machine learning models can be improved by adapting them to respect existing background knowledge. In this paper we consider multitask Gaussian processes, with background knowledge in the form of constraints that require a specific sum of…

Machine Learning · Statistics 2023-02-02 Philipp Pilar , Carl Jidling , Thomas B. Schön , Niklas Wahlström

Multi-task/Multi-output learning seeks to exploit correlation among tasks to enhance performance over learning or solving each task independently. In this paper, we investigate this problem in the context of Gaussian Processes (GPs) and…

Machine Learning · Statistics 2018-05-10 Weitong Ruan , Eric L. Miller

This paper presents a novel extension of multi-task Gaussian Cox processes for modeling multiple heterogeneous correlated tasks jointly, e.g., classification and regression, via multi-output Gaussian processes (MOGP). A MOGP prior over the…

Machine Learning · Computer Science 2023-08-30 Feng Zhou , Quyu Kong , Zhijie Deng , Fengxiang He , Peng Cui , Jun Zhu

Accurate forecasting of multivariate time series data is important in many engineering and scientific applications. Recent state-of-the-art works ignore the inter-relations between variates, using their model on each variate independently.…

Machine Learning · Computer Science 2025-03-18 Liran Nochumsohn , Hedi Zisling , Omri Azencot

Time series analysis has emerged as an important tool for improving patient diagnosis and management in healthcare applications. However, these applications commonly face two critical challenges: time misalignment and data sparsity.…

Machine Learning · Statistics 2025-09-25 Dohyun Ku , Catherine D. Chong , Visar Berisha , Todd J. Schwedt , Jing Li

In this paper, we introduce a novel theoretical framework for multi-task regression, applying random matrix theory to provide precise performance estimations, under high-dimensional, non-Gaussian data distributions. We formulate a…

In this paper, we present a kernel-based, multi-task Gaussian Process (GP) model for approximating the underlying function of an individual's mobility state using a time-inhomogeneous Markov Process with two states: moves and pauses. Our…

Machine Learning · Statistics 2023-06-22 Ekin Ugurel

Learning-based techniques are increasingly effective at controlling complex systems using data-driven models. However, most work done so far has focused on learning individual tasks or control laws. Hence, it is still a largely unaddressed…

Systems and Control · Electrical Eng. & Systems 2020-05-08 Alexandre Capone , Armin Lederer , Jonas Umlauft , Sandra Hirche

Non-stationary time series with non-linear trends are frequently encountered in applications. We consider here the feasibility of accurately forecasting the signals of multiple such time series considering jointly when the number of…

Methodology · Statistics 2016-08-05 Kerry Fendick

We propose a new method for automatically detecting monotonic input-output relationships from data using Gaussian Process (GP) models with virtual derivative observations. Our results on synthetic and real datasets show that the proposed…

Methodology · Statistics 2016-10-19 Eero Siivola , Juho Piironen , Aki Vehtari

Robots performing manipulation tasks must operate under uncertainty about both their pose and the dynamics of the system. In order to remain robust to modeling error and shifts in payload dynamics, agents must simultaneously perform…

Systems and Control · Computer Science 2017-07-31 Patrick Slade , Preston Culbertson , Zachary Sunberg , Mykel Kochenderfer

We propose probabilistic task modelling -- a generative probabilistic model for collections of tasks used in meta-learning. The proposed model combines variational auto-encoding and latent Dirichlet allocation to model each task as a…

Machine Learning · Computer Science 2022-03-21 Cuong C. Nguyen , Thanh-Toan Do , Gustavo Carneiro

We consider inference for misaligned multivariate functional data that represents the same underlying curve, but where the functional samples have systematic differences in shape. In this paper we introduce a new class of generally…

Applications · Statistics 2023-01-23 Niels Lundtorp Olsen , Bo Markussen , Lars Lau Rakêt

Multi-output Gaussian process (MGP) is commonly used as a transfer learning method to leverage information among multiple outputs. A key advantage of MGP is providing uncertainty quantification for prediction, which is highly important for…

Machine Learning · Statistics 2024-09-06 Wang Xinming , Li Yongxiang , Yue Xiaowei , Wu Jianguo

Multi-agent mapping is a fundamentally important capability for autonomous robot task coordination and execution in complex environments. While successful algorithms have been proposed for mapping using individual platforms, cooperative…

Robotics · Computer Science 2021-10-14 James Di , Ehsan Zobeidi , Alec Koppel , Nikolay Atanasov

We address the problem of continual learning in multi-task Gaussian process (GP) models for handling sequential input-output observations. Our approach extends the existing prior-posterior recursion of online Bayesian inference, i.e.\ past…

Machine Learning · Statistics 2019-11-04 Pablo Moreno-Muñoz , Antonio Artés-Rodríguez , Mauricio A. Álvarez

Recent advances in the field of meta-learning have tackled domains consisting of large numbers of small ("few-shot") supervised learning tasks. Meta-learning algorithms must be able to rapidly adapt to any individual few-shot task, fitting…

Machine Learning · Computer Science 2021-10-22 Vivek Myers , Nikhil Sardana

We consider evidence integration from potentially dependent observation processes under varying spatio-temporal sampling resolutions and noise levels. We develop a multi-resolution multi-task (MRGP) framework while allowing for both…

Machine Learning · Statistics 2019-11-06 Oliver Hamelijnck , Theodoros Damoulas , Kangrui Wang , Mark Girolami

We develop an automated variational method for inference in models with Gaussian process (GP) priors and general likelihoods. The method supports multiple outputs and multiple latent functions and does not require detailed knowledge of the…

Machine Learning · Statistics 2018-11-06 Edwin V. Bonilla , Karl Krauth , Amir Dezfouli