English
Related papers

Related papers: Hierarchical additive interaction modelling with G…

200 papers

A network of independently trained Gaussian processes (StackedGP) is introduced to obtain predictions of quantities of interest with quantified uncertainties. The main applications of the StackedGP framework are to integrate different…

Machine Learning · Computer Science 2017-06-20 Kareem Abdelfatah , Junshu Bao , Gabriel Terejanu

Gaussian processes (GPs) are an attractive class of machine learning models because of their simplicity and flexibility as building blocks of more complex Bayesian models. Meanwhile, graph neural networks (GNNs) emerged recently as a…

Machine Learning · Computer Science 2023-02-14 Zehao Niu , Mihai Anitescu , Jie Chen

A key task in AutoML is to model learning curves of machine learning models jointly as a function of model hyper-parameters and training progression. While Gaussian processes (GPs) are suitable for this task, na\"ive GPs require…

Machine Learning · Computer Science 2024-10-15 Jihao Andreas Lin , Sebastian Ament , Maximilian Balandat , Eytan Bakshy

Multi-output Gaussian processes (MOGPs) have been introduced to deal with multiple tasks by exploiting the correlations between different outputs. Generally, MOGPs models assume a flat correlation structure between the outputs. However,…

Machine Learning · Computer Science 2023-09-01 Chunchao Ma , Arthur Leroy , Mauricio Alvarez

Deep Gaussian Processes (DGPs) were proposed as an expressive Bayesian model capable of a mathematically grounded estimation of uncertainty. The expressivity of DPGs results from not only the compositional character but the distribution…

Machine Learning · Computer Science 2021-11-23 Chi-Ken Lu , Patrick Shafto

We make use of Kronecker structure for scaling Gaussian Process models to large-scale, heterogeneous, clinical data sets. Repeated measures, commonly performed in clinical research, facilitate computational acceleration for nonlinear…

Methodology · Statistics 2024-08-29 Owen Thomas , Leiv Rønneberg

Graph neural networks are often used to model interacting dynamical systems since they gracefully scale to systems with a varying and high number of agents. While there has been much progress made for deterministic interacting systems,…

Machine Learning · Computer Science 2023-05-04 Andreas Look , Melih Kandemir , Barbara Rakitsch , Jan Peters

We present a framework for transfer learning based on modular variational Gaussian processes (GP). We develop a module-based method that having a dictionary of well fitted GPs, one could build ensemble GP models without revisiting any data.…

Machine Learning · Statistics 2021-10-27 Pablo Moreno-Muñoz , Antonio Artés-Rodríguez , Mauricio A. Álvarez

Optimizing wheat variety selection for high performance in different environmental conditions is critical for reliable food production and stable incomes for growers. We employ a statistical machine learning framework utilizing Gaussian…

In this paper, we critically examine the prevalent practice of using additive mixtures of Mat\'ern kernels in single-output Gaussian process (GP) models and explore the properties of multiplicative mixtures of Mat\'ern kernels for…

Machine Learning · Statistics 2023-10-27 Jiawen Chen , Wancen Mu , Yun Li , Didong Li

We develop a flexible Gaussian Process (GP) framework for learning the covariance structure of Age- and Year-specific mortality surfaces. Utilizing the additive and multiplicative structure of GP kernels, we design a genetic programming…

Machine Learning · Statistics 2024-11-20 Mike Ludkovski , Jimmy Risk

It is desirable to combine the expressive power of deep learning with Gaussian Process (GP) in one expressive Bayesian learning model. Deep kernel learning showed success in adopting a deep network for feature extraction followed by a GP…

Machine Learning · Computer Science 2021-10-26 Chi-Ken Lu , Patrick Shafto

Gaussian Processes (GPs) are powerful non-parametric Bayesian regression models that allow exact posterior inference, but exhibit high computational and memory costs. In order to improve scalability of GPs, approximate posterior inference…

Machine Learning · Computer Science 2020-04-28 Martin Trapp , Robert Peharz , Franz Pernkopf , Carl E. Rasmussen

Multi-output regression models must exploit dependencies between outputs to maximise predictive performance. The application of Gaussian processes (GPs) to this setting typically yields models that are computationally demanding and have…

Machine Learning · Statistics 2019-02-27 James Requeima , Will Tebbutt , Wessel Bruinsma , Richard E. Turner

We propose a method (TT-GP) for approximate inference in Gaussian Process (GP) models. We build on previous scalable GP research including stochastic variational inference based on inducing inputs, kernel interpolation, and structure…

Machine Learning · Computer Science 2018-01-18 Pavel Izmailov , Alexander Novikov , Dmitry Kropotov

Off-the-shelf Gaussian Process (GP) covariance functions encode smoothness assumptions on the structure of the function to be modeled. To model complex and non-differentiable functions, these smoothness assumptions are often too…

Machine Learning · Statistics 2016-04-12 Roberto Calandra , Jan Peters , Carl Edward Rasmussen , Marc Peter Deisenroth

Graphical models are commonly used to represent conditional dependence relationships between variables. There are multiple methods available for exploring them from high-dimensional data, but almost all of them rely on the assumption that…

Machine Learning · Statistics 2020-04-22 Tianxi Li , Cheng Qian , Elizaveta Levina , Ji Zhu

Gaussian Process (GP) models are a powerful tool in probabilistic machine learning with a solid theoretical foundation. Thanks to current advances, modeling complex data with GPs is becoming increasingly feasible, which makes them an…

Machine Learning · Computer Science 2025-03-04 Sarem Seitz

In recent years, causal modelling has been used widely to improve generalization and to provide interpretability in machine learning models. To determine cause-effect relationships in the absence of a randomized trial, we can model causal…

Machine Learning · Computer Science 2021-06-03 Rohan Giriraj , Sinnu Susan Thomas

We propose principled Gaussian processes (GPs) for modeling functions defined over the edge set of a simplicial 2-complex, a structure similar to a graph in which edges may form triangular faces. This approach is intended for learning…

Machine Learning · Statistics 2024-03-05 Maosheng Yang , Viacheslav Borovitskiy , Elvin Isufi