English
Related papers

Related papers: Spectral Mixture Kernels for Multi-Output Gaussian…

200 papers

Kernel models of potential energy surfaces (PES) for polyatomic molecules are often restricted by a specific choice of the kernel function. This can be avoided by optimizing the complexity of the kernel function. For regression problems…

Chemical Physics · Physics 2023-05-02 Jun Dai , Roman V. Krems

Gaussian Process (GP) regression is a powerful nonparametric Bayesian framework, but its performance depends critically on the choice of covariance kernel. Selecting an appropriate kernel is therefore central to model quality, yet remains…

Machine Learning · Computer Science 2026-01-14 Md Shafiqul Islam , Shakti Prasad Padhy , Douglas Allaire , Raymundo Arróyave

Gaussian process (GP) regression provides a flexible, nonparametric framework for probabilistic modeling, yet remains computationally demanding in large-scale applications. For one-dimensional data, state space (SS) models achieve…

Machine Learning · Statistics 2025-11-07 Liang Ding , Rui Tuo , Lu Zhou

This study proposes a novel framework for spectral unmixing by using 1D convolution kernels and spectral uncertainty. High-level representations are computed from data, and they are further modeled with the Multinomial Mixture Model to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Savas Ozkan , Gozde Bozdagi Akar

To reduce the curse of dimensionality for Gaussian processes (GP), they can be decomposed into a Gaussian Process Network (GPN) of coupled subprocesses with lower dimensionality. In some cases, intermediate observations are available within…

Machine Learning · Computer Science 2025-02-20 Saksham Kiroriwal , Julius Pfrommer , Jürgen Beyerer

The interpretation of complex high-dimensional data typically requires the use of dimensionality reduction techniques to extract explanatory low-dimensional representations. However, in many real-world problems these representations may not…

Machine Learning · Statistics 2019-06-25 Kaspar Märtens , Kieran R. Campbell , Christopher Yau

We introduce a family of multilayer graph kernels and establish new links between graph convolutional neural networks and kernel methods. Our approach generalizes convolutional kernel networks to graph-structured data, by representing…

Machine Learning · Statistics 2020-06-30 Dexiong Chen , Laurent Jacob , Julien Mairal

Optimizing wheat variety selection for high performance in different environmental conditions is critical for reliable food production and stable incomes for growers. We employ a statistical machine learning framework utilizing Gaussian…

Applying Gaussian processes (GPs) to very large datasets remains a challenge due to limited computational scalability. Matrix structures, such as the Kronecker product, can accelerate operations significantly, but their application commonly…

We introduce a framework and early results for massively scalable Gaussian processes (MSGP), significantly extending the KISS-GP approach of Wilson and Nickisch (2015). The MSGP framework enables the use of Gaussian processes (GPs) on…

Machine Learning · Computer Science 2015-11-06 Andrew Gordon Wilson , Christoph Dann , Hannes Nickisch

In this paper we propose a family of tractable kernels that is dense in the family of bounded positive semi-definite functions (i.e. can approximate any bounded kernel with arbitrary precision). We start by discussing the case of stationary…

Machine Learning · Statistics 2015-10-13 Yves-Laurent Kom Samo , Stephen Roberts

Coarse-grained simulations of conjugated polymers have become a popular way of investigating the device physics of organic photovoltaics. While UV-Vis spectroscopy remains one of key experimental methods for the interrogation of these…

Disordered Systems and Neural Networks · Physics 2019-09-10 Lena Simine , Thomas C. Allen , Peter J. Rossky

Deep Gaussian Processes (DGPs) are powerful surrogate models known for their flexibility and ability to capture complex functions. However, extending them to multi-output settings remains challenging due to the need for efficient dependency…

Machine Learning · Statistics 2025-08-25 Chun-Yi Chang , Chih-Li Sung

This work addresses a key limitation in current federated learning approaches, which predominantly focus on homogeneous tasks, neglecting the task diversity on local devices. We propose a principled integration of multi-task learning using…

Machine Learning · Computer Science 2024-12-30 Junliang Lyu , Yixuan Zhang , Xiaoling Lu , Feng Zhou

Gaussian process regression (GPR) has been a well-known machine learning method for various applications such as uncertainty quantifications (UQ). However, GPR is inherently a data-driven method, which requires sufficiently large dataset.…

Machine Learning · Computer Science 2023-05-03 Cheng Chang , Tieyong Zeng

The interpolation of high-dimensional potential energy surfaces (PESs) is commonly done with physically-inspired deep-neural network models. In this work, we illustrate that Gaussian Processes (GPs) are also capable of interpolating…

Chemical Physics · Physics 2021-09-30 Rodrigo A. Vargas-Hernández , Jake R. Gardner

We introduce new Gaussian Process (GP) high-order approximations to linear operations that are frequently used in various numerical methods. Our method employs the kernel-based GP regression modeling, a non-parametric Bayesian approach to…

Computational Physics · Physics 2025-06-09 Christopher DeGrendele , Dongwook Lee

This paper addresses the problem of active learning of a multi-output Gaussian process (MOGP) model representing multiple types of coexisting correlated environmental phenomena. In contrast to existing works, our active learning problem…

Machine Learning · Statistics 2015-11-25 Yehong Zhang , Trong Nghia Hoang , Kian Hsiang Low , Mohan Kankanhalli

Deep Gaussian processes (DGPs) are popular surrogate models for complex nonstationary computer experiments. DGPs use one or more latent Gaussian processes (GPs) to warp the input space into a plausibly stationary regime, then use typical GP…

Methodology · Statistics 2025-12-23 Annie S. Booth

Despite the effectiveness of multitask deep neural network (MTDNN), there is a limited theoretical understanding on how the information is shared across different tasks in MTDNN. In this work, we establish a formal connection between MTDNN…

Machine Learning · Computer Science 2019-12-13 Karthikeyan K , Shubham Kumar Bharti , Piyush Rai