English
Related papers

Related papers: The Minecraft Kernel: Modelling correlated Gaussia…

200 papers

This work incorporates the multi-modality of the data distribution into a Gaussian Process regression model. We approach the problem from a discriminative perspective by learning, jointly over the training data, the target space variance in…

Machine Learning · Computer Science 2018-03-20 Silvia L. Pintea , Jan C. van Gemert , Arnold W. M. Smeulders

Recently, there has been a growing interest for mixed-categorical meta-models based on Gaussian process (GP) surrogates. In this setting, several existing approaches use different strategies either by using continuous kernels (e.g.,…

Optimization and Control · Mathematics 2024-01-25 P. Saves , Y. Diouane , N. Bartoli , T. Lefebvre , J. Morlier

In this paper we analyze the covariance kernel of the Gaussian process that arises as the limit of fluctuations of linear spectral statistics for Wigner matrices with a few moments. More precisely, the process we study here corresponds to…

Probability · Mathematics 2022-02-16 Asad Lodhia , Anna Maltsev

3D action recognition was shown to benefit from a covariance representation of the input data (joint 3D positions). A kernel machine feed with such feature is an effective paradigm for 3D action recognition, yielding state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2017-10-05 Jacopo Cavazza , Pietro Morerio , Vittorio Murino

We propose a graph spectrum-based Gaussian process for prediction of signals defined on nodes of the graph. The model is designed to capture various graph signal structures through a highly adaptive kernel that incorporates a flexible…

Machine Learning · Computer Science 2020-10-29 Yin-Cong Zhi , Yin Cheng Ng , Xiaowen Dong

This paper presents a new approach to the analysis of mixed processes \[X_t=B_t+G_t,\qquad t\in[0,T],\] where $B_t$ is a Brownian motion and $G_t$ is an independent centered Gaussian process. We obtain a new canonical innovation…

Probability · Mathematics 2016-09-05 Chunhao Cai , Pavel Chigansky , Marina Kleptsyna

The specification of a covariance function is of paramount importance when employing Gaussian process models, but the requirement of positive definiteness severely limits those used in practice. Designing flexible stationary covariance…

Computation · Statistics 2024-05-01 Paul G. Beckman , Christopher J. Geoga

This paper is an attempt to bridge the conceptual gaps between researchers working on the two widely used approaches based on positive definite kernels: Bayesian learning or inference using Gaussian processes on the one side, and…

Machine Learning · Statistics 2018-07-10 Motonobu Kanagawa , Philipp Hennig , Dino Sejdinovic , Bharath K Sriperumbudur

We show that Gaussian process regression (GPR) allows representing multivariate functions with low-dimensional terms via kernel design. When using a kernel built with HDMR (High-dimensional model representation), one obtains a similar type…

Numerical Analysis · Mathematics 2023-01-27 Eita Sasaki , Manabu Ihara , Sergei Manzhos

Convolutional neural networks are paramount in image and signal processing including the relevant classification and training tasks alike and constitute for the majority of machine learning compute demand today. With convolution operations…

We propose a novel calibration method for computer simulators, dealing with the problem of covariate shift. Covariate shift is the situation where input distributions for training and test are different, and ubiquitous in applications of…

Machine Learning · Statistics 2020-03-20 Keiichi Kisamori , Motonobu Kanagawa , Keisuke Yamazaki

Understanding the spectral properties of kernels offers a principled perspective on generalization and representation quality. While deep models achieve state-of-the-art accuracy in molecular property prediction, kernel methods remain…

Machine Learning · Computer Science 2025-10-17 Asma Jamali , Tin Sum Cheng , Rodrigo A. Vargas-Hernández

The generalization properties of Gaussian processes depend heavily on the choice of kernel, and this choice remains a dark art. We present the Neural Kernel Network (NKN), a flexible family of kernels represented by a neural network. The…

Machine Learning · Computer Science 2018-08-07 Shengyang Sun , Guodong Zhang , Chaoqi Wang , Wenyuan Zeng , Jiaman Li , Roger Grosse

The principle of translation equivariance (if an input image is translated an output image should be translated by the same amount), led to the development of convolutional neural networks that revolutionized machine vision. Other…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Zachary Schlamowitz , Andrew Bennecke , Daniel J. Tward

A latent force model is a Gaussian process with a covariance function inspired by a differential operator. Such covariance function is obtained by performing convolution integrals between Green's functions associated to the differential…

Machine Learning · Statistics 2021-04-20 Cristian Guarnizo , Mauricio A. Álvarez

Bayesian model updating based on Gaussian Process (GP) models has received attention in recent years, which incorporates kernel-based GPs to provide enhanced fidelity response predictions. Although most kernel functions provide high fitting…

It is a consensus in signal processing that the Gaussian kernel and its partial derivatives enable the development of robust algorithms for feature detection. Fourier analysis and convolution theory have central role in such development. In…

Computer Vision and Pattern Recognition · Computer Science 2016-05-03 Paulo Sérgio Silva Rodrigues , Gilson Antonio Giraldi

Mean-field control problems have received continuous interest over the last decade. Despite being more intricate than in classical optimal control, the linear-quadratic setting can still be tackled through Riccati equations. Remarkably, we…

Optimization and Control · Mathematics 2023-08-23 Pierre-Cyril Aubin-Frankowski , Alain Bensoussan

We introduce a new class of nonstationary kernels, which we derive as covariance functions of a novel family of stochastic processes we refer to as string Gaussian processes (string GPs). We construct string GPs to allow for multiple types…

Machine Learning · Statistics 2015-06-09 Yves-Laurent Kom Samo , Stephen Roberts

Mixtures of Gaussian process experts is a class of models that can simultaneously address two of the key limitations inherent in standard Gaussian processes: scalability and predictive performance. In particular, models that use Dirichlet…

Machine Learning · Statistics 2023-05-09 Yuji Saikai , Khue-Dung Dang