English
Related papers

Related papers: The Minecraft Kernel: Modelling correlated Gaussia…

200 papers

Gaussian process regression is a widely-applied method for function approximation and uncertainty quantification. The technique has gained popularity recently in the machine learning community due to its robustness and interpretability. The…

Machine Learning · Statistics 2022-10-12 Marcus M. Noack , James A. Sethian

Multivariate conformal prediction requires nonconformity scores that compress residual vectors into scalars while preserving certain implicit geometric structure of the residual distribution. We introduce a Multivariate Kernel Score (MKS)…

Machine Learning · Statistics 2026-04-24 Louis Meyer , Wenkai Xu

Machine learning based solvers have garnered much attention in physical simulation and scientific computing, with a prominent example, physics-informed neural networks (PINNs). However, PINNs often struggle to solve high-frequency and…

Machine Learning · Computer Science 2024-03-20 Shikai Fang , Madison Cooley , Da Long , Shibo Li , Robert Kirby , Shandian Zhe

Spectral approximation and variational inducing learning for the Gaussian process are two popular methods to reduce computational complexity. However, in previous research, those methods always tend to adopt the orthonormal basis functions,…

Machine Learning · Statistics 2021-07-15 Wenqi Fang , Guanlin Wu , Jingjing Li , Zheng Wang , Jiang Cao , Yang Ping

Complex-valued signals are used in the modeling of many systems in engineering and science, hence being of fundamental interest. Often, random complex-valued signals are considered to be proper. A proper complex random variable or process…

Machine Learning · Computer Science 2015-02-19 Rafael Boloix-Tortosa , F. Javier Payán-Somet , Eva Arias-de-Reyna , Juan José Murillo-Fuentes

Multi-manifold modeling is increasingly used in segmentation and data representation tasks in computer vision and related fields. While the general problem, modeling data by mixtures of manifolds, is very challenging, several approaches…

Computer Vision and Pattern Recognition · Computer Science 2012-10-08 G. Chen , S. Atev , G. Lerman

Spectral mixture (SM) kernels comprise a powerful class of generalized kernels for Gaussian processes (GPs) to describe complex patterns. This paper introduces model compression and time- and phase (TP) modulated dependency structures to…

Machine Learning · Computer Science 2023-07-27 Kai Chen , Yijue Dai , Feng Yin , Elena Marchiori , Sergios Theodoridis

Functional covariates arise in many scientific and engineering applications when model inputs take the form of time-dependent or spatially distributed profiles, such as varying boundary conditions or changing material behaviours. In…

Statistics Theory · Mathematics 2026-03-10 Razak Christophe Sabi Gninkou , Andrés F. López-Lopera , Franck Massa , Rodolphe Le Riche

We address three key challenges in learning continuous kernel representations: computational efficiency, parameter efficiency, and spectral bias. Continuous kernels have shown significant potential, but their practical adoption is often…

Machine Learning · Computer Science 2024-09-17 Clayton Harper , Luke Wood , Peter Gerstoft , Eric C. Larson

We propose a novel class of Gaussian processes (GPs) whose spectra have compact support, meaning that their sample trajectories are almost-surely band limited. As a complement to the growing literature on spectral design of covariance…

Machine Learning · Statistics 2019-09-17 Felipe Tobar

The Gaussian process (GP) is a widely used probabilistic machine learning method with implicit uncertainty characterization for stochastic function approximation, stochastic modeling, and analyzing real-world measurements of nonlinear…

Machine Learning · Statistics 2026-04-14 Mark D. Risser , Marcus M. Noack , Hengrui Luo , Ronald Pandolfi

For many survey-based spatial modelling problems, responses are observed as spatially aggregated over survey regions due to limited resources. Covariates, from weather models and satellite imageries, can be observed at many different…

Applications · Statistics 2022-04-04 Harrison Zhu , Adam Howes , Owen van Eer , Maxime Rischard , Yingzhen Li , Dino Sejdinovic , Seth Flaxman

Gaussian processes (GP) are widely used as a metamodel for emulating time-consuming computer codes. We focus on problems involving categorical inputs, with a potentially large number L of levels (typically several tens), partitioned in G <<…

Statistics Theory · Mathematics 2018-07-25 Olivier Roustant , Esperan Padonou , Yves Deville , Aloïs Clément , Guillaume Perrin , Jean Giorla , Henry Wynn

Gaussian processes are rich distributions over functions, with generalization properties determined by a kernel function. When used for long-range extrapolation, predictions are particularly sensitive to the choice of kernel parameters. It…

Machine Learning · Statistics 2018-02-05 Phillip A. Jang , Andrew E. Loeb , Matthew B. Davidow , Andrew Gordon Wilson

We present a practical way of introducing convolutional structure into Gaussian processes, making them more suited to high-dimensional inputs like images. The main contribution of our work is the construction of an inter-domain inducing…

Machine Learning · Statistics 2017-09-07 Mark van der Wilk , Carl Edward Rasmussen , James Hensman

The multi-view Gaussian process latent variable model (MV-GPLVM) aims to learn a unified representation from multi-view data but is hindered by challenges such as limited kernel expressiveness and low computational efficiency. To overcome…

Machine Learning · Statistics 2025-12-16 Zi Yang , Ying Li , Zhidi Lin , Michael Minyi Zhang , Pablo M. Olmos

Existing permanental processes often impose constraints on kernel types or stationarity, limiting the model's expressiveness. To overcome these limitations, we propose a novel approach utilizing the sparse spectral representation of…

Machine Learning · Statistics 2024-12-20 Zicheng Sun , Yixuan Zhang , Zenan Ling , Xuhui Fan , Feng Zhou

Kernel methods are among the most popular techniques in machine learning. From a frequentist/discriminative perspective they play a central role in regularization theory as they provide a natural choice for the hypotheses space and the…

Machine Learning · Statistics 2012-04-17 Mauricio A. Alvarez , Lorenzo Rosasco , Neil D. Lawrence

Gaussian process models -also called Kriging models- are often used as mathematical approximations of expensive experiments. However, the number of observation required for building an emulator becomes unrealistic when using classical…

Machine Learning · Statistics 2012-12-17 Nicolas Durrande , David Ginsbourger , Olivier Roustant , Laurent Carraro

Gaussian processes provide a flexible, non-parametric framework for the approximation of functions in high-dimensional spaces. The covariance kernel is the main engine of Gaussian processes, incorporating correlations that underpin the…

Machine Learning · Statistics 2024-03-20 Dionissios T. Hristopulos