English
Related papers

Related papers: How to use GP: Effects of the mean function and hy…

200 papers

This article revisits the fundamental problem of parameter selection for Gaussian process interpolation. By choosing the mean and the covariance functions of a Gaussian process within parametric families, the user obtains a family of…

Methodology · Statistics 2023-08-09 Sébastien Petit , Julien Bect , Paul Feliot , Emmanuel Vazquez

The correlation length-scale next to the noise variance are the most used hyperparameters for the Gaussian processes. Typically, stationary covariance functions are used, which are only dependent on the distances between input points and…

Machine Learning · Computer Science 2017-10-30 Kevin Cremanns , Dirk Roos

Gaussian processes (GPs) are powerful and widely used probabilistic regression models, but their effectiveness in practice is often limited by the choice of kernel function. This kernel function is typically handcrafted from a small set of…

Machine Learning · Computer Science 2026-02-13 Jihao Andreas Lin , Sebastian Ament , Louis C. Tiao , David Eriksson , Maximilian Balandat , Eytan Bakshy

This article introduces exact testing procedures on the mean of a Gaussian process $X$ derived from the outcomes of $\ell_1$-minimization over the space of complex valued measures. The process $X$ can be thought as the sum of two terms:…

Statistics Theory · Mathematics 2018-07-03 Jean-Marc Azaïs , Yohann De Castro , Stéphane Mourareau

Maximizing high-dimensional, non-convex functions through noisy observations is a notoriously hard problem, but one that arises in many applications. In this paper, we tackle this challenge by modeling the unknown function as a sample from…

Machine Learning · Computer Science 2012-07-03 Bo Chen , Rui Castro , Andreas Krause

Non-parametric reconstruction methods, such as Gaussian process (GP) regression, provide a model-independent way of estimating an underlying function and its uncertainty from noisy data. We demonstrate how GP-reconstruction can be used as a…

Cosmology and Nongalactic Astrophysics · Physics 2017-12-25 Amir Aghamousa , Jan Hamann , Arman Shafieloo

We apply Gaussian processes (GP) in order to impose constraints on teleparallel gravity and its $f(T)$ extensions. We use available $H(z)$ observations from (i) cosmic chronometers data (CC); (ii) Supernova Type Ia (SN) data from the…

General Relativity and Quantum Cosmology · Physics 2021-02-03 Rebecca Briffa , Salvatore Capozziello , Jackson Levi Said , Jurgen Mifsud , Emmanuel N. Saridakis

Gaussian processes are powerful, yet analytically tractable models for supervised learning. A Gaussian process is characterized by a mean function and a covariance function (kernel), which are determined by a model selection criterion. The…

Machine Learning · Statistics 2016-10-05 Benjamin Fischer , Nico Gorbach , Stefan Bauer , Yatao Bian , Joachim M. Buhmann

The current accelerated expansion of the Universe remains ones of the most intriguing topics in modern cosmology, driving the search for innovative statistical techniques. Recent advancements in machine learning have significantly enhanced…

Cosmology and Nongalactic Astrophysics · Physics 2025-01-03 José de Jesús Velázquez , Luis A. Escamilla , Purba Mukherjee , J. Alberto Vázquez

In the context of a Hubble tension problem that is growing in its statistical significance, we reconsider the effectiveness of non-parametric reconstruction techniques which are independent of prescriptive cosmological models. By taking…

Cosmology and Nongalactic Astrophysics · Physics 2021-10-11 Celia Escamilla-Rivera , Jackson Levi Said , Jurgen Mifsud

In this paper, we explore the application of Gaussian Processes (GPs) for predicting mean-reverting time series with an underlying structure, using relatively unexplored functional and augmented data structures. While many conventional…

Statistical Finance · Quantitative Finance 2024-03-05 Narayan Tondapu

This work is concerned with the convergence of Gaussian process regression. A particular focus is on hierarchical Gaussian process regression, where hyper-parameters appearing in the mean and covariance structure of the Gaussian process…

Numerical Analysis · Mathematics 2020-07-20 Aretha L Teckentrup

Gaussian process modeling is a standard tool for building emulators for computer experiments, which are usually used to study deterministic functions, for example, a solution to a given system of partial differential equations. This work…

Statistics Theory · Mathematics 2021-10-01 Wenjia Wang

Gaussian processes (GPs) are a powerful tool for probabilistic inference over functions. They have been applied to both regression and non-linear dimensionality reduction, and offer desirable properties such as uncertainty estimates,…

Machine Learning · Statistics 2014-10-01 Yarin Gal , Mark van der Wilk , Carl E. Rasmussen

Gaussian process (GP) regression is a Bayesian nonparametric method for regression and interpolation, offering a principled way of quantifying the uncertainties of predicted function values. For the quantified uncertainties to be…

Statistics Theory · Mathematics 2025-08-22 Masha Naslidnyk , Motonobu Kanagawa , Toni Karvonen , Maren Mahsereci

The hyperparameters in Gaussian process regression (GPR) model with a specified kernel are often estimated from the data via the maximum marginal likelihood. Due to the non-convexity of marginal likelihood with respect to the…

Machine Learning · Statistics 2018-01-15 Zexun Chen , Bo Wang

Bayesian model updating based on Gaussian Process (GP) models has received attention in recent years, which incorporates kernel-based GPs to provide enhanced fidelity response predictions. Although most kernel functions provide high fitting…

We compare classification and regression tasks in an overparameterized linear model with Gaussian features. On the one hand, we show that with sufficient overparameterization all training points are support vectors: solutions obtained by…

Machine Learning · Computer Science 2021-10-15 Vidya Muthukumar , Adhyyan Narang , Vignesh Subramanian , Mikhail Belkin , Daniel Hsu , Anant Sahai

Gaussian processes (GPs) are very widely used for modeling of unknown functions or surfaces in applications ranging from regression to classification to spatial processes. Although there is an increasingly vast literature on applications,…

Methodology · Statistics 2017-06-28 Lizhen Lin , Mu Niu , Pokman Cheung , David Dunson

Estimating causal effects in quasi-experiments with spatio-temporal panel data often requires adjusting for unmeasured confounding that varies across space and time. Gaussian Processes (GPs) offer a flexible, nonparametric modeling approach…

Methodology · Statistics 2025-07-08 Sofia L. Vega , Rachel C. Nethery