English
Related papers

Related papers: Constant-Time Predictive Distributions for Gaussia…

200 papers

To achieve scalable and accurate inference for latent Gaussian processes, we propose a variational approximation based on a family of Gaussian distributions whose covariance matrices have sparse inverse Cholesky (SIC) factors. We combine…

Machine Learning · Statistics 2023-05-30 Jian Cao , Myeongjong Kang , Felix Jimenez , Huiyan Sang , Florian Schafer , Matthias Katzfuss

Gaussian Process (GP) regression models typically assume that residuals are Gaussian and have the same variance for all observations. However, applications with input-dependent noise (heteroscedastic residuals) frequently arise in practice,…

Machine Learning · Statistics 2012-12-27 Chunyi Wang , Radford M. Neal

For applications as varied as Bayesian neural networks, determinantal point processes, elliptical graphical models, and kernel learning for Gaussian processes (GPs), one must compute a log determinant of an $n \times n$ positive definite…

Machine Learning · Statistics 2017-11-10 Kun Dong , David Eriksson , Hannes Nickisch , David Bindel , Andrew Gordon Wilson

Gaussian process models are commonly used as emulators for computer experiments. However, developing a Gaussian process emulator can be computationally prohibitive when the number of experimental samples is even moderately large. Local…

Methodology · Statistics 2018-09-26 Chih-Li Sung , Robert B. Gramacy , Benjamin Haaland

Gaussian processes (GPs) are widely used for regression and optimization tasks such as Bayesian optimization (BO) due to their expressiveness and principled uncertainty estimates. However, in settings with large datasets corrupted by…

Machine Learning · Computer Science 2026-01-13 Marshal Arijona Sinaga , Julien Martinelli , Samuel Kaski

Bayesian inference is a popular method to build learning algorithms but it is hampered by the fact that its key object, the posterior probability distribution, is often uncomputable. Expectation Propagation (EP) (Minka (2001)) is a popular…

Machine Learning · Statistics 2016-12-16 Guillaume P. Dehaene

The generalized extreme value (GEV) distribution is a popular model for analyzing and forecasting extreme weather data. To increase prediction accuracy, spatial information is often pooled via a latent Gaussian process (GP) on the GEV…

Methodology · Statistics 2024-05-20 Meixi Chen , Reza Ramezan , Martin Lysy

Gaussian processes (GPs) are highly flexible function estimators used for geospatial analysis, nonparametric regression, and machine learning, but they are computationally infeasible for large datasets. Vecchia approximations of GPs have…

Methodology · Statistics 2020-12-22 Matthias Katzfuss , Joseph Guinness , Wenlong Gong , Daniel Zilber

Gaussian processes (GPs) with derivatives are useful in many applications, including Bayesian optimization, implicit surface reconstruction, and terrain reconstruction. Fitting a GP to function values and derivatives at $n$ points in $d$…

Machine Learning · Computer Science 2018-10-30 David Eriksson , Kun Dong , Eric Hans Lee , David Bindel , Andrew Gordon Wilson

Bayesian optimization (BO) has established itself as a leading strategy for efficiently optimizing expensive-to-evaluate functions. Existing BO methods mostly rely on Gaussian process (GP) surrogate models and are not applicable to…

Machine Learning · Computer Science 2024-01-29 Yongsheng Mei , Mahdi Imani , Tian Lan

As the amount and complexity of available data increases, the need for robust statistical learning becomes more pressing. To enhance resilience against model misspecification, the generalized posterior inference method adjusts the…

Computation · Statistics 2024-09-04 Masahiro Tanaka

The Gaussian process (GP) is a nonparametric prior distribution over functions indexed by time, space, or other high-dimensional index set. The GP is a flexible model yet its limitation is given by its very nature: it can only model…

Machine Learning · Statistics 2019-07-15 Gonzalo Rios , Felipe Tobar

Gaussian Processes (GPs) provide powerful probabilistic frameworks for interpolation, forecasting, and smoothing, but have been hampered by computational scaling issues. Here we investigate data sampled on one dimension (e.g., a scalar or…

Machine Learning · Statistics 2022-08-04 Jackson Loper , David Blei , John P. Cunningham , Liam Paninski

A method to perform unfolding with Gaussian processes (GPs) is presented. Using Bayesian regression, we define an estimator for the underlying truth distribution as the mode of the posterior. We show that in the case where the bin contents…

Data Analysis, Statistics and Probability · Physics 2018-11-07 Adam Bozson , Glen Cowan , Francesco Spanò

We here consider the subset simulation method which approaches a failure event using a decreasing sequence of nested intermediate failure events. The method resembles importance sampling, which actively explores a probability space by…

Computation · Statistics 2020-03-16 Kenan Šehić , Mirza Karamehmedović

Gaussian processes are probabilistic models that are commonly used as functional priors in machine learning. Due to their probabilistic nature, they can be used to capture the prior information on the statistics of noise, smoothness of the…

Computation · Statistics 2024-02-02 Ahmad Farooq , Cristian A. Galvis-Florez , Simo Särkkä

As a non-parametric Bayesian model which produces informative predictive distribution, Gaussian process (GP) has been widely used in various fields, like regression, classification and optimization. The cubic complexity of standard GP…

Machine Learning · Statistics 2018-11-06 Haitao Liu , Jianfei Cai , Yew-Soon Ong , Yi Wang

Gaussian processes (GPs) are a popular model for spatially referenced data and allow descriptive statements, predictions at new locations, and simulation of new fields. Often a few parameters are sufficient to parameterize the covariance…

Machine Learning · Statistics 2021-01-01 Florian Gerber , Douglas W. Nychka

Preferential Bayesian optimisation (PBO) deals with optimisation problems where the objective function can only be accessed via preference judgments, such as "this is better than that" between two candidate solutions (like in A/B tests or…

Machine Learning · Computer Science 2021-04-02 Alessio Benavoli , Dario Azzimonti , Dario Piga

Gaussian Processes (GPs) are widely used tools in statistics, machine learning, robotics, computer vision, and scientific computation. However, despite their popularity, they can be difficult to apply; all but the simplest classification or…

Machine Learning · Computer Science 2016-01-06 Ulrich Schaechtle , Ben Zinberg , Alexey Radul , Kostas Stathis , Vikash K. Mansinghka