English
Related papers

Related papers: Locally Adaptive Bayes Nonparametric Regression vi…

200 papers

Gaussian Processes (GPs) have been widely used in machine learning to model distributions over functions, with applications including multi-modal regression, time-series prediction, and few-shot learning. GPs are particularly useful in the…

Neural-net-induced Gaussian process (NNGP) regression inherits both the high expressivity of deep neural networks (deep NNs) as well as the uncertainty quantification property of Gaussian processes (GPs). We generalize the current NNGP to…

Machine Learning · Computer Science 2019-03-27 Guofei Pang , Liu Yang , George Em Karniadakis

Gaussian process ($GP$) regression is a widely used non-parametric modeling tool, but its cubic complexity in the training size limits its use on massive data sets. A practical remedy is to predict using only the nearest neighbours of each…

Machine Learning · Statistics 2026-04-09 Robert Allison , Tomasz Maciazek , Anthony Stephenson

This research proposes a flexible Bayesian extension of the composite Gaussian process (CGP) model of Ba and Joseph (2012) for predicting (stationary or) non-stationary $y(\mathbf{x})$. The CGP generalizes the regression plus stationary…

Methodology · Statistics 2019-06-27 Casey B. Davis , Christopher M. Hans , Thomas J. Santner

We consider the accuracy of an approximate posterior distribution in nonparametric regression problems by combining posterior distributions computed on subsets of the data defined by the locations of the independent variables. We show that…

Statistics Theory · Mathematics 2025-04-29 Botond Szabo , Amine Hadji , Aad van der Vaart

We consider a prior for nonparametric Bayesian estimation which uses finite random series with a random number of terms. The prior is constructed through distributions on the number of basis functions and the associated coefficients. We…

Statistics Theory · Mathematics 2015-02-10 Weining Shen , Subhashis Ghosal

In this paper we introduce a novel model for Gaussian process (GP) regression in the fully Bayesian setting. Motivated by the ideas of sparsification, localization and Bayesian additive modeling, our model is built around a recursive…

Statistics Theory · Mathematics 2022-06-06 Hengrui Luo , Giovanni Nattino , Matthew T. Pratola

In spite of the diverse literature on nonstationary spatial modeling and approximate Gaussian process (GP) methods, there are no general approaches for conducting fully Bayesian inference for moderately sized nonstationary spatial data sets…

Computation · Statistics 2020-07-01 Mark D. Risser , Daniel Turek

Gaussian processes (GPs) are Bayesian non-parametric models useful in a myriad of applications. Despite their popularity, the cost of GP predictions (quadratic storage and cubic complexity with respect to the number of training points)…

Machine Learning · Computer Science 2022-05-24 Alec M. Dunton , Benjamin W. Priest , Amanda Muyskens

Gaussian processes are ubiquitous as the primary tool for modeling spatial data. However, the Gaussian process is limited by its $\mathcal{O}(n^3)$ cost, making direct parameter fitting algorithms infeasible for the scale of modern data…

Methodology · Statistics 2025-12-25 Ashlynn Crisp , Daniel Taylor-Rodriguez , Andrew O. Finley

We study location-scale mixture priors for nonparametric statistical problems, including multivariate regression, density estimation and classification. We show that a rate-adaptive procedure can be obtained if the prior is properly…

Statistics Theory · Mathematics 2012-11-12 R. de Jonge , J. H. van Zanten

We study how the posterior contraction rate under a Gaussian process (GP) prior depends on the intrinsic dimension of the predictors and the smoothness of the regression function. An open question is whether a generic GP prior that does not…

Statistics Theory · Mathematics 2025-06-26 Tao Tang , Nan Wu , Xiuyuan Cheng , David Dunson

This paper presents a method for approximate Gaussian process (GP) regression with tensor networks (TNs). A parametric approximation of a GP uses a linear combination of basis functions, where the accuracy of the approximation depends on…

Machine Learning · Statistics 2023-11-01 Clara Menzen , Eva Memmel , Kim Batselier , Manon Kok

Gaussian Processes (GPs) can be used as flexible, non-parametric function priors. Inspired by the growing body of work on Normalizing Flows, we enlarge this class of priors through a parametric invertible transformation that can be made…

Machine Learning · Computer Science 2021-02-26 Juan Maroñas , Oliver Hamelijnck , Jeremias Knoblauch , Theodoros Damoulas

Spatial process models for analyzing geostatistical data entail computations that become prohibitive as the number of spatial locations become large. This manuscript develops a class of highly scalable Nearest Neighbor Gaussian Process…

Methodology · Statistics 2016-01-05 Abhirup Datta , Sudipto Banerjee , Andrew O. Finley , Alan E. Gelfand

Gaussian processes (GPs) are instrumental in modeling spatial processes, offering precise interpolation and prediction capabilities across fields such as environmental science and biology. Recently, there has been growing interest in…

Methodology · Statistics 2025-09-04 Jiawen Chen , Aritra Halder , Yun Li , Sudipto Banerjee , Didong Li

Bayesian models based on Gaussian processes (GPs) offer a flexible framework to predict spatially distributed variables with uncertainty. But the use of nonstationary priors, often necessary for capturing complex spatial patterns, makes…

Machine Learning · Statistics 2025-06-02 Gabriel V Cardoso , Mike Pereira

Gaussian processes (GP) are Bayesian non-parametric models that are widely used for probabilistic regression. Unfortunately, it cannot scale well with large data nor perform real-time predictions due to its cubic time cost in the data size.…

Machine Learning · Computer Science 2014-08-12 Jie Chen , Nannan Cao , Kian Hsiang Low , Ruofei Ouyang , Colin Keng-Yan Tan , Patrick Jaillet

Gaussian processes (GP) are Bayesian non-parametric models that are widely used for probabilistic regression. Unfortunately, it cannot scale well with large data nor perform real-time predictions due to its cubic time cost in the data size.…

Machine Learning · Statistics 2013-05-27 Jie Chen , Nannan Cao , Kian Hsiang Low , Ruofei Ouyang , Colin Keng-Yan Tan , Patrick Jaillet

Deep Gaussian processes have recently been proposed as natural objects to fit, similarly to deep neural networks, possibly complex features present in modern data samples, such as compositional structures. Adopting a Bayesian nonparametric…

Statistics Theory · Mathematics 2025-02-04 Ismaël Castillo , Thibault Randrianarisoa
‹ Prev 1 2 3 10 Next ›