English
Related papers

Related papers: Normalizing Basis Functions: Approximate Stationar…

200 papers

Spatial statistics is concerned with the analysis of data that have spatial locations associated with them, and those locations are used to model statistical dependence between the data. The spatial data are treated as a single realisation…

Methodology · Statistics 2022-02-09 Noel Cressie , Matthew Sainsbury-Dale , Andrew Zammit-Mangion

Gaussian process is a theoretically appealing model for nonparametric analysis, but its computational cumbersomeness hinders its use in large scale and the existing reduced-rank solutions are usually heuristic. In this work, we propose a…

Machine Learning · Statistics 2015-11-25 Leo L. Duan , Xia Wang , Rhonda D. Szczesniak

This paper presents a method for approximate Gaussian process (GP) regression with tensor networks (TNs). A parametric approximation of a GP uses a linear combination of basis functions, where the accuracy of the approximation depends on…

Machine Learning · Statistics 2023-11-01 Clara Menzen , Eva Memmel , Kim Batselier , Manon Kok

Gaussian processes are powerful non-parametric probabilistic models for stochastic functions. However, the direct implementation entails a complexity that is computationally intractable when the number of observations is large, especially…

Gaussian Processes (GPs) are a popular approach to predict the output of a parameterized experiment. They have many applications in the field of Computer Experiments, in particular to perform sensitivity analysis, adaptive design of…

Optimization and Control · Mathematics 2017-05-08 Hossein Mohammadi , Rodolphe Le Riche , Nicolas Durrande , Eric Touboul , Xavier Bay

Gaussian processes (GPs) are a good choice for function approximation as they are flexible, robust to over-fitting, and provide well-calibrated predictive uncertainty. Deep Gaussian processes (DGPs) are multi-layer generalisations of GPs,…

Machine Learning · Statistics 2017-11-15 Hugh Salimbeni , Marc Deisenroth

Designing a covariance function that represents the underlying correlation is a crucial step in modeling complex natural systems, such as climate models. Geospatial datasets at a global scale usually suffer from non-stationarity and…

Machine Learning · Statistics 2015-07-10 Chintan A. Dalal , Vladimir Pavlovic , Robert E. Kopp

Surface roughness plays a critical role and has effects in, e.g. fluid dynamics or contact mechanics. For example, to evaluate fluid behavior at different roughness properties, real-world or numerical experiments are performed. Numerical…

Signal Processing · Electrical Eng. & Systems 2023-03-07 Arsalan Jawaid , Jörg Seewig

We introduce a framework for updating large scale geospatial processes using a model-data synthesis method based on Bayesian hierarchical modelling. Two major challenges come from updating large-scale Gaussian process and modelling…

Applications · Statistics 2018-05-01 Zhe Sha , Jonathan Rougier , Maike Schumacher , Jonathan Bamber

Gaussian processes (GPs) are powerful and widely used probabilistic regression models, but their effectiveness in practice is often limited by the choice of kernel function. This kernel function is typically handcrafted from a small set of…

Machine Learning · Computer Science 2026-02-13 Jihao Andreas Lin , Sebastian Ament , Louis C. Tiao , David Eriksson , Maximilian Balandat , Eytan Bakshy

Modeling and inferring spatial relationships and predicting missing values of environmental data are some of the main tasks of geospatial statisticians. These routine tasks are accomplished using multivariate geospatial models and the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-06 Mary Lai O. Salvaña , Sameh Abdulah , Huang Huang , Hatem Ltaief , Ying Sun , Marc G. Genton , David E. Keyes

Off-the-shelf Gaussian Process (GP) covariance functions encode smoothness assumptions on the structure of the function to be modeled. To model complex and non-differentiable functions, these smoothness assumptions are often too…

Machine Learning · Statistics 2016-04-12 Roberto Calandra , Jan Peters , Carl Edward Rasmussen , Marc Peter Deisenroth

Analysis of geospatial data has traditionally been model-based, with a mean model, customarily specified as a linear regression on the covariates, and a covariance model, encoding the spatial dependence. We relax the strong assumption of…

Machine Learning · Statistics 2024-05-28 Wentao Zhan , Abhirup Datta

Standard sparse pseudo-input approximations to the Gaussian process (GP) cannot handle complex functions well. Sparse spectrum alternatives attempt to answer this but are known to over-fit. We suggest the use of variational inference for…

Machine Learning · Statistics 2015-03-23 Yarin Gal , Richard Turner

The use of Gaussian processes (GPs) is supported by efficient sampling algorithms, a rich methodological literature, and strong theoretical grounding. However, due to their prohibitive computation and storage demands, the use of exact GPs…

Statistics Theory · Mathematics 2022-07-27 Kelly R. Moran , Matthew W. Wheeler

Generalized additive models (GAMs) provide a way to blend parametric and non-parametric (function approximation) techniques together, making them flexible tools suitable for many modeling problems. For instance, GAMs can be used to…

Methodology · Statistics 2023-03-07 Antti Solonen , Stratos Staboulis

Gaussian processes (GPs) are a popular class of Bayesian nonparametric models, but its training can be computationally burdensome for massive training datasets. While there has been notable work on scaling up these models for big data,…

Methodology · Statistics 2023-11-16 Kevin Li , Simon Mak

In this paper, we investigate a class of approximate Gaussian processes (GP) obtained by taking a linear combination of compactly supported basis functions with the basis coefficients endowed with a dependent Gaussian prior distribution.…

Statistics Theory · Mathematics 2025-06-02 Jaehoan Kim , Anirban Bhattacharya , Debdeep Pati

We introduce a scalable Gaussian process (GP) framework with deep product kernels for data-driven learning of parametrized spatio-temporal fields over fixed or parameter-dependent domains. The proposed framework learns a continuous…

Machine Learning · Computer Science 2026-03-03 Srinath Dama , Prasanth B. Nair

In spite of the diverse literature on nonstationary spatial modeling and approximate Gaussian process (GP) methods, there are no general approaches for conducting fully Bayesian inference for moderately sized nonstationary spatial data sets…

Computation · Statistics 2020-07-01 Mark D. Risser , Daniel Turek