English
Related papers

Related papers: Linear-Cost Covariance Functions for Gaussian Rand…

200 papers

Gaussian process is a theoretically appealing model for nonparametric analysis, but its computational cumbersomeness hinders its use in large scale and the existing reduced-rank solutions are usually heuristic. In this work, we propose a…

Machine Learning · Statistics 2015-11-25 Leo L. Duan , Xia Wang , Rhonda D. Szczesniak

Spatial prediction requires expensive computation to invert the spatial covariance matrix it depends on and also has considerable storage needs. This work concentrates on computationally efficient algorithms for prediction using very large…

Computation · Statistics 2019-06-11 Roberto Rivera

Priors are important for achieving proper posteriors with physically meaningful covariance structures for Gaussian random fields (GRFs) since the likelihood typically only provides limited information about the covariance structure under…

Methodology · Statistics 2017-11-28 Geir-Arne Fuglstad , Daniel Simpson , Finn Lindgren , Håvard Rue

Large or very large spatial (and spatio-temporal) datasets have become common place in many environmental and climate studies. These data are often collected in non-Euclidean spaces (such as the planet Earth) and they often present…

Statistics Theory · Mathematics 2023-01-09 Mike Pereira , Nicolas Desassis , Denis Allard

Stochastic kriging is a popular technique for simulation metamodeling due to its exibility and analytical tractability. Its computational bottleneck is the inversion of a covariance matrix, which takes $O(n^3)$ time in general and becomes…

Methodology · Statistics 2018-03-08 Liang Ding , Xiaowei Zhang

Fractional Gaussian noise (fGn) is a stationary time series model with long memory properties applied in various fields like econometrics, hydrology and climatology. The computational cost in fitting an fGn model of length $n$ using a…

Methodology · Statistics 2017-09-20 Sigrunn H. Sørbye , Eirik Myrvoll-Nilsen , Håvard Rue

We begin with isotropic Gaussian random fields, and show how the Bochner-Godement theorem gives a natural way to describe their covariance structure. We continue with a study of Mat\'ern processes on Euclidean space, spheres, manifolds and…

Probability · Mathematics 2021-11-24 N. H. Bingham , Tasmin L. Symons

Gaussian processes have been successful in both supervised and unsupervised machine learning tasks, but their computational complexity has constrained practical applications. We introduce a new approximation for large-scale Gaussian…

Machine Learning · Computer Science 2015-11-03 David A. Moore , Stuart J. Russell

Sparse variational approximations are popular methods for scaling up inference and learning in Gaussian processes to larger datasets. For $N$ training points, exact inference has $O(N^3)$ cost; with $M \ll N$ features, state of the art…

Machine Learning · Statistics 2024-04-15 Talay M Cheema , Carl Edward Rasmussen

Gaussian Markov random fields are used in a large number of disciplines in machine vision and spatial statistics. The models take advantage of sparsity in matrices introduced through the Markov assumptions, and all operations in inference…

Computation · Statistics 2018-02-08 Andrew Zammit-Mangion , Jonathan Rougier

Pairwise Markov Random Fields (MRFs) or undirected graphical models are parsimonious representations of joint probability distributions. Variables correspond to nodes of a graph, with edges between nodes corresponding to conditional…

Statistics Theory · Mathematics 2018-09-18 Eric Janofsky

I consider the use of Markov random fields (MRFs) on a fine grid to represent latent spatial processes when modeling point-level and areal data, including situations with spatial misalignment. Point observations are related to the grid cell…

Methodology · Statistics 2013-04-09 Christopher J. Paciorek

Geophysical and other natural processes often exhibit non-stationary covariances and this feature is important to take into account for statistical models that attempt to emulate the physical process. A convolution-based model is used to…

Methodology · Statistics 2017-11-23 Douglas Nychka , Dorit Hammerling , Mitchell Krock , Ashton Wiens

Treeging combines the flexible mean structure of regression trees with the covariance-based prediction strategy of kriging into the base learner of an ensemble prediction algorithm. In so doing, it combines the strengths of the two primary…

Machine Learning · Statistics 2021-10-05 Gregory L. Watson , Michael Jerrett , Colleen E. Reid , Donatello Telesca

Spartan Spatial Random Fields (SSRFs) are generalized Gibbs random fields, equipped with a coarse-graining kernel that acts as a low-pass filter for the fluctuations. SSRFs are defined by means of physically motivated spatial interactions…

Information Theory · Computer Science 2012-04-12 Dionissios T. Hristopulos , Samuel Elogne

The computational cost for inference and prediction of statistical models based on Gaussian processes with Mat\'ern covariance functions scales cubicly with the number of observations, limiting their applicability to large data sets. The…

Statistics Theory · Mathematics 2025-03-04 David Bolin , Vaibhav Mehandiratta , Alexandre B. Simas

Many real-world datasets can be represented in the form of a graph whose edge weights designate similarities between instances. A discrete Gaussian random field (GRF) model is a finite-dimensional Gaussian process (GP) whose prior…

Machine Learning · Computer Science 2012-09-18 Yifei Ma , Roman Garnett , Jeff Schneider

Maximum likelihood estimation is an important statistical technique for estimating missing data, for example in climate and environmental applications, which are usually large and feature data points that are irregularly spaced. In…

Numerical Analysis · Computer Science 2019-07-25 Sameh Abdulah , Hatem Ltaief , Ying Sun , Marc G. Genton , David E. Keyes

Engineers widely use Gaussian process regression framework to construct surrogate models aimed to replace computationally expensive physical models while exploring design space. Thanks to Gaussian process properties we can use both samples…

Machine Learning · Statistics 2017-07-14 Evgeny Burnaev , Alexey Zaytsev

The Riemannian geometry of covariance matrices has been essential to several successful applications, in computer vision, biomedical signal and image processing, and radar data processing. For these applications, an important ongoing…

Statistics Theory · Mathematics 2017-05-15 Salem Said , Hatem Hajri , Lionel Bombrun , Baba C. Vemuri