English
Related papers

Related papers: Kryging: Geostatistical analysis of large-scale da…

200 papers

This paper introduces new solvers for efficiently computing solutions to large-scale inverse problems with group sparsity regularization, including both non-overlapping and overlapping groups. Group sparsity regularization refers to a type…

Numerical Analysis · Mathematics 2023-06-16 Julianne Chung , Malena Sabaté Landman

In this work, we collect data from runs of Krylov subspace methods and pipelined Krylov algorithms in an effort to understand and model the impact of machine noise and other sources of variability on performance. We find large variability…

Mathematical Software · Computer Science 2021-03-24 Hannah Morgan , Patrick Sanan , Matthew G. Knepley , Richard Tran Mills

We introduce the Tensorized-and-Restricted Krylov (TReK) method, a simple and efficient algorithm for estimating covariance tensors with large observational sizes. TReK extends the conjugate gradient method to incorporate range…

Computation · Statistics 2025-09-03 Ho Yun , Victor M. Panaretos

Kriging is a fundamental tool for spatial prediction, but its computational complexity of $O(N^3)$ becomes prohibitive for large datasets. While local kriging using $K$-nearest neighbors addresses this issue, the selection of $K$ typically…

Methodology · Statistics 2026-02-04 Francisco Cuevas-Pacheco , Jonathan Acosta

We introduce a novel Bayesian approach for variable selection using Gaussian process regression, which is crucial for enhancing interpretability and model regularization. Our method employs nearest neighbor Gaussian processes, serving as…

Spatial prediction is commonly achieved under the assumption of a Gaussian random field (GRF) by obtaining maximum likelihood estimates of parameters, and then using the kriging equations to arrive at predicted values. For massive datasets,…

Methodology · Statistics 2021-07-20 Karl T. Pazdernik , Ranjan Maitra

The use of Gaussian processes (GPs) is supported by efficient sampling algorithms, a rich methodological literature, and strong theoretical grounding. However, due to their prohibitive computation and storage demands, the use of exact GPs…

Statistics Theory · Mathematics 2022-07-27 Kelly R. Moran , Matthew W. Wheeler

Optimal design facilitates intelligent data collection. In this paper, we introduce a fully Bayesian design approach for spatial processes with complex covariance structures, like those typically exhibited in natural ecosystems. Coordinate…

High dimensional data and systems with many degrees of freedom are often characterized by covariance matrices. In this paper, we consider the problem of simultaneously estimating the dimension of the principal (dominant) subspace of these…

Numerical Analysis · Computer Science 2018-10-10 Shashanka Ubaru , Abd-Krim Seghouane , Yousef Saad

Gradient-enhanced Kriging (GE-Kriging) is a well-established surrogate modelling technique for approximating expensive computational models. However, it tends to get impractical for high-dimensional problems due to the size of the inherent…

Machine Learning · Statistics 2024-01-05 Kai Cheng , Ralf Zimmermann

We introduce statistical techniques required to handle complex computer models with potential applications to astronomy. Computer experiments play a critical role in almost all fields of scientific research and engineering. These computer…

Instrumentation and Methods for Astrophysics · Physics 2021-09-01 Joshua Lukemire , Qian Xiao , Abhyuday Mandal , Weng Kee Wong

High-quality reconstructions of signals and images with sharp edges are needed in a wide range of applications. To overcome the large dimensionality of the parameter space and the complexity of the regularization functional,…

Numerical Analysis · Mathematics 2025-05-06 Jonathan Lindbloom , Mirjeta Pasha , Jan Glaubitz , Youssef Marzouk

Gaussian process models -also called Kriging models- are often used as mathematical approximations of expensive experiments. However, the number of observation required for building an emulator becomes unrealistic when using classical…

Machine Learning · Statistics 2012-12-17 Nicolas Durrande , David Ginsbourger , Olivier Roustant , Laurent Carraro

In recent years two Krylov subspace methods have been proposed for solving skew symmetric linear systems, one based on the minimum residual condition, the other on the Galerkin condition. We give new, algorithm-independent proofs that in…

Numerical Analysis · Mathematics 2015-12-02 Stanley C. Eisenstat

We use available measurements to estimate the unknown parameters (variance, smoothness parameter, and covariance length) of a covariance function by maximizing the joint Gaussian log-likelihood function. To overcome cubic complexity in the…

Computation · Statistics 2018-09-13 Alexander Litvinenko , Ying Sun , Marc G. Genton , David Keyes

Variational data assimilation is a technique for combining measured data with dynamical models. It is a key component of Earth system state estimation and is commonly used in weather and ocean forecasting. The approach involves a…

Numerical Analysis · Mathematics 2026-04-30 I. Daužickaitė , M. A. Freitag , S. Gürol , A. S. Lawless , A. Ramage , J. A. Scott , J. M. Tabeart

We aim to solve the problem of spatially localizing composite instructions referring to space: space grounding. Compared to current instance grounding, space grounding is challenging due to the ill-posedness of identifying locations…

Robotics · Computer Science 2024-07-03 Dohyun Kim , Nayoung Oh , Deokmin Hwang , Daehyung Park

The use of Gaussian process models is typically limited to datasets with a few tens of thousands of observations due to their complexity and memory footprint. The two most commonly used methods to overcome this limitation are 1) the…

Machine Learning · Statistics 2020-01-16 Vincent Adam , Stefanos Eleftheriadis , Nicolas Durrande , Artem Artemev , James Hensman

The periodic Gaussian process (PGP) has been increasingly used to model periodic data due to its high accuracy. Yet, computing the likelihood of PGP has a high computational complexity of $\mathcal{O}\left(n^{3}\right)$ ($n$ is the data…

Methodology · Statistics 2023-02-10 Yongxiang Li , Yuting Pu , Changming Cheng , Qian Xiao

We present a kernel-independent method that applies hierarchical matrices to the problem of maximum likelihood estimation for Gaussian processes. The proposed approximation provides natural and scalable stochastic estimators for its…

Computation · Statistics 2019-03-26 Christopher J. Geoga , Mihai Anitescu , Michael L. Stein