English
Related papers

Related papers: The Price of Linear Time: Error Analysis of Struct…

200 papers

This paper studies the statistical complexity of kernel hyperparameter tuning in the setting of active regression under adversarial noise. We consider the problem of finding the best interpolant from a class of kernels with unknown…

Machine Learning · Computer Science 2020-06-16 Raphael A. Meyer , Christopher Musco

Gaussian processes (GPs) are flexible models that can capture complex structure in large-scale dataset due to their non-parametric nature. However, the usage of GPs in real-world application is limited due to their high computational cost…

Machine Learning · Statistics 2018-11-06 Congzheng Song , Yiming Sun

Training and inference in Gaussian processes (GPs) require solving linear systems with $n\times n$ kernel matrices. To address the prohibitive $\mathcal{O}(n^3)$ time complexity, recent work has employed fast iterative methods, like…

Machine Learning · Computer Science 2024-03-12 Kaiwen Wu , Jonathan Wenger , Haydn Jones , Geoff Pleiss , Jacob R. Gardner

Gaussian Processes (GPs) provide powerful probabilistic frameworks for interpolation, forecasting, and smoothing, but have been hampered by computational scaling issues. Here we investigate data sampled on one dimension (e.g., a scalar or…

Machine Learning · Statistics 2022-08-04 Jackson Loper , David Blei , John P. Cunningham , Liam Paninski

Kernel phase interferometry (KPI) is a data processing technique that allows for the detection of asymmetries (such as companions or disks) in high-Strehl images, close to and within the classical diffraction limit. We show that KPI can…

Instrumentation and Methods for Astrophysics · Physics 2023-05-29 Alexander Chaushev , Steph Sallum , Julien Lozi , Frantz Martinache , Jeffrey Chilcote , Tyler Groff , Olivier Guyon , N. Jeremy Kasdin , Barnaby Norris , Andy Skemer

For many expensive deterministic computer simulators, the outputs do not have replication error and the desired metamodel (or statistical emulator) is an interpolator of the observed data. Realizations of Gaussian spatial processes (GP) are…

Methodology · Statistics 2012-03-07 Pritam Ranjan , Ronald Haynes , Richard Karsten

Sparse grids are popular tools for high-dimensional function approximation. In this work, we study the use of sparse grids for interpolation using separable Mat\'ern kernels…

Numerical Analysis · Mathematics 2026-04-14 Elliot J. Addy , Aretha L. Teckentrup

This paper presents performance results comparing MPI-based implementations of the popular Conjugate Gradient (CG) method and several of its communication hiding (or 'pipelined') variants. Pipelined CG methods are designed to efficiently…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-05-17 Siegfried Cools , Jeffrey Cornelis , Pieter Ghysels , Wim Vanroose

An interpolation error is an integral of the squared error of a regression model over a domain of interest. We consider the interpolation error for the case of misspecified Gaussian process regression: used covariance function differs from…

Statistics Theory · Mathematics 2018-03-28 A. Zaytsev , E. Romanenkova , D. Ermilov

Low-rank approximation is a task of critical importance in modern science, engineering, and statistics. Many low-rank approximation algorithms, such as the randomized singular value decomposition (RSVD), project their input matrix into a…

Numerical Analysis · Mathematics 2023-10-17 Robin Armstrong , Alex Buzali , Anil Damle

Through-plane resolution in clinical MRI is typically much coarser than in-plane resolution, limiting diagnostic utility. This work investigates deep learning approaches to interpolate intermediate MRI slices in prostate imaging,…

Image and Video Processing · Electrical Eng. & Systems 2026-05-19 Shamit Savant

The computational cost for inference and prediction of statistical models based on Gaussian processes with Mat\'ern covariance functions scales cubicly with the number of observations, limiting their applicability to large data sets. The…

Statistics Theory · Mathematics 2025-03-04 David Bolin , Vaibhav Mehandiratta , Alexandre B. Simas

This article advocates the use of conformal prediction (CP) methods for Gaussian process (GP) interpolation to enhance the calibration of prediction intervals. We begin by illustrating that using a GP model with parameters selected by…

Machine Learning · Computer Science 2024-07-12 Aurélien Pion , Emmanuel Vazquez

Combining kernel-based collocation methods with time-stepping methods to solve parabolic partial differential equations can potentially introduce challenges in balancing temporal and spatial discretization errors. Typically, using kernels…

Numerical Analysis · Mathematics 2024-10-25 Yichen Su , Leevan Ling

We introduce a scalable Gaussian process (GP) framework with deep product kernels for data-driven learning of parametrized spatio-temporal fields over fixed or parameter-dependent domains. The proposed framework learns a continuous…

Machine Learning · Computer Science 2026-03-03 Srinath Dama , Prasanth B. Nair

Gaussian process (GP) regression is a Bayesian nonparametric method for regression and interpolation, offering a principled way of quantifying the uncertainties of predicted function values. For the quantified uncertainties to be…

Statistics Theory · Mathematics 2025-08-22 Masha Naslidnyk , Motonobu Kanagawa , Toni Karvonen , Maren Mahsereci

We propose a new technique for constructing low-rank approximations of matrices that arise in kernel methods for machine learning. Our approach pairs a novel automatically constructed analytic expansion of the underlying kernel function…

Machine Learning · Computer Science 2022-02-09 John Paul Ryan , Anil Damle

This paper studies the influence of scaling on the behavior of Radial Basis Function interpolation. It focuses on certain central aspects, but does not try to be exhaustive. The most important questions are: How does the error of a…

Numerical Analysis · Mathematics 2022-10-12 Elisabeth Larsson , Robert Schaback

Gaussian processes (GPs) are ubiquitous tools for modeling and predicting continuous processes in physical and engineering sciences. This is partly due to the fact that one may employ a Gaussian process as an interpolator while facilitating…

Statistics Theory · Mathematics 2025-12-16 D. Andrew Brown , Peter Kiessler , John Nicholson

Despite being a key bottleneck in many machine learning tasks, the cost of solving large linear systems has proven challenging to quantify due to problem-dependent quantities such as condition numbers. To tackle this, we consider a…

Data Structures and Algorithms · Computer Science 2025-06-18 Michał Dereziński , Daniel LeJeune , Deanna Needell , Elizaveta Rebrova