English
Related papers

Related papers: Fast multilevel sparse Gaussian kernels for high-d…

200 papers

We propose a sparse interpolation construction and a practical coarsening algorithm for the algebraic multigrid (AMG) method, tailored towards H(curl). Building on the generalized AMG framework, we introduce an interior/exterior splitting…

Numerical Analysis · Mathematics 2026-03-02 Taoli Shen , James Brannick , Robert Falgout , Karsten Kahl , Jacob Schroder

Gaussian processes are powerful models for probabilistic machine learning, but are limited in application by their $O(N^3)$ inference complexity. We propose a method for deriving parametric families of kernel functions with compact spatial…

Machine Learning · Computer Science 2020-06-09 Jarred Barber

A nearly optimal explicitly-sparse representation for oscillatory kernels is presented in this work by developing a curvelet based method. Multilevel curvelet-like functions are constructed as the transform of the original nodal basis. Then…

Numerical Analysis · Mathematics 2025-04-29 Yanchuang Cao , Jun Liu , Dawei Chen

Standard Gaussian Process (GP) regression, a powerful machine learning tool, is computationally expensive when it is applied to large datasets, and potentially inaccurate when data points are sparsely distributed in a high-dimensional…

Machine Learning · Computer Science 2016-03-08 Z. Zhang , K. Duraisamy , N. A. Gumerov

Gaussian processes (GPs) have gained popularity as flexible machine learning models for regression and function approximation with an in-built method for uncertainty quantification. However, GPs suffer when the amount of training data is…

Machine Learning · Statistics 2025-11-26 Jonas Latz , Aretha L. Teckentrup , Simon Urbainczyk

The application of Gaussian processes (GPs) to large data sets is limited due to heavy memory and computational requirements. A variety of methods has been proposed to enable scalability, one of which is to exploit structure in the kernel…

Machine Learning · Computer Science 2019-12-30 Jan Graßhoff , Alexandra Jankowski , Philipp Rostalski

Gaussian processes (GPs) provide a principled Bayesian framework for uncertainty estimation, but their computational complexity severely limits scalability to large datasets. We propose SIKA-GP, which accelerates GP inference using sparse…

Machine Learning · Computer Science 2026-05-27 Wenyuan Zhao , Rui Tuo , Chao Tian

We consider a Gaussian process formulation of the multiple kernel learning problem. The goal is to select the convex combination of kernel matrices that best explains the data and by doing so improve the generalisation on unseen data.…

Machine Learning · Statistics 2011-10-25 Cedric Archambeau , Francis Bach

Meshfree methods, including the reproducing kernel particle method (RKPM), have been widely used within the computational mechanics community to model physical phenomena in materials undergoing large deformations or extreme topology…

Numerical Analysis · Mathematics 2025-06-19 Jennifer E. Fromm , John A. Evans , J. S. Chen

The parallel linear equations solver capable of effectively using 1000+ processors becomes the bottleneck of large-scale implicit engineering simulations. In this paper, we present a new hierarchical parallel master-slave-structural…

Computational Physics · Physics 2015-06-11 Ran Xu , Bin Liu , Yuan Dong

Learning linear combinations of multiple kernels is an appealing strategy when the right choice of features is unknown. Previous approaches to multiple kernel learning (MKL) promote sparse kernel combinations to support interpretability and…

Machine Learning · Computer Science 2010-10-28 Marius Kloft , Ulf Brefeld , Soeren Sonnenburg , Alexander Zien

Advanced algorithms for large-scale electronic structure calculations are mostly based on processing multi-dimensional sparse data. Examples are sparse matrix-matrix multiplications in linear-scaling Kohn-Sham calculations or the efficient…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-31 Ilia Sivkov , Patrick Seewald , Alfio Lazzaro , Juerg Hutter

Gaussian processes are popular and flexible models for spatial, temporal, and functional data, but they are computationally infeasible for large datasets. We discuss Gaussian-process approximations that use basis functions at multiple…

Methodology · Statistics 2020-12-22 Matthias Katzfuss , Wenlong Gong

A Gaussian Process (GP) is a prominent mathematical framework for stochastic function approximation in science and engineering applications. This success is largely attributed to the GP's analytical tractability, robustness, non-parametric…

Machine Learning · Statistics 2022-05-19 Marcus M. Noack , Harinarayan Krishnan , Mark D. Risser , Kristofer G. Reyes

Sparse grids are popular tools for high-dimensional function approximation. In this work, we study the use of sparse grids for interpolation using separable Mat\'ern kernels…

Numerical Analysis · Mathematics 2026-04-14 Elliot J. Addy , Aretha L. Teckentrup

We present a sparse linear system solver that is based on a multifrontal variant of Gaussian elimination, and exploits low-rank approximation of the resulting dense frontal matrices. We use hierarchically semiseparable (HSS) matrices, which…

Mathematical Software · Computer Science 2015-02-27 Pieter Ghysels , Xiaoye S. Li , Francois-Henry Rouet , Samuel Williams , Artem Napov

Gaussian processes (GPs) provide flexible distributions over functions, with inductive biases controlled by a kernel. However, in many applications Gaussian processes can struggle with even moderate input dimensionality. Learning a low…

Machine Learning · Computer Science 2020-01-01 Ian A. Delbridge , David S. Bindel , Andrew Gordon Wilson

Geodesic distance matrices can reveal shape properties that are largely invariant to non-rigid deformations, and thus are often used to analyze and represent 3-D shapes. However, these matrices grow quadratically with the number of points.…

Machine Learning · Statistics 2018-04-02 Javier S. Turek , Alexander Huth

We develop and implement in this paper a fast sparse assembly algorithm, the fundamental operation which creates a compressed matrix from raw index data. Since it is often a quite demanding and sometimes critical operation, it is of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-04-28 Stefan Engblom , Dimitar Lukarski

Multigrid methods have proven to be an invaluable tool to efficiently solve large sparse linear systems arising in the discretization of partial differential equations (PDEs). Algebraic multigrid methods and in particular adaptive algebraic…

Numerical Analysis · Mathematics 2020-04-27 Hanno Gottschalk , Karsten Kahl