English
Related papers

Related papers: Exploiting Hankel-Toeplitz Structures for Fast Com…

200 papers

The Hessian matrix has a number of important applications in a variety of different fields, such as optimzation, image processing and statistics. In this paper we focus on the practical aspects of efficiently computing Hessian matrices in…

Machine Learning · Computer Science 2021-04-08 Geir K. Nilsen , Antonella Z. Munthe-Kaas , Hans J. Skaug , Morten Brun

Gaussian processes (GP) are Bayesian non-parametric models that are widely used for probabilistic regression. Unfortunately, it cannot scale well with large data nor perform real-time predictions due to its cubic time cost in the data size.…

Machine Learning · Computer Science 2014-08-12 Jie Chen , Nannan Cao , Kian Hsiang Low , Ruofei Ouyang , Colin Keng-Yan Tan , Patrick Jaillet

Gaussian processes (GP) are Bayesian non-parametric models that are widely used for probabilistic regression. Unfortunately, it cannot scale well with large data nor perform real-time predictions due to its cubic time cost in the data size.…

Machine Learning · Statistics 2013-05-27 Jie Chen , Nannan Cao , Kian Hsiang Low , Ruofei Ouyang , Colin Keng-Yan Tan , Patrick Jaillet

Gaussian Processes (GPs) are highly expressive, probabilistic models. A major limitation is their computational complexity. Naively, exact GP inference requires $\mathcal{O}(N^3)$ computations with $N$ denoting the number of modeled points.…

Machine Learning · Computer Science 2022-06-23 Gordian Edenhofer , Reimar H. Leike , Philipp Frank , Torsten A. Enßlin

Predicting the labels of graph-structured data is crucial in scientific applications and is often achieved using graph neural networks (GNNs). However, when data is scarce, GNNs suffer from overfitting, leading to poor performance.…

Machine Learning · Computer Science 2025-05-19 Mathieu Alain , So Takao , Xiaowen Dong , Bastian Rieck , Emmanuel Noutahi

The computation of the matrix exponential is a ubiquitous operation in numerical mathematics, and for a general, unstructured $n\times n$ matrix it can be computed in $\mathcal{O}(n^3)$ operations. An interesting problem arises if the input…

Numerical Analysis · Mathematics 2021-06-02 Daniel Kressner , Robert Luce

We propose a representation of Gaussian processes (GPs) based on powers of the integral operator defined by a kernel function, we call these stochastic processes integral Gaussian processes (IGPs). Sample paths from IGPs are functions…

Machine Learning · Statistics 2019-03-08 Zilong Tan , Sayan Mukherjee

To speed up Gaussian process inference, a number of fast kernel matrix-vector multiplication (MVM) approximation algorithms have been proposed over the years. In this paper, we establish an exact fast kernel MVM algorithm based on exact…

Machine Learning · Statistics 2025-08-05 Nicolas Langrené , Xavier Warin , Pierre Gruet

This paper presents a method for approximate Gaussian process (GP) regression with tensor networks (TNs). A parametric approximation of a GP uses a linear combination of basis functions, where the accuracy of the approximation depends on…

Machine Learning · Statistics 2023-11-01 Clara Menzen , Eva Memmel , Kim Batselier , Manon Kok

This article proposes an efficient numerical method for solving nonlinear partial differential equations (PDEs) based on sparse Gaussian processes (SGPs). Gaussian processes (GPs) have been extensively studied for solving PDEs by…

Numerical Analysis · Mathematics 2023-08-09 Rui Meng , Xianjin Yang

We provide guarantees for approximate Gaussian Process (GP) regression resulting from two common low-rank kernel approximations: based on random Fourier features, and based on truncating the kernel's Mercer expansion. In particular, we…

Machine Learning · Statistics 2022-02-22 Constantinos Daskalakis , Petros Dellaportas , Aristeidis Panos

We provide guarantees for approximate Gaussian Process (GP) regression resulting from two common low-rank kernel approximations: based on random Fourier features, and based on truncating the kernel's Mercer expansion. In particular, we…

Machine Learning · Statistics 2021-12-16 Constantinos Daskalakis , Petros Dellaportas , Aristeidis Panos

In this paper, we propose a Gaussian Process (GP) emulator for the calculation of a) tomographic weak lensing band-power spectra, and b) coefficients of summary data massively compressed with the MOPED algorithm. In the former case…

Cosmology and Nongalactic Astrophysics · Physics 2020-07-29 Arrykrishna Mootoovaloo , Alan F. Heavens , Andrew H. Jaffe , Florent Leclercq

We propose a method (TT-GP) for approximate inference in Gaussian Process (GP) models. We build on previous scalable GP research including stochastic variational inference based on inducing inputs, kernel interpolation, and structure…

Machine Learning · Computer Science 2018-01-18 Pavel Izmailov , Alexander Novikov , Dmitry Kropotov

Gaussian processes (GPs) are Bayesian non-parametric models popular in a variety of applications due to their accuracy and native uncertainty quantification (UQ). Tuning GP hyperparameters is critical to ensure the validity of prediction…

Machine Learning · Computer Science 2022-11-03 Killian Wood , Alec M. Dunton , Amanda Muyskens , Benjamin W. Priest

We introduce a scalable Gaussian process (GP) framework with deep product kernels for data-driven learning of parametrized spatio-temporal fields over fixed or parameter-dependent domains. The proposed framework learns a continuous…

Machine Learning · Computer Science 2026-03-03 Srinath Dama , Prasanth B. Nair

We study the robust matrix completion problem for the low-rank Hankel matrix, which detects the sparse corruptions caused by extreme outliers while we try to recover the original Hankel matrix from the partial observation. In this paper, we…

Information Theory · Computer Science 2025-04-17 HanQin Cai , Jian-Feng Cai , Juntao You

Gaussian Process (GP) models are widely utilized as surrogate models in scientific and engineering fields. However, standard GP models are limited to continuous variables due to the difficulties in establishing correlation structures for…

Machine Learning · Statistics 2025-03-05 Mingyu Pu , Songhao Wang , Haowei Wang , Szu Hui Ng

Fast computation of three-dimensional gravity and magnetic forward models is considered. Measurement data is assumed to be obtained on a uniform grid which is staggered with respect to the discretization of the parameter volume. Then, the…

Numerical Analysis · Mathematics 2022-08-16 Jarom D Hogue , Rosemary A Renaut , Saeed Vatankhah

Additive Gaussian Processes (GPs) are popular approaches for nonparametric feature selection. The common training method for these models is Bayesian Back-fitting. However, the convergence rate of Back-fitting in training additive GPs is…

Machine Learning · Statistics 2024-04-02 Lu Zou , Liang Ding