English
Related papers

Related papers: Fast and Provably Accurate Sequential Designs usin…

200 papers

We study integration and $L^2$-approximation in the worst-case setting for deterministic linear algorithms based on function evaluations. The underlying function space is a reproducing kernel Hilbert space with a Gaussian kernel of tensor…

Numerical Analysis · Mathematics 2025-12-08 Michael Gnewuch , Klaus Ritter , Robin Rüßmann

Gaussian processes regression models are an appealing machine learning method as they learn expressive non-linear models from exemplar data with minimal parameter tuning and estimate both the mean and covariance of unseen points. However,…

Machine Learning · Computer Science 2020-08-25 Vladimir Joukov , Dana Kulić

Gaussian processes are a versatile probabilistic machine learning model whose effectiveness often depends on good hyperparameters, which are typically learned by maximising the marginal likelihood. In this work, we consider iterative…

Machine Learning · Computer Science 2024-05-29 Jihao Andreas Lin , Shreyas Padhy , Bruno Mlodozeniec , José Miguel Hernández-Lobato

We examine an analytic variational inference scheme for the Gaussian Process State Space Model (GPSSM) - a probabilistic model for system identification and time-series modelling. Our approach performs variational inference over both the…

Machine Learning · Statistics 2018-12-11 Alessandro Davide Ialongo , Mark van der Wilk , Carl Edward Rasmussen

Importance sampling (IS) and numerical integration methods are usually employed for approximating moments of complicated target distributions. In its basic procedure, the IS methodology randomly draws samples from a proposal distribution…

Computation · Statistics 2022-04-12 Víctor Elvira , Luca Martino , Pau Closas

Gaussian process modeling is a standard tool for building emulators for computer experiments, which are usually used to study deterministic functions, for example, a solution to a given system of partial differential equations. This work…

Statistics Theory · Mathematics 2021-10-01 Wenjia Wang

Experimental exploration of high-cost systems with safety constraints, common in engineering applications, is a challenging endeavor. Data-driven models offer a promising solution, but acquiring the requisite data remains expensive and is…

Machine Learning · Computer Science 2025-04-17 Markus Lange-Hegermann , Christoph Zimmer

We consider an incremental approximation method for solving variational problems in infinite-dimensional Hilbert spaces, where in each step a randomly and independently selected subproblem from an infinite collection of subproblems is…

Numerical Analysis · Mathematics 2018-03-06 Michael Griebel , Peter Oswald

Complex-valued signals are used in the modeling of many systems in engineering and science, hence being of fundamental interest. Often, random complex-valued signals are considered to be proper. A proper complex random variable or process…

Machine Learning · Computer Science 2015-02-19 Rafael Boloix-Tortosa , F. Javier Payán-Somet , Eva Arias-de-Reyna , Juan José Murillo-Fuentes

Gaussian processes (GPs) are powerful but computationally expensive machine learning models, requiring an estimate of the kernel covariance matrix for every prediction. In large and complex domains, such as graphs, sets, or images, the…

Machine Learning · Computer Science 2022-04-22 Alessandro Tibo , Thomas Dyhre Nielsen

We present a practical way of introducing convolutional structure into Gaussian processes, making them more suited to high-dimensional inputs like images. The main contribution of our work is the construction of an inter-domain inducing…

Machine Learning · Statistics 2017-09-07 Mark van der Wilk , Carl Edward Rasmussen , James Hensman

The Gaussian kernel plays a central role in machine learning, uncertainty quantification and scattered data approximation, but has received relatively little attention from a numerical analysis standpoint. The basic problem of finding an…

Numerical Analysis · Mathematics 2021-04-02 Toni Karvonen , Chris J. Oates , Mark Girolami

Scalable Gaussian process (GP) inference is essential for sequential decision-making tasks, yet improving GP scalability remains a challenging problem with many open avenues of research. This paper focuses on iterative GPs, where iterative…

Machine Learning · Computer Science 2025-11-21 Alan Yufei Dong , Jihao Andreas Lin , José Miguel Hernández-Lobato

This paper proposes a new formulation of functional Gaussian Process regression in manifolds, based on an Empirical Bayes approach, in the spatiotemporal random field context. We apply the machinery of tight Gaussian measures in separable…

Machine Learning · Statistics 2026-03-24 MD Ruiz-Medina , AE Madrid , A Torres-Signes , JM Angulo

The state-of-the-art linked Gaussian process offers a way to build analytical emulators for systems of computer models. We generalize the closed form expressions for the linked Gaussian process under the squared exponential kernel to a…

Methodology · Statistics 2021-02-09 Deyu Ming , Serge Guillas

Computing accurate estimates of the Fourier transform of analog signals from discrete data points is important in many fields of science and engineering. The conventional approach of performing the discrete Fourier transform of the data…

Machine Learning · Statistics 2017-12-08 Luca Ambrogioni , Eric Maris

Large-scale precision matrix estimation is of fundamental importance yet challenging in many contemporary applications for recovering Gaussian graphical models. In this paper, we suggest a new approach of innovated scalable efficient…

Methodology · Statistics 2016-05-12 Yingying Fan , Jinchi Lv

The use of Gaussian processes (GPs) is supported by efficient sampling algorithms, a rich methodological literature, and strong theoretical grounding. However, due to their prohibitive computation and storage demands, the use of exact GPs…

Statistics Theory · Mathematics 2022-07-27 Kelly R. Moran , Matthew W. Wheeler

Gaussian processes (GPs) provide flexible distributions over functions, with inductive biases controlled by a kernel. However, in many applications Gaussian processes can struggle with even moderate input dimensionality. Learning a low…

Machine Learning · Computer Science 2020-01-01 Ian A. Delbridge , David S. Bindel , Andrew Gordon Wilson

We develop a scalable class of models for latent variable estimation using composite Gaussian processes, with a focus on derivative Gaussian processes. We jointly model multiple data sources as outputs to improve the accuracy of latent…