English
Related papers

Related papers: Large-Scale Gaussian Processes via Alternating Pro…

200 papers

Learning precise surrogate models of complex computer simulations and physical machines often require long-lasting or expensive experiments. Furthermore, the modeled physical dependencies exhibit nonlinear and nonstationary behavior.…

Machine Learning · Computer Science 2023-03-20 Matthias Bitzer , Mona Meister , Christoph Zimmer

Accurate time series forecasting is crucial for optimizing resource allocation, industrial production, and urban management, particularly with the growth of cyber-physical and IoT systems. However, limited training sample availability in…

Machine Learning · Computer Science 2025-06-24 Yunyao Cheng , Chenjuan Guo , Kaixuan Chen , Kai Zhao , Bin Yang , Jiandong Xie , Christian S. Jensen , Feiteng Huang , Kai Zheng

Repetitive motion tasks are common in robotics, but performance can degrade over time due to environmental changes and robot wear and tear. Iterative learning control (ILC) improves performance by using information from previous iterations…

Robotics · Computer Science 2026-02-23 Unnati Nigam , Radhendushka Srivastava , Faezeh Marzbanrad , Michael Burke

Learning expressive kernels while retaining tractable inference remains a central challenge in scaling Gaussian processes (GPs) to large and complex datasets. We propose a scalable GP regressor based on deep basis kernels (DBKs). Our DBK is…

Machine Learning · Statistics 2026-02-05 Yunqin Zhu , Henry Shaowu Yuchi , Yao Xie

We present GP-4DGS, a novel framework that integrates Gaussian Processes (GPs) into 4D Gaussian Splatting (4DGS) for principled probabilistic modeling of dynamic scenes. While existing 4DGS methods focus on deterministic reconstruction,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Mijeong Kim , Jungtaek Kim , Bohyung Han

This paper proposes a generalization of the conjugate gradient (CG) method used to solve the equation $Ax=b$ for a symmetric positive definite matrix $A$ of large size $n$. The generalization consists of permitting the scalar control…

Numerical Analysis · Mathematics 2016-11-17 Amit Bhaya , Pierre-Alexandre Bliman , Guilherme Niedu , Fernando Pazos

Gaussian process (GP) regression provides a strategy for accelerating saddle point searches on high-dimensional energy surfaces by reducing the number of times the energy and its derivatives with respect to atomic coordinates need to be…

Chemical Physics · Physics 2025-12-03 Rohit Goswami , Hannes Jónsson

Gaussian processes (GPs) offer appealing properties but are costly to train at scale. Sparse variational GP (SVGP) approximations reduce cost yet still rely on Cholesky decompositions of kernel matrices, ill-suited to low-precision,…

Machine Learning · Statistics 2026-04-02 Stefano Cortinovis , Laurence Aitchison , Stefanos Eleftheriadis , Mark van der Wilk

Although machine learning is increasingly applied in control approaches, only few methods guarantee certifiable safety, which is necessary for real world applications. These approaches typically rely on well-understood learning algorithms,…

Machine Learning · Computer Science 2020-06-16 Armin Lederer , Markus Kessler , Sandra Hirche

Gaussian processes are flexible probabilistic regression models which are widely used in statistics and machine learning. However, a drawback is their limited scalability to large data sets. To alleviate this, full-scale approximations…

Methodology · Statistics 2026-01-13 Tim Gyger , Reinhard Furrer , Fabio Sigrist

We propose a flexible procedure for large-scale image search by hash functions with kernels. Our method treats binary codes and pairwise semantic similarity as latent and observed variables, respectively, in a probabilistic model based on…

Computer Vision and Pattern Recognition · Computer Science 2016-04-26 Bahadir Ozdemir , Larry S. Davis

Deep Gaussian processes (DGPs) are popular surrogate models for complex nonstationary computer experiments. DGPs use one or more latent Gaussian processes (GPs) to warp the input space into a plausibly stationary regime, then use typical GP…

Methodology · Statistics 2025-12-23 Annie S. Booth

In this paper, we explore the application of Gaussian Processes (GPs) for predicting mean-reverting time series with an underlying structure, using relatively unexplored functional and augmented data structures. While many conventional…

Statistical Finance · Quantitative Finance 2024-03-05 Narayan Tondapu

One obstacle to the use of Gaussian processes (GPs) in large-scale problems, and as a component in deep learning system, is the need for bespoke derivations and implementations for small variations in the model or inference. In order to…

Machine Learning · Statistics 2020-03-04 Mark van der Wilk , Vincent Dutordoir , ST John , Artem Artemev , Vincent Adam , James Hensman

Discrete automated processes in industrial and cyber-physical systems often exhibit a repetitive structure in which successive repetitions follow a common trajectory while differing in duration, amplitude, and fine-scale dynamics. Such…

Machine Learning · Statistics 2026-05-14 Elias Reich , Saverio Messineo , Stefan Huber

We present techniques for effective Gaussian process (GP) modelling of multiple short time series. These problems are common when applying GP models independently to each gene in a gene expression time series data set. Such sets typically…

Machine Learning · Statistics 2012-10-10 Hande Topa , Antti Honkela

Designing categorical kernels is a major challenge for Gaussian process regression with continuous and categorical inputs. Despite previous studies, it is difficult to identify a preferred method, either because the evaluation metrics, the…

Machine Learning · Statistics 2025-10-03 Raphaël Carpintero Perez , Sébastien Da Veiga , Josselin Garnier

The generalized minimal residual (GMRES) algorithm is applied to image reconstruction using linear computed tomography (CT) models. The GMRES algorithm iteratively solves square, non-symmetric linear systems and it has practical application…

Medical Physics · Physics 2022-05-04 Emil Y. Sidky , Per Christian Hansen , Jakob S. Jørgensen , Xiaochuan Pan

Approximate Bayesian computation (ABC) can be used for model fitting when the likelihood function is intractable but simulating from the model is feasible. However, even a single evaluation of a complex model may take several hours,…

Machine Learning · Statistics 2018-02-19 Marko Järvenpää , Michael Gutmann , Aki Vehtari , Pekka Marttinen

This paper examines experimental design procedures used to develop surrogates of computational models, exploring the interplay between experimental designs and approximation algorithms. We focus on two widely used approximation approaches,…

Numerical Analysis · Computer Science 2016-05-02 Alex A. Gorodetsky , Youssef M. Marzouk