English
Related papers

Related papers: Scaling Gaussian Process Regression with Full Deri…

200 papers

We introduce a stochastic variational inference procedure for training scalable Gaussian process (GP) models whose per-iteration complexity is independent of both the number of training points, $n$, and the number basis functions used in…

Machine Learning · Statistics 2020-06-05 Trefor W. Evans , Prasanth B. Nair

Gaussian Processes (GPs) are widely recognized as powerful non-parametric models for regression and classification. Traditional GP frameworks predominantly operate under the assumption that the inputs are either accurately known or subject…

Systems and Control · Electrical Eng. & Systems 2025-10-14 Muzaffar Qureshi , Tochukwu Elijah Ogri , Zachary I. Bell , Wanjiku A. Makumi , Rushikesh Kamalapurkar

Many methods have been proposed to quantify the predictive uncertainty associated with the outputs of deep neural networks. Among them, ensemble methods often lead to state-of-the-art results, though they require modifications to the…

Machine Learning · Computer Science 2021-05-11 Zhiyun Lu , Eugene Ie , Fei Sha

Gaussian process (GP) regression is a popular surrogate modeling tool for computer simulations in engineering and scientific domains. However, it often struggles with high computational costs and low prediction accuracy when the simulation…

Machine Learning · Computer Science 2025-02-25 Lulu Kang , Minshen Xu

We introduce a novel stochastic variational inference method for Gaussian process ($\mathcal{GP}$) regression, by deriving a posterior over a learnable set of coresets: i.e., over pseudo-input/output, weighted pairs. Unlike former free-form…

Machine Learning · Computer Science 2025-03-06 Mert Ketenci , Adler Perotte , Noémie Elhadad , Iñigo Urteaga

Gaussian process (GP) regression is a powerful probabilistic modeling technique with built-in uncertainty quantification. When one has access to multiple correlated simulations (tasks), it is common to fit a multitask GP (MTGP) surrogate…

Computation · Statistics 2026-03-18 Aleksei G. Sorokin , Pieterjan Robbe , Fred J. Hickernell

In this paper, we investigate a class of approximate Gaussian processes (GP) obtained by taking a linear combination of compactly supported basis functions with the basis coefficients endowed with a dependent Gaussian prior distribution.…

Statistics Theory · Mathematics 2025-06-02 Jaehoan Kim , Anirban Bhattacharya , Debdeep Pati

We present a PDE-based approach for the multidimensional extrapolation of smooth scalar quantities across interfaces with kinks and regions of high curvature. Unlike the commonly used method of [2] in which normal derivatives are…

Numerical Analysis · Mathematics 2023-09-26 Daniil Bochkov , Frederic Gibou

Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalability, one of their main advantages over sparse…

Machine Learning · Statistics 2021-02-24 Simone Rossi , Markus Heinonen , Edwin V. Bonilla , Zheyang Shen , Maurizio Filippone

The Gaussian process state-space model (GPSSM) has garnered considerable attention over the past decade. However, the standard GP with a preliminary kernel, such as the squared exponential kernel or Mat\'{e}rn kernel, that is commonly used…

Machine Learning · Computer Science 2023-04-07 Zhid Lin , Feng Yin , Juan Maroñas

Many scientific phenomena are studied using computer experiments consisting of multiple runs of a computer model while varying the input settings. Gaussian processes (GPs) are a popular tool for the analysis of computer experiments,…

Methodology · Statistics 2021-07-21 Matthias Katzfuss , Joseph Guinness , Earl Lawrence

Gaussian process (GP) regression provides a strategy for accelerating saddle point searches on high-dimensional energy surfaces by reducing the number of times the energy and its derivatives with respect to atomic coordinates need to be…

Chemical Physics · Physics 2025-12-03 Rohit Goswami , Hannes Jónsson

Flow-based generative models can face significant challenges when modeling scientific data with multiscale Fourier spectra, often producing large errors in fine-scale features. We address this problem within the framework of stochastic…

Machine Learning · Statistics 2025-09-04 Yifan Chen , Eric Vanden-Eijnden

Computer models are used as a way to explore complex physical systems. Stationary Gaussian process emulators, with their accompanying uncertainty quantification, are popular surrogates for computer models. However, many computer models are…

Methodology · Statistics 2024-11-25 Faezeh Yazdi , Derek Bingham , Daniel Williamson

Gaussian processes are rich distributions over functions, which provide a Bayesian nonparametric approach to smoothing and interpolation. We introduce simple closed form kernels that can be used with Gaussian processes to discover patterns…

Machine Learning · Statistics 2014-01-03 Andrew Gordon Wilson , Ryan Prescott Adams

This research note presents a derivation and implementation of efficient and scalable gradient computations using the celerite algorithm for Gaussian Process (GP) modeling. The algorithms are derived in a "reverse accumulation" or…

Instrumentation and Methods for Astrophysics · Physics 2018-02-01 Daniel Foreman-Mackey

In this paper, a new strategy for a sub-element based shock capturing for discontinuous Galerkin (DG) approximations is presented. The idea is to interpret a DG element as a collection of data and construct a hierarchy of low to high order…

Numerical Analysis · Mathematics 2020-12-17 Johannes Markert , Gregor Gassner , Stefanie Walch

We propose a new method for simplification of Gaussian process (GP) models by projecting the information contained in the full encompassing model and selecting a reduced number of variables based on their predictive relevance. Our results…

Methodology · Statistics 2017-12-18 Juho Piironen , Aki Vehtari

In this paper, we propose decentralized and scalable algorithms for Gaussian process (GP) training and prediction in multi-agent systems. To decentralize the implementation of GP training optimization algorithms, we employ the alternating…

Machine Learning · Statistics 2022-03-08 George P. Kontoudis , Daniel J. Stilwell

Key to being able to accurately model the properties of realistic materials is being able to predict their properties in the thermodynamic limit. Nevertheless, because most many-body electronic structure methods scale as a high-order…

Chemical Physics · Physics 2024-04-04 Edgar Josué Landinez Borda , Kenneth O. Berard , Annette Lopez , Brenda Rubenstein