中文
相关论文

相关论文: Scaling Gaussian Process Regression with Full Deri…

200 篇论文

We introduce a stochastic variational inference procedure for training scalable Gaussian process (GP) models whose per-iteration complexity is independent of both the number of training points, $n$, and the number basis functions used in…

机器学习 · 统计学 2020-06-05 Trefor W. Evans , Prasanth B. Nair

Gaussian Processes (GPs) are widely recognized as powerful non-parametric models for regression and classification. Traditional GP frameworks predominantly operate under the assumption that the inputs are either accurately known or subject…

系统与控制 · 电气工程与系统科学 2025-10-14 Muzaffar Qureshi , Tochukwu Elijah Ogri , Zachary I. Bell , Wanjiku A. Makumi , Rushikesh Kamalapurkar

Many methods have been proposed to quantify the predictive uncertainty associated with the outputs of deep neural networks. Among them, ensemble methods often lead to state-of-the-art results, though they require modifications to the…

机器学习 · 计算机科学 2021-05-11 Zhiyun Lu , Eugene Ie , Fei Sha

Gaussian process (GP) regression is a popular surrogate modeling tool for computer simulations in engineering and scientific domains. However, it often struggles with high computational costs and low prediction accuracy when the simulation…

机器学习 · 计算机科学 2025-02-25 Lulu Kang , Minshen Xu

We introduce a novel stochastic variational inference method for Gaussian process ($\mathcal{GP}$) regression, by deriving a posterior over a learnable set of coresets: i.e., over pseudo-input/output, weighted pairs. Unlike former free-form…

机器学习 · 计算机科学 2025-03-06 Mert Ketenci , Adler Perotte , Noémie Elhadad , Iñigo Urteaga

Gaussian process (GP) regression is a powerful probabilistic modeling technique with built-in uncertainty quantification. When one has access to multiple correlated simulations (tasks), it is common to fit a multitask GP (MTGP) surrogate…

统计计算 · 统计学 2026-03-18 Aleksei G. Sorokin , Pieterjan Robbe , Fred J. Hickernell

In this paper, we investigate a class of approximate Gaussian processes (GP) obtained by taking a linear combination of compactly supported basis functions with the basis coefficients endowed with a dependent Gaussian prior distribution.…

统计理论 · 数学 2025-06-02 Jaehoan Kim , Anirban Bhattacharya , Debdeep Pati

We present a PDE-based approach for the multidimensional extrapolation of smooth scalar quantities across interfaces with kinks and regions of high curvature. Unlike the commonly used method of [2] in which normal derivatives are…

数值分析 · 数学 2023-09-26 Daniil Bochkov , Frederic Gibou

Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalability, one of their main advantages over sparse…

机器学习 · 统计学 2021-02-24 Simone Rossi , Markus Heinonen , Edwin V. Bonilla , Zheyang Shen , Maurizio Filippone

The Gaussian process state-space model (GPSSM) has garnered considerable attention over the past decade. However, the standard GP with a preliminary kernel, such as the squared exponential kernel or Mat\'{e}rn kernel, that is commonly used…

机器学习 · 计算机科学 2023-04-07 Zhid Lin , Feng Yin , Juan Maroñas

Many scientific phenomena are studied using computer experiments consisting of multiple runs of a computer model while varying the input settings. Gaussian processes (GPs) are a popular tool for the analysis of computer experiments,…

统计方法学 · 统计学 2021-07-21 Matthias Katzfuss , Joseph Guinness , Earl Lawrence

Gaussian process (GP) regression provides a strategy for accelerating saddle point searches on high-dimensional energy surfaces by reducing the number of times the energy and its derivatives with respect to atomic coordinates need to be…

化学物理 · 物理学 2025-12-03 Rohit Goswami , Hannes Jónsson

Flow-based generative models can face significant challenges when modeling scientific data with multiscale Fourier spectra, often producing large errors in fine-scale features. We address this problem within the framework of stochastic…

机器学习 · 统计学 2025-09-04 Yifan Chen , Eric Vanden-Eijnden

Computer models are used as a way to explore complex physical systems. Stationary Gaussian process emulators, with their accompanying uncertainty quantification, are popular surrogates for computer models. However, many computer models are…

统计方法学 · 统计学 2024-11-25 Faezeh Yazdi , Derek Bingham , Daniel Williamson

Gaussian processes are rich distributions over functions, which provide a Bayesian nonparametric approach to smoothing and interpolation. We introduce simple closed form kernels that can be used with Gaussian processes to discover patterns…

机器学习 · 统计学 2014-01-03 Andrew Gordon Wilson , Ryan Prescott Adams

This research note presents a derivation and implementation of efficient and scalable gradient computations using the celerite algorithm for Gaussian Process (GP) modeling. The algorithms are derived in a "reverse accumulation" or…

天体物理仪器与方法 · 物理学 2018-02-01 Daniel Foreman-Mackey

In this paper, a new strategy for a sub-element based shock capturing for discontinuous Galerkin (DG) approximations is presented. The idea is to interpret a DG element as a collection of data and construct a hierarchy of low to high order…

数值分析 · 数学 2020-12-17 Johannes Markert , Gregor Gassner , Stefanie Walch

We propose a new method for simplification of Gaussian process (GP) models by projecting the information contained in the full encompassing model and selecting a reduced number of variables based on their predictive relevance. Our results…

统计方法学 · 统计学 2017-12-18 Juho Piironen , Aki Vehtari

In this paper, we propose decentralized and scalable algorithms for Gaussian process (GP) training and prediction in multi-agent systems. To decentralize the implementation of GP training optimization algorithms, we employ the alternating…

机器学习 · 统计学 2022-03-08 George P. Kontoudis , Daniel J. Stilwell

Key to being able to accurately model the properties of realistic materials is being able to predict their properties in the thermodynamic limit. Nevertheless, because most many-body electronic structure methods scale as a high-order…