English
Related papers

Related papers: Upgrading from Gaussian Processes to Student's-T P…

200 papers

This paper tackles efficient methods for Bayesian inverse problems with priors based on Whittle--Mat\'ern Gaussian random fields. The Whittle--Mat\'ern prior is characterized by a mean function and a covariance operator that is taken as a…

Numerical Analysis · Mathematics 2022-05-12 Harbir Antil , Arvind K. Saibaba

State-space models have been successfully used for more than fifty years in different areas of science and engineering. We present a procedure for efficient variational Bayesian learning of nonlinear state-space models based on sparse…

Machine Learning · Computer Science 2014-11-04 Roger Frigola , Yutian Chen , Carl E. Rasmussen

Uncertainty quantification in reinforcement learning can greatly improve exploration and robustness. Approximate Bayesian approaches have recently been popularized to quantify uncertainty in model-free algorithms. However, so far the focus…

Machine Learning · Computer Science 2025-09-01 Pascal R. van der Vaart , Neil Yorke-Smith , Matthijs T. J. Spaan

We introduce a novel adaptive Gaussian Process Regression (GPR) methodology for efficient construction of surrogate models for Bayesian inverse problems with expensive forward model evaluations. An adaptive design strategy focuses on…

Numerical Analysis · Mathematics 2024-05-01 Paolo Villani , Jörg Unger , Martin Weiser

Gaussian process hyperparameter optimization requires linear solves with, and log-determinants of, large kernel matrices. Iterative numerical techniques are becoming popular to scale to larger datasets, relying on the conjugate gradient…

Machine Learning · Computer Science 2022-06-22 Jonathan Wenger , Geoff Pleiss , Philipp Hennig , John P. Cunningham , Jacob R. Gardner

Bayesian optimization (BO) has established itself as a leading strategy for efficiently optimizing expensive-to-evaluate functions. Existing BO methods mostly rely on Gaussian process (GP) surrogate models and are not applicable to…

Machine Learning · Computer Science 2024-01-29 Yongsheng Mei , Mahdi Imani , Tian Lan

Hierarchical beta process has found interesting applications in recent years. In this paper we present a modified hierarchical beta process prior with applications to hierarchical modeling of multiple data sources. The novel use of the…

Machine Learning · Computer Science 2012-10-19 Sunil Kumar Gupta , Dinh Q. Phung , Svetha Venkatesh

Latent Gaussian models and boosting are widely used techniques in statistics and machine learning. Tree-boosting shows excellent prediction accuracy on many data sets, but potential drawbacks are that it assumes conditional independence of…

Machine Learning · Computer Science 2022-08-24 Fabio Sigrist

This work leverages recent advances in probabilistic machine learning to discover conservation laws expressed by parametric linear equations. Such equations involve, but are not limited to, ordinary and partial differential,…

Machine Learning · Computer Science 2017-09-13 Maziar Raissi , George Em. Karniadakis

Gaussian processes (GPs) are a mature and widely-used component of the ML toolbox. One of their desirable qualities is automatic hyperparameter selection, which allows for training without user intervention. However, in many realistic…

Machine Learning · Computer Science 2024-02-16 Sebastian W. Ober , Artem Artemev , Marcel Wagenländer , Rudolfs Grobins , Mark van der Wilk

We construct flexible likelihoods for multi-output Gaussian process models that leverage neural networks as components. We make use of sparse variational inference methods to enable scalable approximate inference for the resulting class of…

Machine Learning · Statistics 2019-06-03 Martin Jankowiak , Jacob Gardner

Gaussian boson sampling is originally proposed to show quantum advantage with quantum linear optical elements. Recently, several experimental breakthroughs based on Gaussian boson sampling pointing to quantum computing supremacy have been…

Quantum Physics · Physics 2023-01-02 Tian-Yu Yang , Yi-Xin Shen , Zhou-Kai Cao , Xiang-Bin Wang

It is a common practice in the machine learning community to assume that the observed data are noise-free in the input attributes. Nevertheless, scenarios with input noise are common in real problems, as measurements are never perfectly…

We consider a modification of the covariance function in Gaussian processes to correctly account for known linear constraints. By modelling the target function as a transformation of an underlying function, the constraints are explicitly…

Machine Learning · Statistics 2017-09-20 Carl Jidling , Niklas Wahlström , Adrian Wills , Thomas B. Schön

Complex computer codes are often too time expensive to be directly used to perform uncertainty propagation studies, global sensitivity analysis or to solve optimization problems. A well known and widely used method to circumvent this…

Applications · Statistics 2008-04-06 Amandine Marrel , Bertrand Iooss , Francois Van Dorpe , Elena Volkova

We consider a prior for nonparametric Bayesian estimation which uses finite random series with a random number of terms. The prior is constructed through distributions on the number of basis functions and the associated coefficients. We…

Statistics Theory · Mathematics 2015-02-10 Weining Shen , Subhashis Ghosal

A common challenge in computer experiments and related fields is to efficiently explore the input space using a small number of samples, i.e., the experimental design problem. Much of the recent focus in the computer experiment literature,…

Methodology · Statistics 2019-07-01 Boya Zhang , D. Austin Cole , Robert B. Gramacy

Computing a Gaussian process (GP) posterior has a computational cost cubical in the number of historical points. A reformulation of the same GP posterior highlights that this complexity mainly depends on how many \emph{unique} historical…

Machine Learning · Statistics 2022-02-01 Daniele Calandriello , Luigi Carratino , Alessandro Lazaric , Michal Valko , Lorenzo Rosasco

Bayesian optimization devolves the global optimization of a costly objective function to the global optimization of a sequence of acquisition functions. This inner-loop optimization can be catastrophically difficult if it involves posterior…

Machine Learning · Computer Science 2025-04-02 Taiwo A. Adebiyi , Bach Do , Ruda Zhang

We introduce the concept of conjugate prior models for a given likelihood function in Bayesian spatial inversion. The conjugate class of prior models can be selection extended and still remain conjugate. We demonstrate the generality of…

Methodology · Statistics 2018-12-06 Henning Omre , Kjartan Rimstad