English
Related papers

Related papers: Improving the Gaussian Process Sparse Spectrum App…

200 papers

We introduce a variational Bayesian neural network where the parameters are governed via a probability distribution on random matrices. Specifically, we employ a matrix variate Gaussian \cite{gupta1999matrix} parameter posterior…

Machine Learning · Statistics 2016-06-24 Christos Louizos , Max Welling

Gaussian processes scale prohibitively with the size of the dataset. In response, many approximation methods have been developed, which inevitably introduce approximation error. This additional source of uncertainty, due to limited…

Machine Learning · Computer Science 2023-10-11 Jonathan Wenger , Geoff Pleiss , Marvin Pförtner , Philipp Hennig , John P. Cunningham

Mechanistic simulation models are inverted against observations in order to gain inference on modeled processes. However, with the increasing ability to collect high resolution observations, these observations represent more patterns of…

Computation · Statistics 2018-12-20 Thomas Wutzler

Gaussian processes (GPs) are an important tool in machine learning and statistics with applications ranging from social and natural science through engineering. They constitute a powerful kernelized non-parametric method with…

Machine Learning · Statistics 2021-12-20 Manuel Schürch , Dario Azzimonti , Alessio Benavoli , Marco Zaffalon

Maximizing high-dimensional, non-convex functions through noisy observations is a notoriously hard problem, but one that arises in many applications. In this paper, we tackle this challenge by modeling the unknown function as a sample from…

Machine Learning · Computer Science 2012-07-03 Bo Chen , Rui Castro , Andreas Krause

Quasi-periodicity refers to a pattern in a function where it appears periodic but has evolving amplitudes over time. This is often the case in practical settings such as the modeling of case counts of infectious disease or the carbon…

Methodology · Statistics 2023-05-18 Ziang Zhang , Patrick Brown , Jamie Stafford

Gaussian processes (GPs) are widely used in nonparametric regression, classification and spatio-temporal modeling, motivated in part by a rich literature on theoretical properties. However, a well known drawback of GPs that limits their use…

Methodology · Statistics 2011-06-29 Anjishnu Banerjee , David Dunson , Surya Tokdar

Gaussian Processes (GPs) are powerful kernelized methods for non-parameteric regression used in many applications. However, their use is limited to a few thousand of training samples due to their cubic time complexity. In order to scale GPs…

Machine Learning · Statistics 2021-12-20 Manuel Schürch , Dario Azzimonti , Alessio Benavoli , Marco Zaffalon

The accuracy of Bayesian inference can be negatively affected by the use of inaccurate forward models. In the case of gravitational-wave inference, accurate but computationally expensive waveform models are sometimes substituted with faster…

Instrumentation and Methods for Astrophysics · Physics 2024-04-02 Miaoxin Liu , Xiao-Dong Li , Alvin J. K. Chua

We propose a scalable framework for inference in an inhomogeneous Poisson process modeled by a continuous sigmoidal Cox process that assumes the corresponding intensity function is given by a Gaussian process (GP) prior transformed with a…

Machine Learning · Statistics 2019-06-10 Virginia Aglietti , Edwin V. Bonilla , Theodoros Damoulas , Sally Cripps

A key challenge in the practical application of Gaussian processes (GPs) is selecting a proper covariance function. The moving average, or process convolutions, construction of GPs allows some additional flexibility, but still requires…

Machine Learning · Statistics 2022-10-19 Thomas M. McDonald , Magnus Ross , Michael T. Smith , Mauricio A. Álvarez

We introduce new Gaussian Process (GP) high-order approximations to linear operations that are frequently used in various numerical methods. Our method employs the kernel-based GP regression modeling, a non-parametric Bayesian approach to…

Computational Physics · Physics 2025-06-09 Christopher DeGrendele , Dongwook Lee

Two complementary approaches have been extensively used in signal and image processing leading to novel results, the sparse representation methodology and the variational strategy. Recently, a new sparsity based model has been proposed, the…

Computer Vision and Pattern Recognition · Computer Science 2015-08-17 Raja Giryes , Michael Elad , Alfred M. Bruckstein

Random feature methods have been successful in various machine learning tasks, are easy to compute, and come with theoretical accuracy bounds. They serve as an alternative approach to standard neural networks since they can represent…

Machine Learning · Statistics 2026-01-21 Abolfazl Hashemi , Hayden Schaeffer , Robert Shi , Ufuk Topcu , Giang Tran , Rachel Ward

A Gaussian process (GP)-based methodology is proposed to emulate complex dynamical computer models (or simulators). The method relies on emulating the numerical flow map of the system over an initial (short) time step, where the flow map is…

Methodology · Statistics 2024-11-26 Hossein Mohammadi , Peter Challenor , Marc Goodfellow

Examples with bound information on the regression function and density abound in many real applications. We propose a novel approach for estimating such functions by incorporating the prior knowledge on the bounds. Specially, a Gaussian…

Methodology · Statistics 2018-10-30 Jize Zhang , Lizhen Lin

While Gaussian processes are a mainstay for various engineering and scientific applications, the uncertainty estimates don't satisfy frequentist guarantees and can be miscalibrated in practice. State-of-the-art approaches for designing…

Machine Learning · Computer Science 2023-11-20 Alexandre Capone , Geoff Pleiss , Sandra Hirche

This paper introduces a general method to approximate the convolution of an arbitrary program with a Gaussian kernel. This process has the effect of smoothing out a program. Our compiler framework models intermediate values in the program…

Graphics · Computer Science 2017-06-06 Yuting Yang , Connelly Barnes

Finding the sparse representation of a signal in an overcomplete dictionary has attracted a lot of attention over the past years. This paper studies ProSparse, a new polynomial complexity algorithm that solves the sparse representation…

Information Theory · Computer Science 2017-07-11 Yue M. Lu , Jon Oñativia , Pier Luigi Dragotti

Conventional variational autoencoders fail in modeling correlations between data points due to their use of factorized priors. Amortized Gaussian process inference through GP-VAEs has led to significant improvements in this regard, but is…

Machine Learning · Statistics 2021-02-25 Metod Jazbec , Matthew Ashman , Vincent Fortuin , Michael Pearce , Stephan Mandt , Gunnar Rätsch