English
Related papers

Related papers: Bayesian Image Classification with Deep Convolutio…

200 papers

We explore the link between deep ensembles and Gaussian processes (GPs) through the lens of the Neural Tangent Kernel (NTK): a recent development in understanding the training dynamics of wide neural networks (NNs). Previous work has shown…

Machine Learning · Statistics 2020-10-27 Bobby He , Balaji Lakshminarayanan , Yee Whye Teh

Uncertainty quantification (UQ) over graphs arises in a number of safety-critical applications in network science. The Gaussian process (GP), as a classical Bayesian framework for UQ, has been developed to handle graph-structured data by…

Machine Learning · Computer Science 2025-10-08 Jinwen Xu , Qin Lu , Georgios B. Giannakis

Gaussian process (GP) models have been used in a wide range of battery applications, in which different kernels were manually selected with considerable expertise. However, to capture complex relationships in the ever-growing amount of…

Systems and Control · Electrical Eng. & Systems 2025-05-06 Huang Zhang , Xixi Liu , Faisal Altaf , Torsten Wik

In Hezaveh et al. 2017 we showed that deep learning can be used for model parameter estimation and trained convolutional neural networks to determine the parameters of strong gravitational lensing systems. Here we demonstrate a method for…

Cosmology and Nongalactic Astrophysics · Physics 2017-11-29 Laurence Perreault Levasseur , Yashar D. Hezaveh , Risa H. Wechsler

Gaussian processes (GPs) are flexible models that can capture complex structure in large-scale dataset due to their non-parametric nature. However, the usage of GPs in real-world application is limited due to their high computational cost…

Machine Learning · Statistics 2018-11-06 Congzheng Song , Yiming Sun

Off-the-shelf Gaussian Process (GP) covariance functions encode smoothness assumptions on the structure of the function to be modeled. To model complex and non-differentiable functions, these smoothness assumptions are often too…

Machine Learning · Statistics 2016-04-12 Roberto Calandra , Jan Peters , Carl Edward Rasmussen , Marc Peter Deisenroth

Inference in popular nonparametric Bayesian models typically relies on sampling or other approximations. This paper presents a general methodology for constructing novel tractable nonparametric Bayesian methods by applying the kernel trick…

Machine Learning · Statistics 2011-08-15 Ferenc Huszár , Simon Lacoste-Julien

We address the problem of continual learning in multi-task Gaussian process (GP) models for handling sequential input-output observations. Our approach extends the existing prior-posterior recursion of online Bayesian inference, i.e.\ past…

Machine Learning · Statistics 2019-11-04 Pablo Moreno-Muñoz , Antonio Artés-Rodríguez , Mauricio A. Álvarez

A deep generative model is developed for representation and analysis of images, based on a hierarchical convolutional dictionary-learning framework. Stochastic {\em unpooling} is employed to link consecutive layers in the model, yielding…

Computer Vision and Pattern Recognition · Computer Science 2015-12-25 Yunchen Pu , Xin Yuan , Andrew Stevens , Chunyuan Li , Lawrence Carin

In many real-world applications we are interested in approximating costly functions that are analytically unknown, e.g. complex computer codes. An emulator provides a fast approximation of such functions relying on a limited number of…

Methodology · Statistics 2020-10-02 Hossein Mohammadi , Peter Challenor , Marc Goodfellow , Daniel Williamson

As Deep Learning continues to yield successful applications in Computer Vision, the ability to quantify all forms of uncertainty is a paramount requirement for its safe and reliable deployment in the real-world. In this work, we leverage…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Eduardo D C Carvalho , Ronald Clark , Andrea Nicastro , Paul H J Kelly

Gaussian processes offers a convenient way to perform nonparametric reconstructions of observational data assuming only a kernel which describes the covariance between neighbouring points in a data set. We approach the ambiguity in the…

Cosmology and Nongalactic Astrophysics · Physics 2021-08-17 Reginald Christian Bernardo , Jackson Levi Said

Gaussian process regression is a well-established Bayesian machine learning method. We propose a new approach to Gaussian process regression using quantum kernels based on parameterized quantum circuits. By employing a hardware-efficient…

Quantum Physics · Physics 2024-02-06 Frederic Rapp , Marco Roth

We propose a graph spectrum-based Gaussian process for prediction of signals defined on nodes of the graph. The model is designed to capture various graph signal structures through a highly adaptive kernel that incorporates a flexible…

Machine Learning · Computer Science 2020-10-29 Yin-Cong Zhi , Yin Cheng Ng , Xiaowen Dong

Gaussian processes (GPs) offer a flexible, uncertainty-aware framework for modeling complex signals, but scale cubically with data, assume static targets, and are brittle to outliers, limiting their applicability in large-scale problems…

Machine Learning · Statistics 2025-09-23 Fernando Llorente , Daniel Waxman , Sanket Jantre , Nathan M. Urban , Susan E. Minkoff

Bayesian neural networks provide a direct and natural way to extend standard deep neural networks to support probabilistic deep learning through the use of probabilistic layers that, traditionally, encode weight (and bias) uncertainty. In…

Machine Learning · Computer Science 2021-07-16 Daniel T. Chang

Gaussian Process (GP) models are popular tools in uncertainty quantification (UQ) because they purport to furnish functional uncertainty estimates that can be used to represent model uncertainty. It is often difficult to state with…

Methodology · Statistics 2025-09-22 Carlo Graziani , Marieme Ngom

Sparse Bayesian learning is a state-of-the-art supervised learning algorithm that can choose a subset of relevant samples from the input data and make reliable probabilistic predictions. However, in the presence of high-dimensional data…

Machine Learning · Computer Science 2020-01-10 Bingbing Jiang , Chang Li , Maarten de Rijke , Xin Yao , Huanhuan Chen

The Gaussian process (GP) is a nonparametric prior distribution over functions indexed by time, space, or other high-dimensional index set. The GP is a flexible model yet its limitation is given by its very nature: it can only model…

Machine Learning · Statistics 2019-07-15 Gonzalo Rios , Felipe Tobar

Gaussian processes are powerful, yet analytically tractable models for supervised learning. A Gaussian process is characterized by a mean function and a covariance function (kernel), which are determined by a model selection criterion. The…

Machine Learning · Statistics 2016-10-05 Benjamin Fischer , Nico Gorbach , Stefan Bauer , Yatao Bian , Joachim M. Buhmann