English
Related papers

Related papers: Residual Deep Gaussian Processes on Manifolds

200 papers

We propose an unsupervised technique for implicit parameterization of data manifolds. In our approach, the data is assumed to belong to a lower dimensional manifold in a higher dimensional space, and the data points are viewed as the…

Machine Learning · Computer Science 2022-10-14 Viktor Reshniak

Inter-domain Gaussian processes (GPs) allow for high flexibility and low computational cost when performing approximate inference in GP models. They are particularly suitable for modeling data exhibiting global structure but are limited to…

Machine Learning · Statistics 2020-11-03 Tim G. J. Rudner , Dino Sejdinovic , Yarin Gal

Deep Gaussian processes (DGP) have appealing Bayesian properties, can handle variable-sized data, and learn deep features. Their limitation is that they do not scale well with the size of the data. Existing approaches address this using a…

Machine Learning · Computer Science 2019-05-20 Issam H. Laradji , Mark Schmidt , Vladimir Pavlovic , Minyoung Kim

Many applications in speech, robotics, finance, and biology deal with sequential data, where ordering matters and recurrent structures are common. However, this structure cannot be easily captured by standard kernel functions. To model such…

Machine Learning · Computer Science 2017-10-06 Maruan Al-Shedivat , Andrew Gordon Wilson , Yunus Saatchi , Zhiting Hu , Eric P. Xing

Modern machine learning algorithms have been adopted in a range of signal-processing applications spanning computer vision, natural language processing, and artificial intelligence. Many relevant problems involve subspace-structured…

Machine Learning · Computer Science 2018-08-14 Jiayao Zhang , Guangxu Zhu , Robert W. Heath , Kaibin Huang

Despite the growing availability of sensing and data in general, we remain unable to fully characterise many in-service engineering systems and structures from a purely data-driven approach. The vast data and resources available to capture…

Machine Learning · Computer Science 2023-09-20 Elizabeth J Cross , Timothy J Rogers , Daniel J Pitchforth , Samuel J Gibson , Matthew R Jones

Gaussian processes (GPs) are widely used for regression and optimization tasks such as Bayesian optimization (BO) due to their expressiveness and principled uncertainty estimates. However, in settings with large datasets corrupted by…

Machine Learning · Computer Science 2026-01-13 Marshal Arijona Sinaga , Julien Martinelli , Samuel Kaski

Gaussian processes allow for flexible specification of prior assumptions of unknown dynamics in state space models. We present a procedure for efficient Bayesian learning in Gaussian process state space models, where the representation is…

Computation · Statistics 2016-04-18 Andreas Svensson , Arno Solin , Simo Särkkä , Thomas B. Schön

It is desirable to combine the expressive power of deep learning with Gaussian Process (GP) in one expressive Bayesian learning model. Deep kernel learning showed success in adopting a deep network for feature extraction followed by a GP…

Machine Learning · Computer Science 2021-10-26 Chi-Ken Lu , Patrick Shafto

We propose a simple method that combines neural networks and Gaussian processes. The proposed method can estimate the uncertainty of outputs and flexibly adjust target functions where training data exist, which are advantages of Gaussian…

Machine Learning · Statistics 2017-07-20 Tomoharu Iwata , Zoubin Ghahramani

In this paper we model the loss function of high-dimensional optimization problems by a Gaussian random field, or equivalently a Gaussian process. Our aim is to study gradient descent in such loss functions or energy landscapes and compare…

Machine Learning · Statistics 2018-03-28 Mariano Chouza , Stephen Roberts , Stefan Zohren

We introduce a novel edge tracing algorithm using Gaussian process regression. Our edge-based segmentation algorithm models an edge of interest using Gaussian process regression and iteratively searches the image for edge pixels in a…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Jamie Burke , Stuart King

Accurately representing surface weather at the sub-kilometer scale is crucial for optimal decision-making in a wide range of applications. This motivates the use of statistical techniques to provide accurate and calibrated probabilistic…

Atmospheric and Oceanic Physics · Physics 2024-11-15 Francesco Zanetta , Daniele Nerini , Matteo Buzzi , Henry Moss

We present a framework for efficiently approximating differential-geometric primitives on arbitrary manifolds via construction of an atlas graph representation, which leverages the canonical characterization of a manifold as a finite…

Machine Learning · Computer Science 2025-01-23 Ryan A. Robinett , Lorenzo Orecchia , Samantha J. Riesenfeld

Recent research has shown the potential utility of Deep Gaussian Processes. These deep structures are probability distributions, designed through hierarchical construction, which are conditionally Gaussian. In this paper, the current…

Statistics Theory · Mathematics 2018-08-20 Matthew M. Dunlop , Mark A. Girolami , Andrew M. Stuart , Aretha L. Teckentrup

Gaussian process regression is a popular Bayesian framework for surrogate modeling of expensive data sources. As part of a broader effort in scientific machine learning, many recent works have incorporated physical constraints or other a…

Machine Learning · Computer Science 2021-01-07 Laura Swiler , Mamikon Gulian , Ari Frankel , Cosmin Safta , John Jakeman

Subspace-valued functions arise in a wide range of problems, including parametric reduced order modeling (PROM). In PROM, each parameter point can be associated with a subspace, which is used for Petrov-Galerkin projections of large system…

Statistics Theory · Mathematics 2021-07-13 Ruda Zhang , Simon Mak , David Dunson

Complex computer codes are often too time expensive to be directly used to perform uncertainty propagation studies, global sensitivity analysis or to solve optimization problems. A well known and widely used method to circumvent this…

Applications · Statistics 2008-04-06 Amandine Marrel , Bertrand Iooss , Francois Van Dorpe , Elena Volkova

The composition of multiple Gaussian Processes as a Deep Gaussian Process (DGP) enables a deep probabilistic nonparametric approach to flexibly tackle complex machine learning problems with sound quantification of uncertainty. Existing…

Machine Learning · Statistics 2017-03-02 Kurt Cutajar , Edwin V. Bonilla , Pietro Michiardi , Maurizio Filippone

Gaussian processes (GPs) are a powerful tool for probabilistic inference over functions. They have been applied to both regression and non-linear dimensionality reduction, and offer desirable properties such as uncertainty estimates,…

Machine Learning · Statistics 2014-10-01 Yarin Gal , Mark van der Wilk , Carl E. Rasmussen
‹ Prev 1 3 4 5 6 7 10 Next ›