中文
相关论文

相关论文: Learning GPLVM with arbitrary kernels using the un…

200 篇论文

Deep kernel learning (DKL) leverages the connection between Gaussian process (GP) and neural networks (NN) to build an end-to-end, hybrid model. It combines the capability of NN to learn rich representations under massive data and the…

机器学习 · 统计学 2020-08-20 Haitao Liu , Yew-Soon Ong , Xiaomo Jiang , Xiaofang Wang

Gaussian processes are an effective model class for learning unknown functions, particularly in settings where accurately representing predictive uncertainty is of key importance. Motivated by applications in the physical sciences, the…

Random feature latent variable models (RFLVMs) represent the state-of-the-art in latent variable models, capable of handling non-Gaussian likelihoods and effectively uncovering patterns in high-dimensional data. However, their heavy…

机器学习 · 计算机科学 2024-10-24 Ying Li , Zhidi Lin , Yuhao Liu , Michael Minyi Zhang , Pablo M. Olmos , Petar M. Djurić

We introduce a novel stochastic variational inference method for Gaussian process ($\mathcal{GP}$) regression, by deriving a posterior over a learnable set of coresets: i.e., over pseudo-input/output, weighted pairs. Unlike former free-form…

机器学习 · 计算机科学 2025-03-06 Mert Ketenci , Adler Perotte , Noémie Elhadad , Iñigo Urteaga

Spectral approximation and variational inducing learning for the Gaussian process are two popular methods to reduce computational complexity. However, in previous research, those methods always tend to adopt the orthonormal basis functions,…

机器学习 · 统计学 2021-07-15 Wenqi Fang , Guanlin Wu , Jingjing Li , Zheng Wang , Jiang Cao , Yang Ping

Various Large Language Models~(LLMs) from the Generative Pretrained Transformer(GPT) family have achieved outstanding performances in a wide range of text generation tasks. However, the enormous model sizes have hindered their practical use…

计算与语言 · 计算机科学 2024-04-24 Hang Shao , Bei Liu , Bo Xiao , Ke Zeng , Guanglu Wan , Yanmin Qian

Gaussian processes (GPs) are ubiquitously used in sciences and engineering as metamodels. Standard GPs, however, can only handle numerical or quantitative variables. In this paper, we introduce latent map Gaussian processes (LMGPs) that…

机器学习 · 统计学 2021-10-13 Nicholas Oune , Ramin Bostanabad

This paper proposes a hybrid basis function construction method (GP-RVM) for Symbolic Regression problem, which combines an extended version of Genetic Programming called Kaizen Programming and Relevance Vector Machine to evolve an optimal…

神经与进化计算 · 计算机科学 2018-08-28 Hossein Izadi Rad , Ji Feng , Hitoshi Iba

Gaussian processes (GPs) provide a framework for Bayesian inference that can offer principled uncertainty estimates for a large range of problems. For example, if we consider regression problems with Gaussian likelihoods, a GP model enjoys…

机器学习 · 计算机科学 2022-12-21 Felix Leibfried , Vincent Dutordoir , ST John , Nicolas Durrande

Gaussian processes (GPs) can provide a principled approach to uncertainty quantification with easy-to-interpret kernel hyperparameters, such as the lengthscale, which controls the correlation distance of function values. However, selecting…

Sparse Bayesian learning is a state-of-the-art supervised learning algorithm that can choose a subset of relevant samples from the input data and make reliable probabilistic predictions. However, in the presence of high-dimensional data…

机器学习 · 计算机科学 2020-01-10 Bingbing Jiang , Chang Li , Maarten de Rijke , Xin Yao , Huanhuan Chen

Variational Gaussian process (GP) approximations have become a standard tool in fast GP inference. This technique requires a user to select variational features to increase efficiency. So far the common choices in the literature are…

机器学习 · 统计学 2021-10-26 Veit Wild , George Wynne

For a learning task, Gaussian process (GP) is interested in learning the statistical relationship between inputs and outputs, since it offers not only the prediction mean but also the associated variability. The vanilla GP however struggles…

机器学习 · 统计学 2020-09-01 Haitao Liu , Yew-Soon Ong , Xiaomo Jiang , Xiaofang Wang

Graphical Transformation Models (GTMs) are introduced as a novel approach to effectively model multivariate data with intricate marginals and complex dependency structures semiparametrically, while maintaining interpretability through the…

统计方法学 · 统计学 2025-08-28 Matthias Herp , Johannes Brachem , Michael Altenbuchinger , Thomas Kneib

Gaussian Processes (GPs) are a class of kernel methods that have shown to be very useful in geoscience applications. They are widely used because they are simple, flexible and provide very accurate estimates for nonlinear problems,…

机器学习 · 统计学 2020-12-10 Juan Emmanuel Johnson , Valero Laparra , Gustau Camps-Valls

Off-the-shelf Gaussian Process (GP) covariance functions encode smoothness assumptions on the structure of the function to be modeled. To model complex and non-differentiable functions, these smoothness assumptions are often too…

机器学习 · 统计学 2016-04-12 Roberto Calandra , Jan Peters , Carl Edward Rasmussen , Marc Peter Deisenroth

Gaussian Graphical Models (GGMs) or Gauss Markov random fields are widely used in many applications, and the trade-off between the modeling capacity and the efficiency of learning and inference has been an important research problem. In…

机器学习 · 计算机科学 2013-11-12 Ying Liu , Alan S. Willsky

For applications as varied as Bayesian neural networks, determinantal point processes, elliptical graphical models, and kernel learning for Gaussian processes (GPs), one must compute a log determinant of an $n \times n$ positive definite…

机器学习 · 统计学 2017-11-10 Kun Dong , David Eriksson , Hannes Nickisch , David Bindel , Andrew Gordon Wilson

This paper examines experimental design procedures used to develop surrogates of computational models, exploring the interplay between experimental designs and approximation algorithms. We focus on two widely used approximation approaches,…

数值分析 · 计算机科学 2016-05-02 Alex A. Gorodetsky , Youssef M. Marzouk

We introduce Latent Gaussian Process Regression which is a latent variable extension allowing modelling of non-stationary multi-modal processes using GPs. The approach is built on extending the input space of a regression problem with a…

机器学习 · 统计学 2017-09-19 Erik Bodin , Neill D. F. Campbell , Carl Henrik Ek