中文
相关论文

相关论文: Nested Expectation Propagation for Gaussian Proces…

200 篇论文

Deep Gaussian processes (DGPs) are multi-layer hierarchical generalisations of Gaussian processes (GPs) and are formally equivalent to neural networks with multiple, infinitely wide hidden layers. DGPs are nonparametric probabilistic models…

Gaussian processes (GPs) provide a probabilistic nonparametric representation of functions in regression, classification, and other problems. Unfortunately, exact learning with GPs is intractable for large datasets. A variety of approximate…

机器学习 · 计算机科学 2010-02-23 Yuan Qi , Ahmed H. Abdel-Gawad , Thomas P. Minka

We present a Gaussian Process - Latent Class Choice Model (GP-LCCM) to integrate a non-parametric class of probabilistic machine learning within discrete choice models (DCMs). Gaussian Processes (GPs) are kernel-based algorithms that…

计量经济学 · 经济学 2023-08-02 Georges Sfeir , Filipe Rodrigues , Maya Abou-Zeid

We propose a nested Gaussian process (nGP) as a locally adaptive prior for Bayesian nonparametric regression. Specified through a set of stochastic differential equations (SDEs), the nGP imposes a Gaussian process prior for the function's…

统计方法学 · 统计学 2012-01-24 Bin Zhu , David B. Dunson

Expectation propagation (EP) is a deterministic approximation algorithm that is often used to perform approximate Bayesian parameter learning. EP approximates the full intractable posterior distribution through a set of local approximations…

机器学习 · 统计学 2015-11-19 Yingzhen Li , Jose Miguel Hernandez-Lobato , Richard E. Turner

Several numerical approximation strategies for the expectation-propagation algorithm are studied in the context of large-scale learning: the Laplace method, a faster variant of it, Gaussian quadrature, and a deterministic version of…

统计计算 · 统计学 2016-11-16 Alexis Roche

Gaussian processes (GPs) are flexible distributions over functions that enable high-level assumptions about unknown functions to be encoded in a parsimonious, flexible and general way. Although elegant, the application of GPs is limited by…

机器学习 · 统计学 2017-10-06 Thang D. Bui , Josiah Yan , Richard E. Turner

Gaussian processes (GPs) provide a probabilistic nonparametric representation of functions in regression, classification, and other problems. Unfortunately, exact learning with GPs is intractable for large datasets. A variety of approximate…

机器学习 · 计算机科学 2012-03-19 Yuan , Qi , Ahmed H. Abdel-Gawad , Thomas P. Minka

Gaussian Process (GPs) models are a rich distribution over functions with inductive biases controlled by a kernel function. Learning occurs through the optimisation of kernel hyperparameters using the marginal likelihood as the objective.…

机器学习 · 统计学 2021-11-22 Fergus Simpson , Vidhi Lalchand , Carl Edward Rasmussen

Efficient feature selection from high-dimensional datasets is a very important challenge in many data-driven fields of science and engineering. We introduce a statistical mechanics inspired strategy that addresses the problem of sparse…

机器学习 · 统计学 2021-04-07 Alfredo Braunstein , Thomas Gueudré , Andrea Pagnani , Mirko Pieropan

We introduce a stochastic variational inference procedure for training scalable Gaussian process (GP) models whose per-iteration complexity is independent of both the number of training points, $n$, and the number basis functions used in…

机器学习 · 统计学 2020-06-05 Trefor W. Evans , Prasanth B. Nair

Binary regression models represent a popular model-based approach for binary classification. In the Bayesian framework, computational challenges in the form of the posterior distribution motivate still-ongoing fruitful research. Here, we…

统计计算 · 统计学 2023-09-06 Augusto Fasano , Niccolò Anceschi , Beatrice Franzolini , Giovanni Rebaudo

Gaussian Mixture Models (GMMs) commonly arise in communication systems, particularly in bilinear joint estimation and detection problems. Although the product of GMMs is still a GMM, as the number of factors increases, the number of…

信号处理 · 电气工程与系统科学 2026-02-04 Zilu Zhao , Dirk Slock

A new algorithm is developed to tackle the issue of sampling non-Gaussian model parameter posterior probability distributions that arise from solutions to Bayesian inverse problems. The algorithm aims to mitigate some of the hurdles faced…

机器学习 · 统计学 2019-11-19 Leen Alawieh , Jonathan Goodman , John B. Bell

We develop an automated variational method for inference in models with Gaussian process (GP) priors and general likelihoods. The method supports multiple outputs and multiple latent functions and does not require detailed knowledge of the…

机器学习 · 统计学 2018-11-06 Edwin V. Bonilla , Karl Krauth , Amir Dezfouli

Mixed-effects regression models represent a useful subclass of regression models for grouped data; the introduction of random effects allows for the correlation between observations within each group to be conveniently captured when…

统计方法学 · 统计学 2024-09-25 Jackson Zhou , John T. Ormerod , Clara Grazian

Gaussian processes (GPs) are a good choice for function approximation as they are flexible, robust to over-fitting, and provide well-calibrated predictive uncertainty. Deep Gaussian processes (DGPs) are multi-layer generalisations of GPs,…

机器学习 · 统计学 2017-11-15 Hugh Salimbeni , Marc Deisenroth

This work introduces the Efficient Transformed Gaussian Process (ETGP), a new way of creating C stochastic processes characterized by: 1) the C processes are non-stationary, 2) the C processes are dependent by construction without needing a…

机器学习 · 计算机科学 2022-06-01 Juan Maroñas , Daniel Hernández-Lobato

Standard Bayesian inference schemes are infeasible for inverse problems with computationally expensive forward models. A common solution is to replace the model with a cheaper surrogate. To avoid overconfident conclusions, it is essential…

统计方法学 · 统计学 2026-01-09 Andrew Gerard Roberts , Michael Dietze , Jonathan H. Huggins

Deep Gaussian processes provide a flexible approach to probabilistic modelling of data using either supervised or unsupervised learning. For tractable inference approximations to the marginal likelihood of the model must be made. The…

机器学习 · 统计学 2014-12-04 James Hensman , Neil D. Lawrence