中文
相关论文

相关论文: On Sparse variational methods and the Kullback-Lei…

200 篇论文

This paper presents an efficient variational inference framework for deriving a family of structured gaussian process regression network (SGPRN) models. The key idea is to incorporate auxiliary inducing variables in latent functions and…

机器学习 · 计算机科学 2021-11-19 Rui Meng , Herbie Lee , Kristofer Bouchard

Gaussian processes (GPs) provide a framework for Bayesian inference that can offer principled uncertainty estimates for a large range of problems. For example, if we consider regression problems with Gaussian likelihoods, a GP model enjoys…

机器学习 · 计算机科学 2022-12-21 Felix Leibfried , Vincent Dutordoir , ST John , Nicolas Durrande

Gradient matching is a promising tool for learning parameters and state dynamics of ordinary differential equations. It is a grid free inference approach, which, for fully observable systems is at times competitive with numerical…

机器学习 · 统计学 2018-04-11 Nico S. Gorbach , Stefan Bauer , Joachim M. Buhmann

We introduce a Bayesian framework for inference with a supervised version of the Gaussian process latent variable model. The framework overcomes the high correlations between latent variables and hyperparameters by using an unbiased pseudo…

机器学习 · 统计学 2018-03-29 Charles Gadd , Sara Wade , Akeel Shah , Dimitris Grammatopoulos

In this article, we investigate posterior convergence in nonparametric regression models where the unknown regression function is modeled by some appropriate stochastic process. In this regard, we consider two setups. The first setup is…

统计理论 · 数学 2020-05-04 Debashis Chatterjee , Sourabh Bhattacharya

We develop a scalable deep non-parametric generative model by augmenting deep Gaussian processes with a recognition model. Inference is performed in a novel scalable variational framework where the variational posterior distributions are…

机器学习 · 计算机科学 2016-03-02 Zhenwen Dai , Andreas Damianou , Javier González , Neil Lawrence

This paper shows that large nonparametric classes of conditional multivariate densities can be approximated in the Kullback--Leibler distance by different specifications of finite mixtures of normal regressions in which normal means and…

统计理论 · 数学 2010-10-05 Andriy Norets

While stochastic variational inference is relatively well known for scaling inference in Bayesian probabilistic models, related methods also offer ways to circumnavigate the approximation of analytically intractable expectations. The key…

机器学习 · 统计学 2015-09-08 David A. Knowles

Recent years have witnessed growing interest in semi-implicit variational inference (SIVI) methods due to their ability to rapidly generate samples from complex distributions. However, since the likelihood of these samples is non-trivial to…

机器学习 · 计算机科学 2025-06-05 Tobias Pielok , Bernd Bischl , David Rügamer

We introduce fully scalable Gaussian processes, an implementation scheme that tackles the problem of treating a high number of training instances together with high dimensional input data. Our key idea is a representation trick over the…

机器学习 · 统计学 2018-07-16 Aristeidis Panos , Petros Dellaportas , Michalis K. Titsias

A new method called "variational sampling" is proposed to estimate integrals under probability distributions that can be evaluated up to a normalizing constant. The key idea is to fit the target distribution with an exponential family model…

统计计算 · 统计学 2013-10-15 Alexis Roche

This paper addresses the steady state covariance steering for linear dynamical systems via structural intervention on the system matrix. We formulate the covariance steering problem as the minimization of the Kullback-Leibler (KL)…

系统与控制 · 电气工程与系统科学 2026-02-27 Yosuke Inoue , Masaki Inoue

A variational inference-based framework for training a multi-output Gaussian process latent variable model, specifically tailored to the tails-up spatio-temporal stream network, is developed. Training, given a censored observational data…

统计方法学 · 统计学 2026-05-21 Marno Basson , Tobias M. Louw , Theresa R. Smith

The paper covers the design and analysis of experiments to discriminate between two Gaussian process models, such as those widely used in computer experiments, kriging, sensor location and machine learning. Two frameworks are considered.…

统计方法学 · 统计学 2022-11-22 Elham Yousefi , Luc Pronzato , Markus Hainy , Werner G. Müller , Henry P. Wynn

Point pattern data often exhibit features such as abrupt changes, hotspots and spatially varying dependence in local intensity. Under a Poisson process framework, these correspond to discontinuities and nonstationarity in the underlying…

统计方法学 · 统计学 2025-07-24 Izabel Nolau , Flávio B. Gonçalves , Dani Gamerman

In this paper we study algorithms to find a Gaussian approximation to a target measure defined on a Hilbert space of functions; the target measure itself is defined via its density with respect to a reference Gaussian measure. We employ the…

数值分析 · 数学 2014-08-11 Frank J. Pinski , Gideon Simpson , Andrew M. Stuart , Hendrik Weber

Implicit Processes (IPs) represent a flexible framework that can be used to describe a wide variety of models, from Bayesian neural networks, neural samplers and data generators to many others. IPs also allow for approximate inference in…

机器学习 · 统计学 2022-07-25 Simón Rodríguez Santana , Bryan Zaldivar , Daniel Hernández-Lobato

We consider estimating the predictive density under Kullback-Leibler loss in an $\ell_0$ sparse Gaussian sequence model. Explicit expressions of the first order minimax risk along with its exact constant, asymptotically least favorable…

统计理论 · 数学 2015-06-04 Gourab Mukherjee , Iain M. Johnstone

Variational Inference is a powerful tool in the Bayesian modeling toolkit, however, its effectiveness is determined by the expressivity of the utilized variational distributions in terms of their ability to match the true posterior…

机器学习 · 统计学 2019-05-10 Artem Sobolev , Dmitry Vetrov

Gaussian process modulated Poisson processes provide a flexible framework for modelling spatiotemporal point patterns. So far this had been restricted to one dimension, binning to a pre-determined grid, or small data sets of up to a few…

机器学习 · 统计学 2018-04-04 S. T. John , James Hensman