中文
相关论文

相关论文: Variational inference for hierarchical models with…

200 篇论文

This article explores the optimization of variational approximations for posterior covariances of Gaussian multiway arrays. To achieve this, we establish a natural differential geometric optimization framework on the space using the…

统计计算 · 统计学 2025-01-10 Quinn Simonis , Martin T. Wells

The main computational challenge in Bayesian inference is to compute integrals against a high-dimensional posterior distribution. In the past decades, variational inference (VI) has emerged as a tractable approximation to these integrals,…

统计理论 · 数学 2024-01-09 Anya Katsevich , Philippe Rigollet

We study Bayesian inference methods for solving linear inverse problems, focusing on hierarchical formulations where the prior or the likelihood function depend on unspecified hyperparameters. In practice, these hyperparameters are often…

数值分析 · 数学 2018-08-01 Qingping Zhou , Wenqing Liu , Jinglai Li , Youssef M. Marzouk

We explore various Bayesian approaches to estimate partial Gaussian graphical models. Our hierarchical structures enable to deal with single-output as well as multiple-output linear regressions, in small or high dimension, enforcing either…

统计方法学 · 统计学 2021-12-14 Eunice Okome Obiang , Pascal Jézéquel , Frédéric Proïa

We propose a new approach to Bayesian prediction that caters for models with a large number of parameters and is robust to model misspecification. Given a class of high-dimensional (but parametric) predictive models, this new approach…

统计方法学 · 统计学 2022-05-13 David T. Frazier , Ruben Loaiza-Maya , Gael M. Martin , Bonsoo Koo

We consider a Bayesian approach to variable selection in the presence of high dimensional covariates based on a hierarchical model that places prior distributions on the regression coefficients as well as on the model space. We adopt the…

统计理论 · 数学 2014-07-28 Naveen Naidu Narisetty , Xuming He

Bayesian posterior distributions arising in modern applications, including inverse problems in partial differential equation models in tomography and subsurface flow, are often computationally intractable due to the large computational cost…

机器学习 · 统计学 2023-02-10 Tapio Helin , Andrew Stuart , Aretha Teckentrup , Konstantinos Zygalakis

In Bayesian inference, making deductions about a parameter of interest requires one to sample from or compute an integral against a posterior distribution. A popular method to make these computations cheaper in high-dimensional settings is…

统计理论 · 数学 2024-06-10 Anya Katsevich

Gaussian empirical Bayes methods usually maintain a precision independence assumption: The unknown parameters of interest are independent from the known standard errors of the estimates. This assumption is often theoretically questionable…

计量经济学 · 经济学 2025-12-30 Jiafeng Chen

Sparse variational Gaussian processes (GPs) construct tractable posterior approximations to GP models. At the core of these methods is the assumption that the true posterior distribution over training function values ${\bf f}$ and inducing…

机器学习 · 计算机科学 2025-06-27 Michalis K. Titsias

Inverse problems, i.e., estimating parameters of physical models from experimental data, are ubiquitous in science and engineering. The Bayesian formulation is the gold standard because it alleviates ill-posedness issues and quantifies…

机器学习 · 统计学 2024-05-28 Sharmila Karumuri , Ilias Bilionis

Bayesian nonparametric regression under a rescaled Gaussian process prior offers smoothness-adaptive function estimation with near minimax-optimal error rates. Hierarchical extensions of this approach, equipped with stochastic variable…

统计理论 · 数学 2020-12-15 Sheng Jiang , Surya T. Tokdar

Bayesian inference allows us to define a posterior distribution over the weights of a generic neural network (NN). Exact posteriors are usually intractable, in which case approximations can be employed. One such approximation - variational…

机器学习 · 计算机科学 2026-01-30 Andrew Millard , Joshua Murphy , Peter Green , Simon Maskell

Standard sparse pseudo-input approximations to the Gaussian process (GP) cannot handle complex functions well. Sparse spectrum alternatives attempt to answer this but are known to over-fit. We suggest the use of variational inference for…

机器学习 · 统计学 2015-03-23 Yarin Gal , Richard Turner

A method for sequential inference of the fixed parameters of a dynamic latent Gaussian models is proposed and evaluated that is based on the iterated Laplace approximation. The method provides a useful trade-off between computational…

统计方法学 · 统计学 2015-09-29 Tiep Mai , Simon Wilson

The main goal of this paper is an application of Bayesian model comparison, based on the posterior probabilities and posterior odds ratios, in testing the explanatory power of the set of competing GARCH (ang. Generalised Autoregressive…

数据分析、统计与概率 · 物理学 2008-10-06 Mateusz Pipien

We present a new approach to using neural networks to approximate the solutions of variational equations, based on the adaptive construction of a sequence of finite-dimensional subspaces whose basis functions are realizations of a sequence…

机器学习 · 计算机科学 2021-06-01 Mark Ainsworth , Justin Dong

Due to their conjugate posteriors, Gaussian process priors are attractive for estimating the drift of stochastic differential equations with continuous time observations. However, their performance strongly depends on the choice of the…

统计理论 · 数学 2020-02-04 Jan van Waaij

Graphical models describe associations between variables through the notion of conditional independence. Gaussian graphical models are a widely used class of such models where the relationships are formalized by non-null entries of the…

统计方法学 · 统计学 2023-08-08 Sagnik Bhadury , Riten Mitra , Jeremy T. Gaskins

The use of Gaussian processes (GPs) is supported by efficient sampling algorithms, a rich methodological literature, and strong theoretical grounding. However, due to their prohibitive computation and storage demands, the use of exact GPs…

统计理论 · 数学 2022-07-27 Kelly R. Moran , Matthew W. Wheeler