中文
相关论文

相关论文: Covariance Matrices for Mean Field Variational Bay…

200 篇论文

PyVBMC is a Python implementation of the Variational Bayesian Monte Carlo (VBMC) algorithm for posterior and model inference for black-box computational models (Acerbi, 2018, 2020). VBMC is an approximate inference method designed for…

机器学习 · 统计学 2023-06-29 Bobby Huggins , Chengkun Li , Marlon Tobaben , Mikko J. Aarnos , Luigi Acerbi

Time series analysis of fMRI data is an important area of medical statistics for neuroimaging data. The neuroimaging community has embraced mean-field variational Bayes (VB) approximations, which are implemented in Statistical Parametric…

统计计算 · 统计学 2018-03-06 Ming Teng , Timothy Johnson , Farouk Nathoo

Variational inference (VI) is a technique to approximate difficult to compute posteriors by optimization. In contrast to MCMC, VI scales to many observations. In the case of complex posteriors, however, state-of-the-art VI approaches often…

机器学习 · 统计学 2024-02-26 Oliver Dürr , Stephan Hörling , Daniel Dold , Ivonne Kovylov , Beate Sick

We develop a variational Bayesian (VB) approach for estimating large-scale dynamic network models in the network autoregression framework. The VB approach allows for the automatic identification of the dynamic structure of such a model and…

统计方法学 · 统计学 2021-02-19 Wei-Ting Lai , Ray-Bing Chen , Ying Chen , Thorsten Koch

Variational inference is an approximation framework for Bayesian inference that seeks to improve quantified uncertainty in predictions by optimizing a simplified distribution over parameters to stand in for the full posterior. Capturing…

机器学习 · 计算机科学 2023-09-12 Jed A. Duersch

Variational Autoencoders (VAEs) are expressive latent variable models that can be used to learn complex probability distributions from training data. However, the quality of the resulting model crucially relies on the expressiveness of the…

机器学习 · 计算机科学 2018-06-12 Lars Mescheder , Sebastian Nowozin , Andreas Geiger

We propose a family of variational approximations to Bayesian posterior distributions, called $\alpha$-VB, with provable statistical guarantees. The standard variational approximation is a special case of $\alpha$-VB with $\alpha=1$. When…

统计理论 · 数学 2018-02-09 Yun Yang , Debdeep Pati , Anirban Bhattacharya

In high-dimensions, the prior tails can have a significant effect on both posterior computation and asymptotic concentration rates. To achieve optimal rates while keeping the posterior computations relatively simple, an empirical Bayes…

统计方法学 · 统计学 2020-08-03 Yue Yang , Ryan Martin

One of the core problems of modern statistics is to approximate difficult-to-compute probability densities. This problem is especially important in Bayesian statistics, which frames all inference about unknown quantities as a calculation…

统计计算 · 统计学 2018-05-11 David M. Blei , Alp Kucukelbir , Jon D. McAuliffe

Mean-field backward stochastic Volterra integral equations (MF-BSVIEs, for short) are introduced and studied. Well-posedness of MF-BSVIEs in the sense of introduced adapted M-solutions is established. Two duality principles between linear…

概率论 · 数学 2011-07-06 Yufeng Shi , Tianxiao Wang , Jiongmin Yong

The use of sparse precision (inverse covariance) matrices has become popular because they allow for efficient algorithms for joint inference in high-dimensional models. Many applications require the computation of certain elements of the…

统计计算 · 统计学 2017-12-06 Per Sidén , Finn Lindgren , David Bolin , Mattias Villani

We have utilized the non-conjugate Variational Bayesian (VB) method for the problem of the sparse Poisson regression model. To provide approximate conjugacy in the model, the likelihood is approximated by a quadratic function, yielding…

统计方法学 · 统计学 2026-02-06 Mitra Kharabati , Morteza Amini , Mohammad Arashi

Variational Bayes (VB) inference is one of the most important algorithms in machine learning and widely used in engineering and industry. However, VB is known to suffer from the problem of local optima. In this Letter, we generalize VB by…

机器学习 · 统计学 2018-09-12 Hideyuki Miyahara , Yuki Sughiyama

Mixture models are widely used in Bayesian statistics and machine learning, in particular in computational biology, natural language processing and many other fields. Variational inference, a technique for approximating intractable…

统计理论 · 数学 2020-08-03 Badr-Eddine Chérief-Abdellatif , Pierre Alquier

Distributed inference/estimation in Bayesian framework in the context of sensor networks has recently received much attention due to its broad applicability. The variational Bayesian (VB) algorithm is a technique for approximating…

机器学习 · 统计学 2020-11-30 Junhao Hua , Chunguang Li

The mean field variational Bayes (VB) algorithm implemented in Stan is relatively fast and efficient, making it feasible to produce model-estimated official statistics on a rapid timeline. Yet, while consistent point estimates of parameters…

统计方法学 · 统计学 2024-07-08 Terrance D. Savitsky , Julie Gershunskaya

Bayesian neural networks (BNNs) hold great promise as a flexible and principled solution to deal with uncertainty when learning from finite data. Among approaches to realize probabilistic inference in deep neural networks, variational Bayes…

Deep neural networks have achieved impressive results on a wide variety of tasks. However, quantifying uncertainty in the network's output is a challenging task. Bayesian models offer a mathematical framework to reason about model…

机器学习 · 计算机科学 2019-05-28 Manikanta Srikar Yellapragada , Chandra Prakash Konkimalla

The effects of different parametrizations on the convergence of Bayesian computational algorithms for hierarchical models are well explored. Techniques such as centering, noncentering and partial noncentering can be used to accelerate…

统计计算 · 统计学 2015-03-20 Linda S. L. Tan , David J. Nott

This paper proposes a fast two-stage variational Bayesian (VB) algorithm to estimate unrestricted panel spatial autoregressive models. Using Dirichlet-Laplace priors, we are able to uncover the spatial relationships between cross-sectional…

计量经济学 · 经济学 2023-08-23 Deborah Gefang , Stephen G. Hall , George S. Tavlas