中文
相关论文

相关论文: Exact Sampling of Gibbs Measures with Estimated Lo…

200 篇论文

Gibbs sampling is the de facto Markov chain Monte Carlo method used for inference and learning on large scale graphical models. For complicated factor graphs with lots of factors, the performance of Gibbs sampling can be limited by the…

机器学习 · 计算机科学 2018-06-19 Christopher De Sa , Vincent Chen , Wing Wong

A popular approach to semi-supervised learning proceeds by endowing the input data with a graph structure in order to extract geometric information and incorporate it into a Bayesian framework. We introduce new theory that gives appropriate…

机器学习 · 统计学 2020-01-14 Nicolas Garcia Trillos , Zachary Kaplan , Thabo Samakhoana , Daniel Sanz-Alonso

Models with intractable likelihood functions arise in areas including network analysis and spatial statistics, especially those involving Gibbs random fields. Posterior parameter es timation in these settings is termed a doubly-intractable…

统计计算 · 统计学 2018-10-16 Lampros Bouranis , Nial Friel , Florian Maire

This paper derives two new optimization-driven Monte Carlo algorithms inspired from variable splitting and data augmentation. In particular, the formulation of one of the proposed approaches is closely related to the alternating direction…

统计方法学 · 统计学 2019-03-27 Maxime Vono , Nicolas Dobigeon , Pierre Chainais

We propose a very fast approximate Markov Chain Monte Carlo (MCMC) sampling framework that is applicable to a large class of sparse Bayesian inference problems, where the computational cost per iteration in several models is of order…

统计计算 · 统计学 2021-08-17 Yves Atchadé , Liwei Wang

Gaussian time-series models are often specified through their spectral density. Such models present several computational challenges, in particular because of the non-sparse nature of the covariance matrix. We derive a fast approximation of…

统计计算 · 统计学 2012-11-20 Nicolas Chopin , Judith Rousseau , Brunero Liseo

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

机器学习 · 计算机科学 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

The prior distribution on parameters of a sampling distribution is the usual starting point for Bayesian uncertainty quantification. In this paper, we present a different perspective which focuses on missing observations as the source of…

统计方法学 · 统计学 2021-11-23 Edwin Fong , Chris Holmes , Stephen G. Walker

Stochastic differential equations (SDEs) or diffusions are continuous-valued continuous-time stochastic processes widely used in the applied and mathematical sciences. Simulating paths from these processes is usually an intractable problem,…

统计计算 · 统计学 2020-05-27 Qi Wang , Vinayak Rao , Yee Whye Teh

Constraints are a natural choice for prior information in Bayesian inference. In various applications, the parameters of interest lie on the boundary of the constraint set. In this paper, we use a method that implicitly defines a…

统计理论 · 数学 2022-09-27 Jasper Marijn Everink , Yiqiu Dong , Martin Skovgaard Andersen

Denoising diffusion models have driven significant progress in the field of Bayesian inverse problems. Recent approaches use pre-trained diffusion models as priors to solve a wide range of such problems, only leveraging inference-time…

机器学习 · 统计学 2025-02-06 Yazid Janati , Badr Moufad , Mehdi Abou El Qassime , Alain Durmus , Eric Moulines , Jimmy Olsson

Bayesian inference allows us to define a posterior distribution over the weights of a generic neural network (NN). Exact posteriors are usually intractable, in which case approximations can be employed. One such approximation - variational…

机器学习 · 计算机科学 2026-01-30 Andrew Millard , Joshua Murphy , Peter Green , Simon Maskell

An important feature of Bayesian statistics is the opportunity to do sequential inference: the posterior distribution obtained after seeing a dataset can be used as prior for a second inference. However, when Monte Carlo sampling methods…

统计计算 · 统计学 2019-06-24 Bram Thijssen , Lodewyk F. A. Wessels

One of the fundamental tasks of science is to find explainable relationships between observed phenomena. One approach to this task that has received attention in recent years is based on probabilistic graphical modelling with sparsity…

机器学习 · 统计学 2014-04-16 Peter Orchard , Felix Agakov , Amos Storkey

We develop a new Gibbs sampler for a linear mixed model with a Dirichlet process random effect term, which is easily extended to a generalized linear mixed model with a probit link function. Our Gibbs sampler exploits the properties of the…

统计理论 · 数学 2010-02-26 Minjung Kyung , Jeff Gill , George Casella

We consider the problem of sampling from a product-of-experts-type model that encompasses many standard prior and posterior distributions commonly found in Bayesian imaging. We show that this model can be easily lifted into a novel latent…

图像与视频处理 · 电气工程与系统科学 2026-04-16 Muhamed Kuric , Martin Zach , Andreas Habring , Michael Unser , Thomas Pock

Gibbs sampling is a widely used Markov chain Monte Carlo (MCMC) method for numerically approximating integrals of interest in Bayesian statistics and other mathematical sciences. Many implementations of MCMC methods do not extend easily to…

统计计算 · 统计学 2019-06-03 Alexander Terenin , Shawfeng Dong , David Draper

We consider sparse Bayesian estimation in the classical multivariate linear regression model with $p$ regressors and $q$ response variables. In univariate Bayesian linear regression with a single response $y$, shrinkage priors which can be…

统计方法学 · 统计学 2018-05-21 Ray Bai , Malay Ghosh

For Bayesian learning, given likelihood function and Gaussian prior, the elliptical slice sampler, introduced by Murray, Adams and MacKay 2010, provides a tool for the construction of a Markov chain for approximate sampling of the…

机器学习 · 统计学 2021-07-27 Viacheslav Natarovskii , Daniel Rudolf , Björn Sprungk

The rigorous quantification of uncertainty in geophysical inversions is a challenging problem. Inversions are often ill-posed and the likelihood surface may be multi-modal; properties of any single mode become inadequate uncertainty…