English
Related papers

Related papers: Fast Gibbs sampling for the local and global trend…

200 papers

With extreme weather events becoming more common, the risk posed by surface water flooding is ever increasing. In this work we propose a model, and associated Bayesian inference scheme, for generating probabilistic (high-resolution…

The popularity of Adaptive MCMC has been fueled on the one hand by its success in applications, and on the other hand, by mathematically appealing and computationally straightforward optimisation criteria for the Metropolis algorithm…

Computation · Statistics 2018-01-30 Cyril Chimisov , Krzysztof Latuszynski , Gareth Roberts

Recent crash frequency studies incorporate spatiotemporal correlations, but these studies have two key limitations: i) none of these studies accounts for temporal variation in model parameters; and ii) Gibbs sampler suffers from convergence…

Applications · Statistics 2020-08-11 Prasad Buddhavarapu , Prateek Bansal , Jorge A. Prozzi

Sparse regression based on global-local shrinkage priors are increasingly used for Bayesian modeling of modern high-dimensional data, but scaling up the Gibbs sampler for posterior inference remains a challenge. While much effort has gone…

Methodology · Statistics 2026-05-08 Andrew Chin , Xiyu Ding , Akihiko Nishimura

The inadequate mixing of conventional Markov Chain Monte Carlo (MCMC) methods for multi-modal distributions presents a significant challenge in practical applications such as Bayesian inference and molecular dynamics. Addressing this, we…

Machine Learning · Statistics 2024-05-30 Wenlin Chen , Mingtian Zhang , Brooks Paige , José Miguel Hernández-Lobato , David Barber

We solve the inverse problem of deblurring a pixelized image of Jupiter using regularized deconvolution and by sample-based Bayesian inference. By efficiently sampling the marginal posterior distribution for hyperparameters, then the full…

Computation · Statistics 2016-02-24 Colin Fox , Richard A. Norton

Denoising diffusion models have driven significant progress in the field of Bayesian inverse problems. Recent approaches use pre-trained diffusion models as priors to solve a wide range of such problems, only leveraging inference-time…

Machine Learning · Statistics 2025-02-06 Yazid Janati , Badr Moufad , Mehdi Abou El Qassime , Alain Durmus , Eric Moulines , Jimmy Olsson

In the realm of statistical learning, the increasing volume of accessible data and increasing model complexity necessitate robust methodologies. This paper explores two branches of robust Bayesian methods in response to this trend. The…

Methodology · Statistics 2024-12-02 Masahiro Tanaka

Monte Carlo methods are essential tools for Bayesian inference. Gibbs sampling is a well-known Markov chain Monte Carlo (MCMC) algorithm, extensively used in signal processing, machine learning, and statistics, employed to draw samples from…

Computation · Statistics 2017-12-21 Luca Martino , Victor Elvira , Gustau Camps-Valls

This paper develops a slice sampler for Bayesian linear regression models with arbitrary priors. The new sampler has two advantages over current approaches. One, it is faster than many custom implementations that rely on auxiliary latent…

Computation · Statistics 2018-06-18 P. Richard Hahn , Jingyu He , Hedibert Lopes

We develop a framework for approximating collapsed Gibbs sampling in generative latent variable cluster models. Collapsed Gibbs is a popular MCMC method, which integrates out variables in the posterior to improve mixing. Unfortunately for…

Machine Learning · Statistics 2018-07-23 Christopher Aicher , Emily B. Fox

With the ubiquitous availability of unstructured data, growing attention is paid as how to adjust for selection bias in such non-probability samples. The majority of the robust estimators proposed by prior literature are either fully or…

Methodology · Statistics 2022-04-08 Ali Rafei , Michael R. Elliott , Carol A. C. Flannagan

Bayesian optimization has recently emerged as a popular method for the sample-efficient optimization of expensive black-box functions. However, the application to high-dimensional problems with several thousand observations remains…

Machine Learning · Computer Science 2020-02-26 David Eriksson , Michael Pearce , Jacob R Gardner , Ryan Turner , Matthias Poloczek

L1-ball-type priors are a recent generalization of the spike-and-slab priors. By transforming a continuous precursor distribution to the L1-ball boundary, it induces exact zeros with positive prior and posterior probabilities. With great…

Methodology · Statistics 2026-05-05 Yu Zheng , Leo L. Duan

We consider Bayesian linear regression with sparsity-inducing prior and design efficient sampling algorithms leveraging posterior contraction properties. A quasi-likelihood with Gaussian spike-and-slab (that is favorable both statistically…

Computation · Statistics 2023-07-13 Qijia Jiang

In this article, we propose a new class of priors for Bayesian inference with multiple Gaussian graphical models. We introduce fully Bayesian treatments of two popular procedures, the group graphical lasso and the fused graphical lasso, and…

Machine Learning · Statistics 2019-05-13 Zehang Richard Li , Tyler H. McCormick , Samuel J. Clark

Gibbs sampling, as a model learning method, is known to produce the most accurate results available in a variety of domains, and is a de facto standard in these domains. Yet, it is also well known that Gibbs random walks usually have…

Machine Learning · Statistics 2018-04-20 Mark Kozdoba , Shie Mannor

Although the block Gibbs sampler for the Bayesian graphical LASSO proposed by Wang (2012) has been widely applied and extended to various shrinkage priors in recent years, it has a less noticeable but possibly severe disadvantage that the…

Computation · Statistics 2022-04-15 Sakae Oya , Teruo Nakatsuma

Gibbs sampling is the de facto Markov chain Monte Carlo method used for inference and learning on large scale graphical models. For complicated factor graphs with lots of factors, the performance of Gibbs sampling can be limited by the…

Machine Learning · Computer Science 2018-06-19 Christopher De Sa , Vincent Chen , Wing Wong

We develop a new Gibbs sampler for a linear mixed model with a Dirichlet process random effect term, which is easily extended to a generalized linear mixed model with a probit link function. Our Gibbs sampler exploits the properties of the…

Statistics Theory · Mathematics 2010-02-26 Minjung Kyung , Jeff Gill , George Casella