English
Related papers

Related papers: Improving Gibbs Sampler Scan Quality with DoGS

200 papers

A popular method for sampling from high-dimensional distributions is the \emph{Gibbs sampler}, which iteratively resamples sites from the conditional distribution of the desired measure given the values of the other coordinates. It is…

Probability · Mathematics 2025-07-22 Jason Gaitonde , Elchanan Mossel

Data sampling enhances classifier efficiency and robustness through data compression and quality improvement. Recently, the sampling method based on granular-ball (GB) has shown promising performance in generality and noisy classification…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Qin Xie , Qinghua Zhang , Shuyin Xia

Bayesian inference in state-space models is challenging due to high-dimensional state trajectories. A viable approach is particle Markov chain Monte Carlo, combining MCMC and sequential Monte Carlo to form "exact approximations" to…

Computation · Statistics 2022-10-27 Anna Wigren , Riccardo Sven Risuleo , Lawrence Murray , Fredrik Lindsten

A common analytical problem in neuroscience is the interpretation of neural activity with respect to sensory input or behavioral output. This is typically achieved by regressing measured neural activity against known stimuli or behavioral…

Computation · Statistics 2016-06-28 Kamiar Rahnama Rad , Timothy A. Machado , Liam Paninski

A central task in many applications is reasoning about processes that change over continuous time. Continuous-Time Bayesian Networks is a general compact representation language for multi-component continuous-time processes. However, exact…

Artificial Intelligence · Computer Science 2012-06-18 Tal El-Hay , Nir Friedman , Raz Kupferman

Diffusion models are an important tool for generative modelling, serving as effective priors in applications such as imaging and protein design. A key challenge in applying diffusion models for downstream tasks is efficiently sampling from…

Machine Learning · Computer Science 2026-02-12 Alexander Denker , Shreyas Padhy , Francisco Vargas , Johannes Hertrich

The Partially Collapsed Gibbs (PCG) sampler offers a new strategy for improving the convergence of a Gibbs sampler. PCG achieves faster convergence by reducing the conditioning in some of the draws of its parent Gibbs sampler. Although this…

Computation · Statistics 2016-02-19 David A. van Dyk , Xiyun Jiao

We present a Gibbs sampling solution to the map-making problem for CMB measurements, building on existing destriping methodology. Gibbs sampling breaks the computationally heavy destriping problem into two separate steps; noise filtering…

Full Bayesian posteriors are rarely analytically tractable, which is why real-world Bayesian inference heavily relies on approximate techniques. Approximations generally differ from the true posterior and require diagnostic tools to assess…

Machine Learning · Statistics 2022-03-08 Luca Rendsburg , Agustinus Kristiadi , Philipp Hennig , Ulrike von Luxburg

We investigate the convergence properties of popular data-augmentation samplers for Bayesian probit regression. Leveraging recent results on Gibbs samplers for log-concave targets, we provide simple and explicit non-asymptotic bounds on the…

Computation · Statistics 2025-05-21 Filippo Ascolani , Giacomo Zanella

We develop efficient simulation techniques for Bayesian inference on switching GARCH models. Our contribution to existing literature is manifold. First, we discuss different multi-move sampling techniques for Markov Switching (MS) state…

Statistics Theory · Mathematics 2012-12-24 Monica Billio , Roberto Casarin , Anthony Osuntuyi

Graph sampling set selection, where a subset of nodes are chosen to collect samples to reconstruct a smooth graph signal, is a fundamental problem in graph signal processing (GSP). Previous works employ an unbiased least-squares (LS) signal…

Signal Processing · Electrical Eng. & Systems 2020-06-24 Yuanchao Bai , Fen Wang , Gene Cheung , Yuji Nakatsukasa , Wen Gao

Computational couplings of Markov chains provide a practical route to unbiased Monte Carlo estimation that can utilize parallel computation. However, these approaches depend crucially on chains meeting after a small number of transitions.…

Methodology · Statistics 2021-04-14 Brian L. Trippe , Tin D. Nguyen , Tamara Broderick

We consider three Bayesian penalized regression models and show that the respective deterministic scan Gibbs samplers are geometrically ergodic regardless of the dimension of the regression problem. We prove geometric ergodicity of the…

Statistics Theory · Mathematics 2017-07-05 Dootika Vats

We propose a new method called the Metropolis-adjusted Mirror Langevin algorithm for approximate sampling from distributions whose support is a compact and convex set. This algorithm adds an accept-reject filter to the Markov chain induced…

Computation · Statistics 2024-06-24 Vishwak Srinivasan , Andre Wibisono , Ashia Wilson

Gaussian Markov random fields (GMRFs) are popular for modeling dependence in large areal datasets due to their ease of interpretation and computational convenience afforded by the sparse precision matrices needed for random variable…

Computation · Statistics 2019-04-16 D. Andrew Brown , Christopher S. McMahan , Stella Watson Self

Sampling-based algorithms are classical approaches to perform Bayesian inference in inverse problems. They provide estimators with the associated credibility intervals to quantify the uncertainty on the estimators. Although these methods…

Methodology · Statistics 2023-11-28 Pierre-Antoine Thouvenin , Audrey Repetti , Pierre Chainais

Gibbs sampling is a Markov Chain Monte Carlo (MCMC) method often used in Bayesian learning. MCMC methods can be difficult to deploy on parallel and distributed systems due to their inherently sequential nature. We study asynchronous Gibbs…

Computation · Statistics 2020-03-03 Alexander Terenin , Daniel Simpson , David Draper

Gibbs sampling is a workhorse for Bayesian inference but has several limitations when used for parameter estimation, and is often much slower than non-sampling inference methods. SAME (State Augmentation for Marginal Estimation)…

Machine Learning · Computer Science 2014-09-19 Huasha Zhao , Biye Jiang , John Canny

Gaussian Boson Sampling (GBS) is a near-term platform for photonic quantum computing. Applications have been developed which rely on directly programming GBS devices, but the ability to train and optimize circuits has been a key missing…

Quantum Physics · Physics 2020-07-22 Leonardo Banchi , Nicolás Quesada , Juan Miguel Arrazola