English
Related papers

Related papers: Ensuring Rapid Mixing and Low Bias for Asynchronou…

200 papers

Markov chain Monte Carlo sampling methods often suffer from long correlation times. Consequently, these methods must be run for many steps to generate an independent sample. In this paper a method is proposed to overcome this difficulty.…

Numerical Analysis · Mathematics 2009-11-13 Jonathan Weare

Gibbs sampling on factor graphs is a widely used inference technique, which often produces good empirical results. Theoretical guarantees for its performance are weak: even for tree structured graphs, the mixing time of Gibbs may be…

Machine Learning · Computer Science 2015-10-06 Christopher De Sa , Ce Zhang , Kunle Olukotun , Christopher Ré

Markov jump processes (MJPs) are continuous-time stochastic processes widely used in a variety of applied disciplines. Inference for MJPs typically proceeds via Markov chain Monte Carlo, the state-of-the-art being a uniformization-based…

Computation · Statistics 2020-04-14 Boqian Zhang , Vinayak Rao

Standard Gibbs sampling applied to a multivariate normal distribution with a specified precision matrix is equivalent in fundamental ways to the Gauss-Seidel iterative solution of linear equations in the precision matrix. Specifically, the…

Computation · Statistics 2015-05-14 Colin Fox , Albert Parker

A fundamental task in machine learning and related fields is to perform inference on Bayesian networks. Since exact inference takes exponential time in general, a variety of approximate methods are used. Gibbs sampling is one of the most…

Machine Learning · Computer Science 2015-11-23 Daniel Seita , Haoyu Chen , John Canny

A central task in many applications is reasoning about processes that change over continuous time. Continuous-Time Bayesian Networks is a general compact representation language for multi-component continuous-time processes. However, exact…

Artificial Intelligence · Computer Science 2012-06-18 Tal El-Hay , Nir Friedman , Raz Kupferman

Gibbs sampling is a widely popular Markov chain Monte Carlo algorithm that can be used to analyze intractable posterior distributions associated with Bayesian hierarchical models. There are two standard versions of the Gibbs sampler: The…

Statistics Theory · Mathematics 2020-01-01 Grant Backlund , James P. Hobert , Yeun Ji Jung , Kshitij Khare

Sampling from the lattice Gaussian distribution has emerged as an important problem in coding, decoding and cryptography. In this paper, lattice reduction technique is adopted to Gibbs sampler for lattice Gaussian sampling. Firstly, with…

Information Theory · Computer Science 2018-12-04 Zheng Wang , Yang Huang , Shanxiang Lyu

Sampling from lattice Gaussian distribution has emerged as an important problem in coding, decoding and cryptography. In this paper, the classic Gibbs algorithm from Markov chain Monte Carlo (MCMC) methods is demonstrated to be…

Information Theory · Computer Science 2018-12-03 Zheng Wang

Markov Chain Monte Carlo (MCMC) methods are a popular technique in Bayesian statistical modeling. They have long been used to obtain samples from posterior distributions, but recent research has focused on the scalability of these…

Methodology · Statistics 2016-02-02 Nicholas A. Johnson , Frank O. Kuehnel , Ali Nasiri Amini

The stochastic volatility model is a popular tool for modeling the volatility of assets. The model is a nonlinear and non-Gaussian state space model, and consequently is difficult to fit. Many approaches, both classical and Bayesian, have…

Methodology · Statistics 2019-07-22 Chen Gong , David S. Stoffer

Monte Carlo sampling methods often suffer from long correlation times. Consequently, these methods must be run for many steps to generate an independent sample. In this paper a method is proposed to overcome this difficulty. The method…

Computation · Statistics 2007-09-13 Jonathan Weare

Bayesian hierarchical Poisson models are an essential tool for analyzing count data. However, designing efficient algorithms to sample from the posterior distribution of the target parameters remains a challenging task for this class of…

Methodology · Statistics 2025-02-10 Aldo Gardini , Fedele Greco , Carlo Trivisano

Sampling from a lattice Gaussian distribution is emerging as an important problem in various areas such as coding and cryptography. The default sampling algorithm --- Klein's algorithm yields a distribution close to the lattice Gaussian…

Information Theory · Computer Science 2016-11-18 Zheng Wang , Cong Ling , Guillaume Hanrot

Sampling from the full posterior distribution of high-dimensional non-linear, non-Gaussian latent dynamical models presents significant computational challenges. While Particle Gibbs (also known as conditional sequential Monte Carlo) is…

Computation · Statistics 2025-03-05 Adrien Corenflos , Simo Särkkä

The inadequate mixing of conventional Markov Chain Monte Carlo (MCMC) methods for multi-modal distributions presents a significant challenge in practical applications such as Bayesian inference and molecular dynamics. Addressing this, we…

Machine Learning · Statistics 2024-05-30 Wenlin Chen , Mingtian Zhang , Brooks Paige , José Miguel Hernández-Lobato , David Barber

This paper deals with a complete bipartite matching problem with the objective of finding an optimal matching that maximizes a certain generic predefined utility function on the set of all matchings. After proving the NP-hardness of the…

Discrete Mathematics · Computer Science 2017-10-30 Shana Moothedath , Prasanna Chaporkar , Madhu N. Belur

Markov jump processes (or continuous-time Markov chains) are a simple and important class of continuous-time dynamical systems. In this paper, we tackle the problem of simulating from the posterior distribution over paths in these models,…

Computation · Statistics 2013-10-21 Vinayak Rao , Yee Whye Teh

Switching dynamical systems are an expressive model class for the analysis of time-series data. As in many fields within the natural and engineering sciences, the systems under study typically evolve continuously in time, it is natural to…

Machine Learning · Computer Science 2022-05-19 Lukas Köhs , Bastian Alt , Heinz Koeppl

In any Markov chain Monte Carlo analysis, rapid convergence of the chain to its target probability distribution is of practical and theoretical importance. A chain that converges at a geometric rate is geometrically ergodic. In this paper,…

Computation · Statistics 2012-10-05 Alicia A. Johnson , Owen Burbank