English
Related papers

Related papers: Exponential Ergodicity of the Bouncy Particle Samp…

200 papers

We make two closely related theoretical contributions to the use of importance sampling schemes. First, for independent sampling, we prove that the minimax optimal trial distribution coincides with the target if and only if the target…

Computation · Statistics 2025-06-25 Quan Zhou

The Bouncy Particle sampler (BPS) and the Zig-Zag sampler (ZZS) are continuous time, non-reversible Monte Carlo methods based on piecewise deterministic Markov processes. Experiments show that the speed of convergence of these samplers can…

Computation · Statistics 2021-09-15 Andrea Bertazzi , Joris Bierkens

Ergodic exploration has spawned a lot of interest in mobile robotics due to its ability to design time trajectories that match desired spatial coverage statistics. However, current ergodic approaches are for continuous spaces, which require…

Robotics · Computer Science 2025-09-30 Benjamin Wong , Ryan H. Lee , Tyler M. Paine , Santosh Devasia , Ashis G. Banerjee

There has been substantial interest in developing Markov chain Monte Carlo algorithms based on piecewise-deterministic Markov processes. However existing algorithms can only be used if the target distribution of interest is differentiable…

Statistics Theory · Mathematics 2021-11-12 Augustin Chevallier , Sam Power , Andi Q. Wang , Paul Fearnhead

Rao and Teh (2012, 2013) introduced an efficient MCMC algorithm for sampling from the posterior distribution of a hidden Markov jump process. The algorithm is based on the idea of sampling virtual jumps. In the present paper we show that…

Computation · Statistics 2016-06-28 Błażej Miasojedow , Wojcieh Niemiro

In the framework of statistical mechanics the properties of macroscopic systems are deduced starting from the laws of their microscopic dynamics. One of the key assumptions in this procedure is the ergodic property, namely the equivalence…

Statistical Mechanics · Physics 2024-01-09 Marco Baldovin , Raffaele Marino , Angelo Vulpiani

We develop a novel Markov chain Monte Carlo (MCMC) method that exploits a hierarchy of models of increasing complexity to efficiently generate samples from an unnormalized target distribution. Broadly, the method rewrites the Multilevel…

Methodology · Statistics 2022-09-05 Mikkel B. Lykkegaard , Tim J. Dodwell , Colin Fox , Grigorios Mingas , Robert Scheichl

This paper discusses the irreducibility and geometric ergodicity of the Hamiltonian Monte Carlo (HMC) algorithm. We consider cases where the number of steps of the symplectic integrator is either fixed or random. Under mild conditions on…

Computation · Statistics 2019-05-14 Alain Durmus , Eric Moulines , Eero Saksman

Gaussian mixtures are commonly used for modeling heavy-tailed error distributions in robust linear regression. Combining the likelihood of a multivariate robust linear regression model with a standard improper prior distribution yields an…

Statistics Theory · Mathematics 2023-01-05 Haoxiang Li , Qian Qin , Galin L. Jones

We study convergence properties of pseudo-marginal Markov chain Monte Carlo algorithms (Andrieu and Roberts [Ann. Statist. 37 (2009) 697-725]). We find that the asymptotic variance of the pseudo-marginal algorithm is always at least as…

Probability · Mathematics 2015-03-31 Christophe Andrieu , Matti Vihola

We consider Gibbs samplers for a normal linear regression model with a global-local shrinkage prior and show that they produce geometrically ergodic Markov chains. First, under the horseshoe local prior and a three-parameter beta global…

Statistics Theory · Mathematics 2025-10-14 Yasuyuki Hamura

Estimation in the deformable template model is a big challenge in image analysis. The issue is to estimate an atlas of a population. This atlas contains a template and the corresponding geometrical variability of the observed shapes. The…

Statistics Theory · Mathematics 2013-09-09 Stéphanie Allassonniere , Estelle Kuhn

Probability measures on the sphere form an important class of statistical models and are used, for example, in modeling directional data or shapes. Due to their widespread use, but also as an algorithmic building block, efficient sampling…

Methodology · Statistics 2026-03-10 Michael Habeck , Mareike Hasenpflug , Shantanu Kodgirwar , Daniel Rudolf

Bayesian inference is useful to obtain a predictive distribution with a small generalization error. However, since posterior distributions are rarely evaluated analytically, we employ the variational Bayesian inference or sampling method to…

Machine Learning · Computer Science 2025-09-03 Yohei Saito , Shun Kimura , Koujin Takeda

Recently, many Markov chain Monte Carlo methods have been developed with deterministic reversible transform proposals inspired by the Hamiltonian Monte Carlo method. The deterministic transform is relatively easy to reconcile with the local…

Methodology · Statistics 2021-11-12 Kengo Kamatani , Xiaolin Song

It is common practice in Markov chain Monte Carlo to update the simulation one variable (or sub-block of variables) at a time, rather than conduct a single full-dimensional update. When it is possible to draw from each full-conditional…

Computation · Statistics 2013-10-03 Alicia A. Johnson , Galin L. Jones , Ronald C. Neath

We study weighted ensemble, an interacting particle method for sampling distributions of Markov chains that has been used in computational chemistry since the 1990s. Many important applications of weighted ensemble require the computation…

Numerical Analysis · Mathematics 2022-04-22 David Aristoff

Sampling the parameters of high-dimensional Continuous Time Markov Chains (CTMC) is a challenging problem with important applications in many fields of applied statistics. In this work a recently proposed type of non-reversible…

Machine Learning · Statistics 2021-06-01 Tingting Zhao , Alexandre Bouchard-Côté

The particle Gibbs (PG) sampler is a systematic way of using a particle filter within Markov chain Monte Carlo (MCMC). This results in an off-the-shelf Markov kernel on the space of state trajectories, which can be used to simulate from the…

Statistics Theory · Mathematics 2015-03-24 Fredrik Lindsten , Randal Douc , Eric Moulines

We introduce a gradient-based learning method to automatically adapt Markov chain Monte Carlo (MCMC) proposal distributions to intractable targets. We define a maximum entropy regularised objective function, referred to as generalised speed…

Machine Learning · Statistics 2020-01-07 Michalis K. Titsias , Petros Dellaportas