English
Related papers

Related papers: Time-complexity of sampling from a multimodal dist…

200 papers

Stochastic gradient Markov Chain Monte Carlo algorithms are popular samplers for approximate inference, but they are generally biased. We show that many recent versions of these methods (e.g. Chen et al. (2014)) cannot be corrected using…

Machine Learning · Statistics 2021-02-03 Adrià Garriga-Alonso , Vincent Fortuin

Monte Carlo simulations of diffusion processes often introduce bias in the final result, due to time discretization. Using an auxiliary Poisson process, it is possible to run simulations which are unbiased. In this article, we propose such…

Computational Finance · Quantitative Finance 2016-05-09 Louis Paulot

We propose a new algorithm to do posterior sampling of Kingman's coalescent, based upon the Particle Markov Chain Monte Carlo methodology. Specifically, the algorithm is an instantiation of the Particle Gibbs Sampling method, which…

Machine Learning · Statistics 2013-05-07 Yifei Chen , Xiaohui Xie

Hamiltonian Monte Carlo (HMC) is widely used for sampling from high dimensional target distributions with densities known up to proportionality. While HMC exhibits favorable scaling properties in high dimensions, it struggles with strongly…

Computation · Statistics 2025-07-30 Joonha Park

Nonlinear non-Gaussian state-space models arise in numerous applications in statistics and signal processing. In this context, one of the most successful and popular approximation techniques is the Sequential Monte Carlo (SMC) algorithm,…

Computation · Statistics 2016-04-20 Francois Septier , Gareth W. Peters

We discuss the efficiency of Monte Carlo methods in solving continuum radiative transfer problems. The sampling of the radiation field and convergence of dust temperature calculations in the case of optically thick clouds are both studied.…

Astrophysics · Physics 2009-11-10 M. Juvela

We propose a fast potential splitting Markov Chain Monte Carlo method which costs $O(1)$ time each step for sampling from equilibrium distributions (Gibbs measures) corresponding to particle systems with singular interacting kernels. We…

Computational Physics · Physics 2020-10-13 Lei Li , Zhenli Xu , Yue Zhao

We investigate both ensemble and time-averaged mean-squared displacements of particles in a polydisperse granular system in a homogeneous cooling state. The system contains an arbitrary number of species of different sizes and masses. The…

Soft Condensed Matter · Physics 2024-09-20 Anna S. Bodrova , Alexander I. Osinsky

This work explores a novel perspective on solving nonconvex and nonsmooth optimization problems by leveraging sampling based methods. Instead of treating the objective function purely through traditional (often deterministic) optimization…

Optimization and Control · Mathematics 2025-05-21 Nahom Seyoum , Haoxiang You

We discuss the use of a recent class of sequential Monte Carlo methods for solving inverse problems characterized by a semi-linear structure, i.e. where the data depend linearly on a subset of variables and nonlinearly on the remaining…

Applications · Statistics 2014-11-06 Sara Sommariva , Alberto Sorrentino

Auxiliary variable methods such as the Parallel Tempering and the cluster Monte Carlo methods generate samples that follow a target distribution by using proposal and auxiliary distributions. In sampling from complex distributions, these…

Computation · Statistics 2012-07-16 Takamitsu Araki , Kazushi Ikeda

Continuous-time quantum Monte Carlo refers to a class of algorithms designed to sample the thermal distribution of a quantum Hamiltonian through exact expansions of the Boltzmann exponential in terms of stochastic trajectories which are…

Statistical Mechanics · Physics 2024-07-17 Luke Causer , Konstantinos Sfairopoulos , Jamie F. Mair , Juan P. Garrahan

This paper presents a new accelerated proximal Markov chain Monte Carlo methodology to perform Bayesian inference in imaging inverse problems with an underlying convex geometry. The proposed strategy takes the form of a stochastic relaxed…

Sequential Monte Carlo Samplers are a class of stochastic algorithms for Monte Carlo integral estimation w.r.t. probability distributions, which combine elements of Markov chain Monte Carlo methods and importance sampling/resampling…

Probability · Mathematics 2007-05-23 Andreas Eberle , Carlo Marinelli

Monte Carlo experiments produce samples in order to estimate features of a given distribution. However, simultaneous estimation of means and quantiles has received little attention, despite being common practice. In this setting we…

Computation · Statistics 2020-04-24 Nathan Robertson , James M. Flegal , Dootika Vats , Galin L. Jones

Particle Markov Chain Monte Carlo methods are used to carry out inference in non-linear and non-Gaussian state space models, where the posterior density of the states is approximated using particles. Current approaches usually perform…

Computation · Statistics 2019-09-30 Eduardo F. Mendes , Christopher K. Carter , David Gunawan , Robert Kohn

A key limitation of sampling algorithms for approximate inference is that it is difficult to quantify their approximation error. Widely used sampling schemes, such as sequential importance sampling with resampling and Metropolis-Hastings,…

Artificial Intelligence · Computer Science 2017-05-09 Marco F. Cusumano-Towner , Vikash K. Mansinghka

This paper considers the problem of estimating chirp parameters from a noisy mixture of chirps. While a rich body of work exists in this area, challenges remain when extending these techniques to chirps of higher order polynomials. We…

Signal Processing · Electrical Eng. & Systems 2025-01-31 Sattwik Basu , Debottam Dutta , Yu-Lin Wei , Romit Roy Choudhury

We present bounds for the finite sample error of sequential Monte Carlo samplers on static spaces. Our approach explicitly relates the performance of the algorithm to properties of the chosen sequence of distributions and mixing properties…

Computation · Statistics 2022-08-19 Joe Marion , Joseph Mathews , Scott C. Schmidler

The aim of this paper is to introduce a new Monte Carlo method based on importance sampling techniques for the simulation of stochastic differential equations. The main idea is to combine random walk on squares or rectangles methods with…

Probability · Mathematics 2010-10-22 Madalina Deaconu , Antoine Lejay