English
Related papers

Related papers: The Gibbs Sampler with Particle Efficient Importan…

200 papers

We introduce a novel stochastic version of the non-reversible, rejection-free Bouncy Particle Sampler (BPS), a Markov process whose sample trajectories are piecewise linear. The algorithm is based on simulating first arrival times in a…

Computation · Statistics 2017-06-15 Ari Pakman , Dar Gilboa , David Carlson , Liam Paninski

There has been recent interest in developing scalable Bayesian sampling methods such as stochastic gradient MCMC (SG-MCMC) and Stein variational gradient descent (SVGD) for big-data analysis. A standard SG-MCMC algorithm simulates samples…

Machine Learning · Statistics 2018-07-11 Changyou Chen , Ruiyi Zhang , Wenlin Wang , Bai Li , Liqun Chen

Sparse regression based on global-local shrinkage priors are increasingly used for Bayesian modeling of modern high-dimensional data, but scaling up the Gibbs sampler for posterior inference remains a challenge. While much effort has gone…

Methodology · Statistics 2026-05-08 Andrew Chin , Xiyu Ding , Akihiko Nishimura

In this work, we adopt a general framework based on the Gibbs posterior to update belief distributions for inverse problems governed by partial differential equations (PDEs). The Gibbs posterior formulation is a generalization of standard…

Computation · Statistics 2019-07-04 Zilong Zou , Sayan Mukherjee , Harbir Antil , Wilkins Aquino

Bayesian neural networks (BNNs) have received an increased interest in the last years. In BNNs, a complete posterior distribution of the unknown weight and bias parameters of the network is produced during the training stage. This…

Machine Learning · Computer Science 2023-04-14 Yunshi Huang , Emilie Chouzenoux , Victor Elvira , Jean-Christophe Pesquet

For several decades now, Bayesian inference techniques have been applied to theories of particle physics, cosmology and astrophysics to obtain the probability density functions of their free parameters. In this study, we review and compare…

High Energy Physics - Phenomenology · Physics 2025-09-03 Joshua Albert , Csaba Balazs , Andrew Fowlie , Will Handley , Nicholas Hunt-Smith , Roberto Ruiz de Austri , Martin White

This paper introduces a sequential multiple importance sampling (SeMIS) algorithm for high-dimensional Bayesian inference. The method estimates Bayesian evidence using all generated samples from each proposal distribution while obtaining…

Methodology · Statistics 2025-07-08 Li Binbin , He Xiao , Liao Zihan

Switching state-space models (SSSM) are a very popular class of time series models that have found many applications in statistics, econometrics and advanced signal processing. Bayesian inference for these models typically relies on Markov…

Computation · Statistics 2010-11-11 Nick Whiteley , Christophe Andrieu , Arnaud Doucet

Importance Sampling (IS) is a widely used variance reduction technique for enhancing the efficiency of Monte Carlo methods, particularly in rare-event simulation and related applications. Despite its effectiveness, the performance of IS is…

Optimization and Control · Mathematics 2026-02-11 Liviu Aolaritei , Bart P. G. Van Parys , Henry Lam , Michael I. Jordan

Poisson log-linear models are ubiquitous in many applications, and one of the most popular approaches for parametric count regression. In the Bayesian context, however, there are no sufficient specific computational tools for efficient…

Computation · Statistics 2022-09-02 Laura D'Angelo , Antonio Canale

State-space models have been widely used to model the dynamics of communicable diseases in populations of interest by fitting to time-series data. Particle filters have enabled these models to incorporate stochasticity and so can better…

Applications · Statistics 2022-05-17 Conor Rosato , John Harris , Jasmina Panovska-Griffiths , Simon Maskell

Calibration of individual based models (IBMs), successful in modeling complex ecological dynamical systems, is often performed only ad-hoc. Bayesian inference can be used for both parameter estimation and uncertainty quantification, but its…

Computation · Statistics 2017-11-09 Jonas Šukys , Mira Kattwinkel

Stochastic differential equations (SDEs) are an important class of time-series models, used to describe stochastic systems evolving in continuous time. Simulating paths from these processes, particularly after conditioning on noisy…

Computation · Statistics 2026-02-03 Xinyi Pei , Minhyeok Kim , Vinayak Rao

We consider the problem of estimating rare event probabilities, focusing on systems whose evolution is governed by differential equations with uncertain input parameters. If the system dynamics is expensive to compute, standard sampling…

Computation · Statistics 2019-11-05 Siddhant Wahal , George Biros

Importance sampling is a Monte Carlo method that introduces a proposal distribution to sample the space according to the target distribution. Yet calibration of the proposal distribution is essential to achieving efficiency, thus the resort…

Computation · Statistics 2022-06-17 Grégoire Aufort , Pierre Pudlo , Denis Burgarella

We propose a unified mixture sampler (UMS) that provides a universal estimation framework for nonlinear state-space models with "exp-exp" likelihood kernels. Unlike existing methods that require deriving new mixture approximations for each…

Methodology · Statistics 2026-04-07 Daichi Hiraki , Yasuhiro Omori

Importance sampling and Metropolis-Hastings sampling (of which Gibbs sampling is a special case) are two methods commonly used to sample multi-variate probability distributions (that is, Bayesian networks). Heretofore, the sampling of…

Quantum Physics · Physics 2008-11-13 Robert R. Tucci

Stochastic differential equations provide a powerful tool for modelling dynamic phenomena affected by random noise. In case of repeated observations of time series for several experimental units, it is often the case that some of the…

Methodology · Statistics 2024-09-06 Fernando Baltazar-Larios , Mogens Bladt , Michael Sørensen

Recursive estimation of nonlinear dynamical systems is an important problem that arises in several engineering applications. Consistent and accurate propagation of uncertainties is important to ensuring good estimation performance. It is…

Systems and Control · Computer Science 2016-03-16 Dilshad Raihan Akkam Veettil , Suman Chakravorty

Sum-product networks (SPNs) are probabilistic models characterized by exact and fast evaluation of fundamental probabilistic operations. Its superior computational tractability has led to applications in many fields, such as machine…

Machine Learning · Statistics 2024-06-19 Soma Yokoi , Issei Sato