中文
相关论文

相关论文: Enhanced gradient-based MCMC in discrete spaces

200 篇论文

We study posterior sampling for inverse problems in discrete state spaces using discrete diffusion models as generative priors. While continuous diffusion models have become widely used for inverse problems, their discrete counterparts…

机器学习 · 计算机科学 2026-05-12 Chaitanya Amballa , Sattwik Basu , Jorge Vančo Sampedro , Romit Roy Choudhury

MALA is a popular gradient-based Markov chain Monte Carlo method to access the Gibbs-posterior distribution. Stochastic MALA (sMALA) scales to large data sets, but changes the target distribution from the Gibbs-posterior to a surrogate…

机器学习 · 统计学 2026-03-24 Sebastian Bieringer , Gregor Kasieczka , Maximilian F. Steffen , Mathias Trabs

We propose a class of discrete state sampling algorithms based on Nesterov's accelerated gradient method, which extends the classical Metropolis-Hastings (MH) algorithm. The evolution of the discrete states probability distribution governed…

最优化与控制 · 数学 2026-02-10 Bohan Zhou , Shu Liu , Xinzhe Zuo , Wuchen Li

The Linear Ballistic Accumulator (Brown & Heathcote, 2008) model is used as a measurement tool to answer questions about applied psychology. The analyses based on this model depend upon the model selected and its estimated parameters.…

统计方法学 · 统计学 2020-03-03 David Gunawan , Guy E. Hawkins , Minh-Ngoc Tran , Robert Kohn , Scott Brown

Inference for spatial generalized linear mixed models (SGLMMs) for high-dimensional non-Gaussian spatial data is computationally intensive. The computational challenge is due to the high-dimensional random effects and because Markov chain…

统计计算 · 统计学 2018-10-09 Yawen Guan , Murali Haran

The challenging problem of conducting fully Bayesian inference for the reaction rate constants governing stochastic kinetic models (SKMs) is considered. Given the challenges underlying this problem, the Markov jump process representation is…

统计计算 · 统计学 2019-01-10 Andrew Golightly , Emma Bradley , Tom Lowe , Colin S. Gillespie

Convergence analysis of Markov chain Monte Carlo methods in high-dimensional statistical applications is increasingly recognized. In this paper, we develop general mixing time bounds for Metropolis-Hastings algorithms on discrete spaces by…

统计计算 · 统计学 2025-07-29 Hyunwoong Chang , Quan Zhou

Performing Bayesian inference via Markov chain Monte Carlo (MCMC) can be exceedingly expensive when posterior evaluations invoke the evaluation of a computationally expensive model, such as a system of partial differential equations. In…

统计计算 · 统计学 2017-12-27 Patrick Conrad , Andrew Davis , Youssef Marzouk , Natesh Pillai , Aaron Smith

Markov chain Monte Carlo (MCMC) methods are fundamental to Bayesian computation, but can be computationally intensive, especially in high-dimensional settings. Push-forward generative models, such as generative adversarial networks (GANs),…

机器学习 · 计算机科学 2026-02-25 Jonathan Spence , Tobías I. Liaudat , Konstantinos Zygalakis , Marcelo Pereyra

When conducting Bayesian inference, delayed acceptance (DA) Metropolis-Hastings (MH) algorithms and DA pseudo-marginal MH algorithms can be applied when it is computationally expensive to calculate the true posterior or an unbiased estimate…

统计计算 · 统计学 2016-06-02 Chris Sherlock , Andrew Golightly , Daniel A. Henderson

Traditionally, the field of computational Bayesian statistics has been divided into two main subfields: variational methods and Markov chain Monte Carlo (MCMC). In recent years, however, several methods have been proposed based on combining…

统计计算 · 统计学 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao

We develop new flexible univariate models for light-tailed and heavy-tailed data, which extend a hierarchical representation of the generalized Pareto (GP) limit for threshold exceedances. These models can accommodate departure from…

统计方法学 · 统计学 2020-09-14 Rishikesh Yadav , Raphaël Huser , Thomas Opitz

Federated learning performed by a decentralized networks of agents is becoming increasingly important with the prevalence of embedded software on autonomous devices. Bayesian approaches to learning benefit from offering more information as…

机器学习 · 计算机科学 2021-07-16 Vyacheslav Kungurtsev , Adam Cobb , Tara Javidi , Brian Jalaian

Motivated by the problem of exploring discrete but very complex state spaces in Bayesian models, we propose a novel Markov Chain Monte Carlo search algorithm: the taxicab sampler. We describe the construction of this sampler and discuss how…

统计方法学 · 统计学 2022-10-04 Vincent Geels , Matthew Pratola , Radu Herbei

Recent work has suggested using Monte Carlo methods based on piecewise deterministic Markov processes (PDMPs) to sample from target distributions of interest. PDMPs are non-reversible continuous-time processes endowed with momentum, and…

机器学习 · 统计学 2024-06-28 Paul Fearnhead , Sebastiano Grazzi , Chris Nemeth , Gareth O. Roberts

Hidden semi-Markov Models (HSMM's) - while broadly in use - are restricted to a discrete and uniform time grid. They are thus not well suited to explain often irregularly spaced discrete event data from continuous-time phenomena. We show…

机器学习 · 统计学 2022-10-18 Nicolai Engelmann , Heinz Koeppl

Many recent Markov chain Monte Carlo (MCMC) samplers leverage continuous dynamics to define a transition kernel that efficiently explores a target distribution. In tandem, a focus has been on devising scalable variants that subsample the…

统计理论 · 数学 2015-11-03 Yi-An Ma , Tianqi Chen , Emily B. Fox

Stochastic gradient Markov chain Monte Carlo (SG-MCMC) has become increasingly popular for simulating posterior samples in large-scale Bayesian modeling. However, existing SG-MCMC schemes are not tailored to any specific probabilistic…

机器学习 · 统计学 2018-06-13 Wenbo Gong , Yingzhen Li , José Miguel Hernández-Lobato

This work introduces a novel framework for precisely and efficiently estimating rare event probabilities in complex, high-dimensional non-Gaussian spaces, building on our foundational Approximate Sampling Target with Post-processing…

统计方法学 · 统计学 2025-01-09 Elsayed Eshra , Konstantinos G. Papakonstantinou , Hamed Nikbakht

Recent advances in stochastic gradient variational inference have made it possible to perform variational Bayesian inference with posterior approximations containing auxiliary random variables. This enables us to explore a new synthesis of…

统计计算 · 统计学 2015-05-20 Tim Salimans , Diederik P. Kingma , Max Welling