English
Related papers

Related papers: Fast MCMC sampling for Markov jump processes and e…

200 papers

Sparsity has become a key concept for solving of high-dimensional inverse problems using variational regularization techniques. Recently, using similar sparsity-constraints in the Bayesian framework for inverse problems by encoding them in…

Numerical Analysis · Mathematics 2014-11-18 Felix Lucka

The study of time-inhomogeneous Markov jump processes is a traditional topic within probability theory that has recently attracted substantial attention in various applications. However, their flexibility also incurs a substantial…

Probability · Mathematics 2023-11-03 Martin Bladt , Oscar Peralta

Monte Carlo methods are essential tools for Bayesian inference. Gibbs sampling is a well-known Markov chain Monte Carlo (MCMC) algorithm, extensively used in signal processing, machine learning, and statistics, employed to draw samples from…

Computation · Statistics 2017-12-21 Luca Martino , Victor Elvira , Gustau Camps-Valls

This work considers the method of uniformisation for continuous-time Markov chains in the context of chemical reaction networks. Previous work in the literature has shown that uniformisation can be beneficial in the context of…

Quantitative Methods · Quantitative Biology 2019-04-18 Casper Beentjes , Ruth Baker

This paper presents a Bayesian method for identification of jump Markov linear system parameters. A primary motivation is to provide accurate quantification of parameter uncertainty without relying on asymptotic in data-length arguments. To…

Methodology · Statistics 2021-02-11 Mark P. Balenzuela , Adrian G. Wills , Christopher Renton , Brett Ninness

We introduce an approach for efficient Markov chain Monte Carlo (MCMC) sampling for challenging high-dimensional distributions in sparse Bayesian learning (SBL). The core innovation involves using hierarchical prior-normalizing transport…

Numerical Analysis · Mathematics 2025-05-30 Jan Glaubitz , Youssef Marzouk

Monte Carlo algorithms simulate some prescribed number of samples, taking some random real time to complete the computations necessary. This work considers the converse: to impose a real-time budget on the computation, which results in the…

Computation · Statistics 2023-06-22 Lawrence M. Murray , Sumeetpal Singh , Anthony Lee

A rescaled Markov chain converges uniformly in probability to the solution of an ordinary differential equation, under carefully specified assumptions. The presentation is much simpler than those in the outside literature. The result may be…

Probability · Mathematics 2007-05-23 R. W. R. Darling

Inference for continuous-time Markov chains (CTMCs) becomes challenging when the process is only observed at discrete time points. The exact likelihood is intractable, and existing methods often struggle even in medium-dimensional…

Methodology · Statistics 2025-07-23 Tao Tang , Lachlan Astfalck , David Dunson

This work introduces and studies a new family of velocity jump Markov processes directly amenable to exact simulation with the following two properties: i) trajectories converge in law when a time-step parameter vanishes towards a given…

Numerical Analysis · Mathematics 2020-09-15 Pierre Monmarché , Mathias Rousset , Pierre-André Zitt

The random numbers driving Markov chain Monte Carlo (MCMC) simulation are usually modeled as independent U(0,1) random variables. Tribble [Markov chain Monte Carlo algorithms using completely uniformly distributed driving sequences (2007)…

Statistics Theory · Mathematics 2011-05-11 S. Chen , J. Dick , A. B. Owen

Rao and Teh (2012, 2013) introduced an efficient MCMC algorithm for sampling from the posterior distribution of a hidden Markov jump process. The algorithm is based on the idea of sampling virtual jumps. In the present paper we show that…

Computation · Statistics 2016-06-28 Błażej Miasojedow , Wojcieh Niemiro

In this article we consider Bayesian estimation of static parameters for a class of partially observed McKean-Vlasov diffusion processes with discrete-time observations over a fixed time interval. This problem features several obstacles to…

Computation · Statistics 2025-04-23 Ajay Jasra , Amin Wu

Stochastic kinetic models (SKMs) are increasingly used to account for the inherent stochasticity exhibited by interacting populations of species in areas such as epidemiology, population ecology and systems biology. Species numbers are…

Computation · Statistics 2023-04-06 Tom E. Lowe , Andrew Golightly , Chris Sherlock

Markov Chain Monte Carlo (MCMC) methods sample from unnormalized probability distributions and offer guarantees of exact sampling. However, in the continuous case, unfavorable geometry of the target distribution can greatly limit the…

Machine Learning · Statistics 2020-10-09 Zengyi Li , Yubei Chen , Friedrich T. Sommer

We consider the approximation of expectations with respect to the distribution of a latent Markov process given noisy measurements. This is known as the smoothing problem and is often approached with particle and Markov chain Monte Carlo…

Computation · Statistics 2019-02-06 Lawrence Middleton , George Deligiannidis , Arnaud Doucet , Pierre E. Jacob

At high levels, the asymptotic distribution of a stationary, regularly varying Markov chain is conveniently given by its tail process. The latter takes the form of a geometric random walk, the increment distribution depending on the sign of…

Methodology · Statistics 2014-12-11 Holger Drees , Johan Segers , Michał Warchoł

The rapid development of computing power and efficient Markov Chain Monte Carlo (MCMC) simulation algorithms have revolutionized Bayesian statistics, making it a highly practical inference method in applied work. However, MCMC algorithms…

Methodology · Statistics 2018-09-21 Matias Quiroz , Mattias Villani , Robert Kohn , Minh-Ngoc Tran , Khue-Dung Dang

The slow processes of metastable stochastic dynamical systems are difficult to access by direct numerical simulation due the sampling problem. Here, we suggest an approach for modeling the slow parts of Markov processes by approximating the…

Mathematical Physics · Physics 2012-12-03 Frank Noé , Feliks Nüske

This paper is concerned with the development of rigorous approximations to various expectations associated with Markov chains and processes having non-stationary transition probabilities. Such non-stationary models arise naturally in…

Probability · Mathematics 2018-05-07 Zeyu Zheng , Harsha Honnappa , Peter W. Glynn