English
Related papers

Related papers: Bayesian inference for continuous-time hidden Mark…

200 papers

Motivated by applications in movement ecology, in this paper I propose a new class of integrated continuous-time hidden Markov models in which each observation depends on the underlying state of the process over the whole interval since the…

Methodology · Statistics 2019-10-01 Paul G Blackwell

Performing numerical integration when the integrand itself cannot be evaluated point-wise is a challenging task that arises in statistical analysis, notably in Bayesian inference for models with intractable likelihood functions. Markov…

Computation · Statistics 2020-06-17 Lawrence Middleton , George Deligiannidis , Arnaud Doucet , Pierre E. Jacob

In this article a flexible Bayesian non-parametric model is proposed for non-homogeneous hidden Markov models. The model is developed through the amalgamation of the ideas of hidden Markov models and predictor dependent stick-breaking…

Methodology · Statistics 2012-05-10 Abhra Sarkar , Anindya Bhadra , Bani K. Mallick

We consider chemical reaction networks modeled by a discrete state and continuous in time Markov process for the vector copy number of the species and provide a novel particle filter method for state and parameter estimation based on exact…

Molecular Networks · Quantitative Biology 2021-02-24 Muruhan Rathinam , Mingkai Yu

We present a new method for simulating Markovian jump processes with time-dependent transitions rates, which avoids the transformation of random numbers by inverting time integrals over the rates. It relies on constructing a sequence of…

Statistical Mechanics · Physics 2015-05-20 Viktor Holubec , Petr Chvosta , Mario Einax , Philipp Maass

In this work the issue of Bayesian inference for stationary data is addressed. Therefor a parametrization of a statistically suitable subspace of the the shift-ergodic probability measures on a Cartesian product of some finite state space…

Statistics Theory · Mathematics 2017-10-24 Fritz Moritz von Rohrscheidt

We consider the problem of inference in discrete probabilistic models, that is, distributions over subsets of a finite ground set. These encompass a range of well-known models in machine learning, such as determinantal point processes and…

Machine Learning · Computer Science 2018-07-10 Alkis Gotovos , Hamed Hassani , Andreas Krause , Stefanie Jegelka

We introduce an ensemble Markov chain Monte Carlo approach to sampling from a probability density with known likelihood. This method upgrades an underlying Markov chain by allowing an ensemble of such chains to interact via a process in…

Computation · Statistics 2021-06-08 Michael Lindsey , Jonathan Weare , Anna Zhang

We propose a new computationally efficient sampling scheme for Bayesian inference involving high dimensional probability distributions. Our method maps the original parameter space into a low-dimensional latent space, explores the latent…

Computation · Statistics 2019-10-15 Babak Shahbaba , Luis Martinez Lomeli , Tian Chen , Shiwei Lan

Here, a new two-dimensional process, discrete in time and space, that yields the results of both a random walk and a quantum random walk, is introduced. This model describes the population distribution of four coin states |1>,-|1>, |0> -|0>…

Quantum Physics · Physics 2020-08-26 Arie Bar-Haim

We consider a continuous time Markov chain on a countable state space and prove a joint large deviation principle for the empirical measure and the empirical flow, which accounts for the total number of jumps between pairs of states. We…

Probability · Mathematics 2015-01-19 Lorenzo Bertini , Alessandra Faggionato , Davide Gabrielli

Performing model selection for coupled hidden Markov models (CHMMs) is highly challenging, owing to the large dimension of the hidden state process. Whilst in principle the hidden state process can be marginalized out via forward filtering,…

Methodology · Statistics 2021-05-26 Jake Carson , Trevelyan J. McKinley , Peter Neal , Simon E. F. Spencer

We consider a unified framework of sequential change-point detection and hypothesis testing modeled by means of hidden Markov chains. One observes a sequence of random variables whose distributions are functionals of a hidden Markov chain.…

Optimization and Control · Mathematics 2013-12-13 Savas Dayanik , Kazutoshi Yamazaki

Inference for continuous-time Markov chains (CTMCs) becomes challenging when the process is only observed at discrete time points. The exact likelihood is intractable, and existing methods often struggle even in medium-dimensional…

Methodology · Statistics 2025-07-23 Tao Tang , Lachlan Astfalck , David Dunson

We propose a Bayesian nonparametric mixture model for prediction- and information extraction tasks with an efficient inference scheme. It models categorical-valued time series that exhibit dynamics from multiple underlying patterns (e.g.…

Machine Learning · Statistics 2017-06-21 Jan Reubold , Thorsten Strufe , Ulf Brefeld

A current challenge for many Bayesian analyses is determining when to terminate high-dimensional Markov chain Monte Carlo simulations. To this end, we propose using an automated sequential stopping procedure that terminates the simulation…

Computation · Statistics 2014-03-24 Lei Gong , James M. Flegal

We analyse the performance of a recursive Monte Carlo method for the Bayesian estimation of the static parameters of a discrete--time state--space Markov model. The algorithm employs two layers of particle filters to approximate the…

Computation · Statistics 2016-03-31 Dan Crisan , Joaquin Miguez

A method for sequential Bayesian inference of the static parameters of a dynamic state space model is proposed. The method is based on the observation that many dynamic state space models have a relatively small number of static parameters…

Computation · Statistics 2017-06-28 Arnab Bhattacharya , Simon Wilson

We apply a Bayesian data analysis scheme known as the Markov Chain Monte Carlo (MCMC) to the tomographic reconstruction of quantum states. This method yields a vector, known as the Markov chain, which contains the full statistical…

Markov jump processes (or continuous-time Markov chains) are a simple and important class of continuous-time dynamical systems. In this paper, we tackle the problem of simulating from the posterior distribution over paths in these models,…

Computation · Statistics 2013-10-21 Vinayak Rao , Yee Whye Teh