English
Related papers

Related papers: Stochastic Gradient MCMC Methods for Hidden Markov…

200 papers

Bayesian inference via standard Markov Chain Monte Carlo (MCMC) methods is too computationally intensive to handle large datasets, since the cost per step usually scales like $\Theta(n)$ in the number of data points $n$. We propose the…

Machine Learning · Statistics 2019-06-12 Robert Cornish , Paul Vanetti , Alexandre Bouchard-Côté , George Deligiannidis , Arnaud Doucet

It is well known that Markov chain Monte Carlo (MCMC) methods scale poorly with dataset size. A popular class of methods for solving this issue is stochastic gradient MCMC. These methods use a noisy estimate of the gradient of the log…

Computation · Statistics 2017-12-15 Jack Baker , Paul Fearnhead , Emily B. Fox , Christopher Nemeth

We propose a sequential Markov chain Monte Carlo (SMCMC) algorithm to sample from a sequence of probability distributions, corresponding to posterior distributions at different times in on-line applications. SMCMC proceeds as in usual MCMC…

Statistics Theory · Mathematics 2013-08-20 Yun Yang , David B. Dunson

Recent studies have proposed that one can summarize brain activity into dynamics among a relatively small number of hidden states and that such an approach is a promising tool for revealing brain function. Hidden Markov models (HMMs) are a…

Neurons and Cognition · Quantitative Biology 2021-09-02 Takahiro Ezaki , Yu Himeno , Takamitsu Watanabe , Naoki Masuda

We propose a Bayesian nonparametric mixture model for prediction- and information extraction tasks with an efficient inference scheme. It models categorical-valued time series that exhibit dynamics from multiple underlying patterns (e.g.…

Machine Learning · Statistics 2017-06-21 Jan Reubold , Thorsten Strufe , Ulf Brefeld

We present a scalable approach to performing approximate fully Bayesian inference in generic state space models. The proposed method is an alternative to particle MCMC that provides fully Bayesian inference of both the dynamic latent states…

Machine Learning · Statistics 2019-02-13 Marcel Hirt , Petros Dellaportas

This paper intends to apply the Hidden Markov Model into stock market and and make predictions. Moreover, four different methods of improvement, which are GMM-HMM, XGB-HMM, GMM-HMM+LSTM and XGB-HMM+LSTM, will be discussed later with the…

Pricing of Securities · Quantitative Finance 2021-04-21 Mingwen Liu , Junbang Huo , Yulin Wu , Jinge Wu

Bayesian inference using Markov Chain Monte Carlo (MCMC) on large datasets has developed rapidly in recent years. However, the underlying methods are generally limited to relatively simple settings where the data have specific forms of…

Methodology · Statistics 2020-02-18 Robert Salomone , Matias Quiroz , Robert Kohn , Mattias Villani , Minh-Ngoc Tran

Stochastic gradient Markov chain Monte Carlo (SGMCMC) has become a popular method for scalable Bayesian inference. These methods are based on sampling a discrete-time approximation to a continuous time process, such as the Langevin…

Computation · Statistics 2018-10-29 Jack Baker , Paul Fearnhead , Emily B Fox , Christopher Nemeth

Hidden Markov models (HMMs) are general purpose models for time-series data widely used across the sciences because of their flexibility and elegance. However fitting HMMs can often be computationally demanding and time consuming,…

Computation · Statistics 2021-09-15 Marnus Stoltz , Gene Stoltz , Kazushige Obara , Ting Wang , David Bryant

In this paper we address the problem of Monte Carlo approximation of posterior probability distributions in stochastic kinetic models (SKMs). SKMs are multivariate Markov jump processes that model the interactions among species in…

Methodology · Statistics 2014-04-22 Eugenia Koblents , Joaquín Míguez

Recent years have seen substantial advances in the development of biofunctional materials using synthetic polymers. The growing problem of elusive sequence-functionality relations for most biomaterials has driven researchers to seek more…

Quantitative Methods · Quantitative Biology 2022-07-06 Yun Zhou , Boying Gong , Tao Jiang , Ting Xu , Haiyan Huang

We propose a very fast approximate Markov Chain Monte Carlo (MCMC) sampling framework that is applicable to a large class of sparse Bayesian inference problems, where the computational cost per iteration in several models is of order…

Computation · Statistics 2021-08-17 Yves Atchadé , Liwei Wang

Markov Chain Monte Carlo (MCMC) methods are a popular technique in Bayesian statistical modeling. They have long been used to obtain samples from posterior distributions, but recent research has focused on the scalability of these…

Methodology · Statistics 2016-02-02 Nicholas A. Johnson , Frank O. Kuehnel , Ali Nasiri Amini

People are living longer than ever before, and with this arises new complications and challenges for humanity. Among the most pressing of these challenges is of understanding the role of aging in the development of dementia. This paper is…

Methodology · Statistics 2018-08-07 Jonathan P Williams , Curtis B Storlie , Terry M Therneau , Clifford R Jack , Jan Hannig

In this contribution, we consider the problem of the blind separation of noisy instantaneously mixed images. The images are modelized by hidden Markov fields with unknown parameters. Given the observed images, we give a Bayesian formulation…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Hichem Snoussi , Ali Mohammad-Djafari

In this paper we propose an efficient stochastic optimization algorithm to search for Bayesian experimental designs such that the expected information gain is maximized. The gradient of the expected information gain with respect to…

Computation · Statistics 2022-02-03 Takashi Goda , Tomohiko Hironaka , Wataru Kitade , Adam Foster

Hidden Markov Models are widely used in classical computer science to model stochastic processes with a wide range of applications. This paper concerns the quantum analogues of these machines --- so-called Hidden Quantum Markov Models…

Quantum Physics · Physics 2015-03-05 Lewis A. Clark , Wei Huang , Thomas M. Barlow , Almut Beige

Hidden Markov models (HMMs) have been extensively used in the univariate and multivariate literature. However, there has been an increased interest in the analysis of matrix-variate data over the recent years. In this manuscript we…

Methodology · Statistics 2021-07-16 Salvatore D. Tomarchio , Antonio Punzo , Antonello Maruotti

Markov Chain Monte Carlo (MCMC) algorithms play an important role in statistical inference problems dealing with intractable probability distributions. Recently, many MCMC algorithms such as Hamiltonian Monte Carlo (HMC) and Riemannian…

Computation · Statistics 2017-04-19 Cheng Zhang , Babak Shahbaba , Hongkai Zhao