English
Related papers

Related papers: Variational Bayesian Inference for Hidden Markov M…

200 papers

We propose a Bayesian nonparametric mixture model for prediction- and information extraction tasks with an efficient inference scheme. It models categorical-valued time series that exhibit dynamics from multiple underlying patterns (e.g.…

Machine Learning · Statistics 2017-06-21 Jan Reubold , Thorsten Strufe , Ulf Brefeld

We show how models for prediction with expert advice can be defined concisely and clearly using hidden Markov models (HMMs); standard HMM algorithms can then be used to efficiently calculate, among other things, how the expert predictions…

Machine Learning · Computer Science 2008-02-15 Wouter Koolen , Steven de Rooij

We present a novel algorithm for learning the parameters of hidden Markov models (HMMs) in a geometric setting where the observations take values in Riemannian manifolds. In particular, we elevate a recent second-order method of moments…

Machine Learning · Computer Science 2023-02-16 Berlin Chen , Cyrus Mostajeran , Salem Said

We explore the use of traditional and contemporary hidden Markov models (HMMs) for sequential physiological data analysis and sepsis prediction in preterm infants. We investigate the use of classical Gaussian mixture model based HMM, and a…

Machine Learning · Computer Science 2019-10-31 Antoine Honore , Dong Liu , David Forsberg , Karen Coste , Eric Herlenius , Saikat Chatterjee , Mikael Skoglund

Industrial processes generate a massive amount of monitoring data that can be exploited to uncover hidden time losses in the system. This can be used to enhance the accuracy of maintenance policies and increase the effectiveness of the…

Applications · Statistics 2025-08-27 Fernando Miguelez , Josu Doncel , Maria Dolores Ugarte

Extending classical probabilistic reasoning using the quantum mechanical view of probability has been of recent interest, particularly in the development of hidden quantum Markov models (HQMMs) to model stochastic processes. However, there…

Machine Learning · Computer Science 2019-12-05 Sandesh Adhikary , Siddarth Srinivasan , Geoff Gordon , Byron Boots

Hidden Markov models (HMMs) are one of the most widely used statistical methods for analyzing sequence data. However, the reporting of output from HMMs has largely been restricted to the presentation of the most-probable (MAP) hidden state…

Methodology · Statistics 2015-05-01 Michalis K. Titsias , Christopher Yau , Christopher C. Holmes

The spatial error model (SEM) is a type of simultaneous autoregressive (SAR) model for analysing spatially correlated data. Markov chain Monte Carlo (MCMC) is one of the most widely used Bayesian methods for estimating SEM, but it has…

Methodology · Statistics 2024-06-14 Anjana Wijayawardhana , David Gunawan , Thomas Suesse

We study a phase transition in parameter learning of Hidden Markov Models (HMMs). We do this by generating sequences of observed symbols from given discrete HMMs with uniformly distributed transition probabilities and a noise level encoded…

Statistical Mechanics · Physics 2021-10-13 Nikita Rau , Jörg Lücke , Alexander K. Hartmann

Evidence accumulation models (EAMs) are an important class of cognitive models used to analyze both response time and response choice data recorded from decision-making tasks. Developments in estimation procedures have helped EAMs become…

Methodology · Statistics 2023-06-01 Viet Hung Dao , David Gunawan , Robert Kohn , Minh-Ngoc Tran , Guy E. Hawkins , Scott D. Brown

In unsupervised classification, Hidden Markov Models (HMM) are used to account for a neighborhood structure between observations. The emission distributions are often supposed to belong to some parametric family. In this paper, a…

Machine Learning · Statistics 2012-06-25 Stevenn Volant , Caroline Bérard , Marie-Laure Martin-Magniette , Stéphane Robin

Motivated by high-throughput single-cell cytometry data with applications to vaccine development and immunological research, we consider statistical clustering in large-scale data that contain multiple rare clusters. We propose a new…

Methodology · Statistics 2016-06-30 Lin Lin , Jia Li

As one of Bayesian analysis tools, Hidden Markov Model (HMM) has been used to in extensive applications. Most HMMs are solved by Baum-Welch algorithm (BWHMM) to predict the model parameters, which is difficult to find global optimal…

Machine Learning · Statistics 2018-11-09 L. Chang , Yacine Ouzrout , Antoine Nongaillard , Abdelaziz Bouras

This paper addresses the issue of model selection for hidden Markov models (HMMs). We generalize factorized asymptotic Bayesian inference (FAB), which has been recently developed for model selection on independent hidden variables (i.e.,…

Machine Learning · Computer Science 2012-06-22 Ryohei Fujimaki , Kohei Hayashi

Bayesian methods have shown success in deep learning applications. For example, in predictive tasks, Bayesian neural networks leverage Bayesian reasoning of model uncertainty to improve the reliability and uncertainty awareness of deep…

Machine Learning · Computer Science 2025-10-21 Wenlong Chen , Bolian Li , Ruqi Zhang , Yingzhen Li

Variational inference (VI) plays an essential role in approximate Bayesian inference due to its computational efficiency and broad applicability. Crucial to the performance of VI is the selection of the associated divergence measure, as VI…

Machine Learning · Computer Science 2021-06-24 Ruqi Zhang , Yingzhen Li , Christopher De Sa , Sam Devlin , Cheng Zhang

Linear mixed effects models are widely used in statistical modelling. We consider a mixed effects model with Bayesian variable selection in the random effects using spike-and-slab priors and developed a variational Bayes inference scheme…

Methodology · Statistics 2024-08-15 M-Z. Spyropoulou , J. Hopker , J. E. Griffin

Undirected graphical models are applied in genomics, protein structure prediction, and neuroscience to identify sparse interactions that underlie discrete data. Although Bayesian methods for inference would be favorable in these contexts,…

Machine Learning · Statistics 2017-06-15 John Ingraham , Debora Marks

High-dimensional variable selection, with many more covariates than observations, is widely documented in standard regression models, but there are still few tools to address it in non-linear mixed-effects models where data are collected…

Statistics Theory · Mathematics 2024-04-08 Marion Naveau , Guillaume Kon Kam King , Renaud Rincent , Laure Sansonnet , Maud Delattre

Non-homogeneous hidden Markov models (NHHMM) are a subclass of dependent mixture models used for semi-supervised learning, where both transition probabilities between the latent states and mean parameter of the probability distribution of…

Machine Learning · Statistics 2019-12-23 Aliaksandr Hubin