English
Related papers

Related papers: Forward-Backward Latent State Inference for Hidden…

200 papers

Hidden Markov models (HMMs) are flexible tools for clustering dependent data coming from unknown populations, allowing nonparametric modelling of the population densities. Identifiability fails when the data is in fact independent and…

Statistics Theory · Mathematics 2025-07-16 Kweku Abraham , Elisabeth Gassiat , Zacharie Naulet

In textual information extraction and other sequence labeling tasks it is now common to use recurrent neural networks (such as LSTM) to form rich embedded representations of long-term input co-occurrence patterns. Representation of output…

Computation and Language · Computer Science 2017-08-03 Dung Thai , Shikhar Murty , Trapit Bansal , Luke Vilnis , David Belanger , Andrew McCallum

Hidden Markov models (HMMs) are popular time series model in many fields including ecology, economics and genetics. HMMs can be defined over discrete or continuous time, though here we only cover the former. In the field of movement ecology…

Quantitative Methods · Quantitative Biology 2018-06-29 Vianey Leos-Barajas , Théo Michelot

We consider a Hidden Markov Model (HMM) where the integrated continuous-time Markov chain can be observed at discrete time points perturbed by a Brownian motion. The aim is to derive a filter for the underlying continuous-time Markov chain.…

Probability · Mathematics 2021-07-21 Nicole Bäuerle , Igor Gilitschenski , Uwe D. Hanebeck

If the state space of a homogeneous continuous-time Markov chain is too large, making inferences - here limited to determining marginal or limit expectations - becomes computationally infeasible. Fortunately, the state space of such a chain…

Probability · Mathematics 2018-06-01 Alexander Erreygers , Jasper De Bock

Hidden Markov Models are widely used in classical computer science to model stochastic processes with a wide range of applications. This paper concerns the quantum analogues of these machines --- so-called Hidden Quantum Markov Models…

Quantum Physics · Physics 2015-03-05 Lewis A. Clark , Wei Huang , Thomas M. Barlow , Almut Beige

We are interested in assessing the order of a finite-state Hidden Markov Model (HMM) with the only two assumptions that the transition matrix of the latent Markov chain has full rank and that the density functions of the emission…

Statistics Theory · Mathematics 2023-11-29 Marie Du Roy de Chaumaray , Salima El Kolei , Marie-Pierre Etienne , Matthieu Marbac

In unsupervised classification, Hidden Markov Models (HMM) are used to account for a neighborhood structure between observations. The emission distributions are often supposed to belong to some parametric family. In this paper, a…

Machine Learning · Statistics 2012-06-25 Stevenn Volant , Caroline Bérard , Marie-Laure Martin-Magniette , Stéphane Robin

A hidden Markov model (HMM) solved recursively by the Viterbi algorithm can be configured to search for persistent, quasimonochromatic gravitational radiation from an isolated or accreting neutron star, whose rotational frequency is unknown…

General Relativity and Quantum Cosmology · Physics 2021-09-01 A. Melatos , P. Clearwater , S. Suvorova , L. Sun , W. Moran , R. J. Evans

Since the early days of digital communication, Hidden Markov Models (HMMs) have now been routinely used in speech recognition, processing of natural languages, images, and in bioinformatics. An HMM $(X_i,Y_i)_{i\ge 1}$ assumes observations…

Statistics Theory · Mathematics 2009-02-06 J. Lember , A. Koloydenko

We aim at the construction of a Hidden Markov Model (HMM) of assigned complexity (number of states of the underlying Markov chain) which best approximates, in Kullback-Leibler divergence rate, a given stationary process. We establish, under…

Optimization and Control · Mathematics 2014-07-03 Lorenzo Finesso , Angela Grassi , Peter Spreij

In this paper, we consider the filtering and smoothing recursions in nonparametric finite state space hidden Markov models (HMMs) when the parameters of the model are unknown and replaced by estimators. We provide an explicit and time…

Statistics Theory · Mathematics 2015-07-24 Yohann De Castro , Elisabeth Gassiat , Sylvain Le Corff

Labeling of sequential data is a prevalent meta-problem for a wide range of real world applications. While the first-order Hidden Markov Models (HMM) provides a fundamental approach for unsupervised sequential labeling, the basic model does…

Machine Learning · Computer Science 2019-04-08 Maoying Qiao , Wei Bian , Richard Yida Xu , Dacheng Tao

The hidden Markov model (HMM) is a classic modeling tool with a wide swath of applications. Its inception considered observations restricted to a finite alphabet, but it was quickly extended to multivariate continuous distributions. In this…

Methodology · Statistics 2022-05-30 Adam B Kashlak , Prachi Loliencar , Giseon Heo

We present a lightweight approach to sequence classification using Ensemble Methods for Hidden Markov Models (HMMs). HMMs offer significant advantages in scenarios with imbalanced or smaller datasets due to their simplicity,…

Machine Learning · Computer Science 2024-09-13 Maxime Kawawa-Beaudan , Srijan Sood , Soham Palande , Ganapathy Mani , Tucker Balch , Manuela Veloso

Latent Gaussian process (GP) models are widely used in neuroscience to uncover hidden state evolutions from sequential observations, mainly in neural activity recordings. While latent GP models provide a principled and powerful solution in…

Neurons and Cognition · Quantitative Biology 2023-06-06 Matthew Dowling , Yuan Zhao , Il Memming Park

The Hierarchical Dirichlet Process Hidden Markov Model (HDP-HMM) is a natural Bayesian nonparametric extension of the classical Hidden Markov Model for learning from (spatio-)temporal data. A sticky HDP-HMM has been proposed to strengthen…

Machine Learning · Computer Science 2024-11-08 Mikołaj Słupiński , Piotr Lipiński

Markov chain Monte Carlo (MCMC) algorithms for hidden Markov models often rely on the forward-backward sampler. This makes them computationally slow as the length of the time series increases, motivating the development of…

Machine Learning · Statistics 2024-07-26 Rihui Ou , Deborshee Sen , Alexander L Young , David B Dunson

This paper presents a novel methodology for modelling precipitation patterns in a specific geographical region using Hidden Markov Models (HMMs). Departing from conventional HMMs, where the hidden state process is assumed to be Markovian,…

Methodology · Statistics 2025-08-05 M. L. Gamiz , D. Montoro , M. C Segovia-Garcia

The hidden Markov model (HMM) has been a workhorse of single molecule data analysis and is now commonly used as a standalone tool in time series analysis or in conjunction with other analyses methods such as tracking. Here we provide a…

Data Analysis, Statistics and Probability · Physics 2017-06-28 Ioannis Sgouralis , Steve Presse