English
Related papers

Related papers: Fundamental limits for learning hidden Markov mode…

200 papers

Hidden Markov Models, HMM's, are mathematical models of Markov processes with state that is hidden, but from which information can leak. They are typically represented as 3-way joint-probability distributions. We use HMM's as denotations of…

Logic in Computer Science · Computer Science 2023-06-22 Annabelle McIver , Carroll Morgan , Tahiry Rabehaja

The prevalence of hidden Markov models (HMMs) in various applications of statistical signal processing and communications is a testament to the power and flexibility of the model. In this paper, we link the identifiability problem with…

Information Theory · Computer Science 2013-05-03 Paul Tune , Hung X. Nguyen , Matthew Roughan

We consider probabilistic systems with hidden state and unobservable transitions, an extension of Hidden Markov Models (HMMs) that in particular admits unobservable {\epsilon}-transitions (also called null transitions), allowing state…

Machine Learning · Computer Science 2022-05-30 Rebecca Bernemann , Barbara König , Matthias Schaffeld , Torben Weis

Ecological systems can often be characterised by changes among a finite set of underlying states pertaining to individuals, populations, communities, or entire ecosystems through time. Owing to the inherent difficulty of empirical field…

Quantitative Methods · Quantitative Biology 2020-11-12 Brett T. McClintock , Roland Langrock , Olivier Gimenez , Emmanuelle Cam , David L. Borchers , Richard Glennie , Toby A. Patterson

While hidden class models of various types arise in many statistical applications, it is often difficult to establish the identifiability of their parameters. Focusing on models in which there is some structure of independence of some of…

Statistics Theory · Mathematics 2009-09-01 Elizabeth S. Allman , Catherine Matias , John A. Rhodes

Hidden Markov models (HMMs) and partially observable Markov decision processes (POMDPs) provide useful tools for modeling dynamical systems. They are particularly useful for representing the topology of environments such as road networks…

Artificial Intelligence · Computer Science 2011-06-06 L. P. Kaelbling , H. Shatkay

We address the problem of analyzing sets of noisy time-varying signals that all report on the same process but confound straightforward analyses due to complex inter-signal heterogeneities and measurement artifacts. In particular we…

Hidden Markov Models (HMMs) are foundational tools for modeling sequential data with latent Markovian structure, yet fitting them to real-world data remains computationally challenging. In this work, we show that pre-trained large language…

Machine Learning · Computer Science 2026-04-27 Yijia Dai , Zhaolin Gao , Yahya Sattar , Sarah Dean , Jennifer J. Sun

Hidden Markov Models (HMMs) can be accurately approximated using co-occurrence frequencies of pairs and triples of observations by using a fast spectral method in contrast to the usual slow methods like EM or Gibbs sampling. We provide a…

Machine Learning · Statistics 2012-03-29 Dean P. Foster , Jordan Rodu , Lyle H. Ungar

The hidden Markov model (HMM) provides a powerful framework for inference in time-varying environments, where the underlying state evolves according to a Markov chain. To address the optimal filtering problem in general dynamic settings, we…

Systems and Control · Electrical Eng. & Systems 2025-06-10 Dongyan Sui , Haotian Pu , Siyang Leng , Stefan Vlaski

The formalism of state estimation and hidden Markov models (HMMs) can simplify and clarify the discussion of stochastic thermodynamics in the presence of feedback and measurement errors. After reviewing the basic formalism, we use it to…

Statistical Mechanics · Physics 2015-11-13 John Bechhoefer

Hidden Markov models (HMMs) have been used increasingly to understand how movement patterns of animals arise from behavioural states. An animal is assumed to transition between behavioural states through time, as described by transition…

Quantitative Methods · Quantitative Biology 2025-10-07 Théo Michelot , Emma Storey

In this paper, we prove that finite state space non parametric hidden Markov models are identifiable as soon as the transition matrix of the latent Markov chain has full rank and the emission probability distributions are linearly…

Methodology · Statistics 2013-06-20 Elisabeth Gassiat , Alice Cleynen , Stéphane Robin

Mixtures of Hidden Markov Models (MHMMs) are frequently used for clustering of sequential data. An important aspect of MHMMs, as of any clustering approach, is that they can be interpretable, allowing for novel insights to be gained from…

Artificial Intelligence · Computer Science 2021-03-24 Negar Safinianaini , Henrik Boström

A Hidden Markov Model (HMM) is a common statistical model which is widely used for analysis of biological sequence data and other sequential phenomena. In the present paper we show how HMMs can be extended with side-constraints and present…

Artificial Intelligence · Computer Science 2010-08-02 Henning Christiansen , Christian Theil Have , Ole Torp Lassen , Matthieu Petit

Nonparametric identification and maximum likelihood estimation for finite-state hidden Markov models are investigated. We obtain identification of the parameters as well as the order of the Markov chain if the transition probability…

Statistics Theory · Mathematics 2015-10-01 Grigory Alexandrovich , Hajo Holzmann , Anna Leister

Scripts have been proposed to model the stereotypical event sequences found in narratives. They can be applied to make a variety of inferences including filling gaps in the narratives and resolving ambiguous references. This paper proposes…

Computation and Language · Computer Science 2018-09-12 J. Walker Orr , Prasad Tadepalli , Janardhan Rao Doppa , Xiaoli Fern , Thomas G. Dietterich

The hidden Markov model (HMM) is a widely-used generative model that copes with sequential data, assuming that each observation is conditioned on the state of a hidden Markov chain. In this paper, we derive a novel algorithm to cluster HMMs…

Machine Learning · Computer Science 2012-10-26 Emanuele Coviello , Antoni B. Chan , Gert R. G. Lanckriet

In unsupervised classification, Hidden Markov Models (HMM) are used to account for a neighborhood structure between observations. The emission distributions are often supposed to belong to some parametric family. In this paper, a…

Machine Learning · Statistics 2012-06-25 Stevenn Volant , Caroline Bérard , Marie-Laure Martin-Magniette , Stéphane Robin

Hidden Markov models (HMMs) are flexible time series models in which the distributions of the observations depend on unobserved serially correlated states. The state-dependent distributions in HMMs are usually taken from some class of…

Methodology · Statistics 2014-06-19 Roland Langrock , Thomas Kneib , Alexander Sohn , Stacy DeRuiter