English
Related papers

Related papers: Learning Hidden Markov Models When the Locations o…

200 papers

The Baum-Welsh algorithm together with its derivatives and variations has been the main technique for learning Hidden Markov Models (HMM) from observational data. We present an HMM learning algorithm based on the non-negative matrix…

Machine Learning · Computer Science 2011-01-11 George Cybenko , Valentino Crespi

Hidden Markov Models (HMMs) comprise a powerful generative approach for modeling sequential data and time-series in general. However, the commonly employed assumption of the dependence of the current time frame to a single or multiple…

Machine Learning · Computer Science 2021-09-13 Konstantinos P. Panousis , Sotirios Chatzis , Sergios Theodoridis

Hidden Markov Models (HMMs) are fundamental for modeling sequential data, yet learning their parameters from observations remains challenging. Classical methods like the Baum-Welch algorithm are computationally intensive and prone to local…

Machine Learning · Computer Science 2026-04-27 Reginald Zhiyan Chen , Heng-Sheng Chang , Prashant G. Mehta

Recurrent neural networks (RNNs) provide a powerful approach in neuroscience to infer latent dynamics in neural populations and to generate hypotheses about the neural computations underlying behavior. However, past work has focused on…

Machine Learning · Computer Science 2025-10-30 Elia Torre , Michele Viscione , Lucas Pompe , Benjamin F Grewe , Valerio Mante

The ability to predict the intentions of people based solely on their visual actions is a skill only performed by humans and animals. The intelligence of current computer algorithms has not reached this level of complexity, but there are…

Artificial Intelligence · Computer Science 2011-02-07 Michael DelRose , Christian Wagner , Philip Frederick

We study the frontier between learnable and unlearnable hidden Markov models (HMMs). HMMs are flexible tools for clustering dependent data coming from unknown populations. The model parameters are known to be fully identifiable (up to…

Machine Learning · Statistics 2022-10-25 Kweku Abraham , Zacharie Naulet , Elisabeth Gassiat

Hidden Markov models (HMMs) are one of the most widely used statistical methods for analyzing sequence data. However, the reporting of output from HMMs has largely been restricted to the presentation of the most-probable (MAP) hidden state…

Methodology · Statistics 2015-05-01 Michalis K. Titsias , Christopher Yau , Christopher C. Holmes

The hidden Markov model (HMM) has been a workhorse of single molecule data analysis and is now commonly used as a standalone tool in time series analysis or in conjunction with other analyses methods such as tracking. Here we provide a…

Data Analysis, Statistics and Probability · Physics 2017-06-28 Ioannis Sgouralis , Steve Presse

Hidden Markov Model (HMM) is often regarded as the dynamical model of choice in many fields and applications. It is also at the heart of most state-of-the-art speech recognition systems since the 70's. However, from Gaussian mixture models…

Computation and Language · Computer Science 2016-07-04 Sébastien Gagnon , Jean Rouat

Hidden Markov models (HMMs) are probabilistic functions of finite Markov chains, or, put in other words, state space models with finite state space. In this paper, we examine subspace estimation methods for HMMs whose output lies a finite…

Statistics Theory · Mathematics 2009-11-20 Sofia Andersson , Tobias Rydén

The hidden Markov model (HMM) is a fundamental tool for sequence modeling that cleanly separates the hidden state from the emission structure. However, this separation makes it difficult to fit HMMs to large datasets in modern NLP, and they…

Computation and Language · Computer Science 2020-11-10 Justin T. Chiu , Alexander M. Rush

Hidden Markov models (HMMs) are commonly used for disease progression modeling when the true patient health state is not fully known. Since HMMs typically have multiple local optima, incorporating additional patient covariates can improve…

Machine Learning · Statistics 2021-10-05 Matt Baucum , Anahita Khojandi , Theodore Papamarkou

Hidden Markov Chains (HMCs) are commonly used mathematical models of probabilistic systems. They are employed in various fields such as speech recognition, signal processing, and biological sequence analysis. We consider the problem of…

Data Structures and Algorithms · Computer Science 2016-05-10 Stefan Kiefer , A. Prasad Sistla

The Baum-Welch (B-W) algorithm is the most widely accepted method for inferring hidden Markov models (HMM). However, it is prone to getting stuck in local optima, and can be too slow for many real-time applications. Spectral learning of…

Machine Learning · Statistics 2024-08-27 Xiaoyuan Ma , Jordan Rodu

Hidden Markov Models (HMMs) are powerful tools for modeling sequential data, where the underlying states evolve in a stochastic manner and are only indirectly observable. Traditional HMM approaches are well-established for linear sequences,…

Machine Learning · Statistics 2024-06-05 Farzan Vafa , Sahand Hormoz

Scripts have been proposed to model the stereotypical event sequences found in narratives. They can be applied to make a variety of inferences including filling gaps in the narratives and resolving ambiguous references. This paper proposes…

Computation and Language · Computer Science 2018-09-12 J. Walker Orr , Prasad Tadepalli , Janardhan Rao Doppa , Xiaoli Fern , Thomas G. Dietterich

We are interested in assessing the order of a finite-state Hidden Markov Model (HMM) with the only two assumptions that the transition matrix of the latent Markov chain has full rank and that the density functions of the emission…

Statistics Theory · Mathematics 2023-11-29 Marie Du Roy de Chaumaray , Salima El Kolei , Marie-Pierre Etienne , Matthieu Marbac

We consider the problem of estimating the number of hidden states (the order) of a nonparametric hidden Markov model (HMM). We propose two different methods and prove their almost sure consistency without any prior assumption, be it on the…

Statistics Theory · Mathematics 2017-05-19 Luc Lehéricy

Hidden Markov models (HMMs) are popular models to identify a finite number of latent states from sequential data. However, fitting them to large data sets can be computationally demanding because most likelihood maximization techniques…

The hidden Markov model (HMM) is a generative model that treats sequential data under the assumption that each observation is conditioned on the state of a discrete hidden variable that evolves in time as a Markov chain. In this paper, we…

Artificial Intelligence · Computer Science 2011-09-07 Emanuele Coviello , Antoni B. Chan , Gert R. G. Lanckriet