English
Related papers

Related papers: Forgetting of the initial distribution for Hidden …

200 papers

Hidden Markov models have successfully been applied as models of discrete time series in many fields. Often, when applied in practice, the parameters of these models have to be estimated. The currently predominating identification methods,…

Machine Learning · Statistics 2015-07-24 Robert Mattila , Cristian R. Rojas , Bo Wahlberg

We introduce the Reduced-Rank Hidden Markov Model (RR-HMM), a generalization of HMMs that can model smooth state evolution as in Linear Dynamical Systems (LDSs) as well as non-log-concave predictive distributions as in…

Machine Learning · Computer Science 2009-12-23 Sajid M. Siddiqi , Byron Boots , Geoffrey J. Gordon

Over the last decade, hidden Markov models (HMMs) have become increasingly popular in statistical ecology, where they constitute natural tools for studying animal behavior based on complex sensor data. Corresponding analyses sometimes…

Methodology · Statistics 2025-10-15 Jan-Ole Koslik , Carlina C. Feldmann , Sina Mews , Rouven Michels , Roland Langrock

We develop a recursion for hidden Markov model of any order h, which allows us to obtain the posterior distribution of the latent state at every occasion, given the previous h states and the observed data. With respect to the well-known…

Statistics Theory · Mathematics 2012-01-04 Francesco Bartolucci

Hidden tree Markov models allow learning distributions for tree structured data while being interpretable as nondeterministic automata. We provide a concise summary of the main approaches in literature, focusing in particular on the…

Machine Learning · Statistics 2018-06-01 Davide Bacciu , Daniele Castellana

We propose DenseHMM - a modification of Hidden Markov Models (HMMs) that allows to learn dense representations of both the hidden states and the observables. Compared to the standard HMM, transition probabilities are not atomic but composed…

Machine Learning · Computer Science 2020-12-18 Joachim Sicking , Maximilian Pintz , Maram Akila , Tim Wirtz

We are interested in assessing the order of a finite-state Hidden Markov Model (HMM) with the only two assumptions that the transition matrix of the latent Markov chain has full rank and that the density functions of the emission…

Statistics Theory · Mathematics 2023-11-29 Marie Du Roy de Chaumaray , Salima El Kolei , Marie-Pierre Etienne , Matthieu Marbac

The hidden Markov model (HMM) is a classic modeling tool with a wide swath of applications. Its inception considered observations restricted to a finite alphabet, but it was quickly extended to multivariate continuous distributions. In this…

Methodology · Statistics 2022-05-30 Adam B Kashlak , Prachi Loliencar , Giseon Heo

Markov chain Monte Carlo (MCMC) methods are frequently used to approximately simulate high-dimensional, multimodal probability distributions. In adaptive MCMC methods, the transition kernel is changed "on the fly" in the hope to speed up…

Probability · Mathematics 2014-06-04 Winfried Barta

This paper is concerned with the computational complexity of learning the Hidden Markov Model (HMM). Although HMMs are some of the most widely used tools in sequential and time series modeling, they are cryptographically hard to learn in…

Machine Learning · Computer Science 2024-02-27 Sham M. Kakade , Akshay Krishnamurthy , Gaurav Mahajan , Cyril Zhang

Hidden Quantum Markov Models (HQMMs) can be thought of as quantum probabilistic graphical models that can model sequential data. We extend previous work on HQMMs with three contributions: (1) we show how classical hidden Markov models…

Machine Learning · Statistics 2017-10-26 Siddarth Srinivasan , Geoff Gordon , Byron Boots

We present a novel approach for learning an HMM whose outputs are distributed according to a parametric family. This is done by {\em decoupling} the learning task into two steps: first estimating the output parameters, and then estimating…

Machine Learning · Computer Science 2013-02-26 Aryeh Kontorovich , Boaz Nadler , Roi Weiss

We study the frontier between learnable and unlearnable hidden Markov models (HMMs). HMMs are flexible tools for clustering dependent data coming from unknown populations. The model parameters are known to be fully identifiable (up to…

Machine Learning · Statistics 2022-10-25 Kweku Abraham , Zacharie Naulet , Elisabeth Gassiat

Nature, as far as we know, evolves continuously through space and time. Yet the ubiquitous hidden Markov model (HMM)--originally developed for discrete time and space analysis in natural language processing--remains a central tool in…

Biomolecules · Quantitative Biology 2025-06-09 Max Schweiger , Ayush Saurabh , Steve Pressé

The hidden Markov model (HMM) is a fundamental tool for sequence modeling that cleanly separates the hidden state from the emission structure. However, this separation makes it difficult to fit HMMs to large datasets in modern NLP, and they…

Computation and Language · Computer Science 2020-11-10 Justin T. Chiu , Alexander M. Rush

In this paper we study posterior consistency for different topologies on the parameters for hidden Markov models with finite state space. We first obtain weak and strong posterior consistency for the marginal density function of finitely…

Statistics Theory · Mathematics 2014-07-09 Elodie Vernet

We demonstrate the application of pattern recognition algorithms via hidden Markov models (HMM) for qubit readout. This scheme provides a state-path trajectory approach capable of detecting qubit state transitions and makes for a robust…

Quantum Physics · Physics 2021-01-04 Luis A. Martinez , Yaniv J. Rosen , Jonathan L. DuBois

In this paper, we propose an algorithm for estimating the parameters of a time-homogeneous hidden Markov model from aggregate observations. This problem arises when only the population level counts of the number of individuals at each time…

Machine Learning · Computer Science 2021-11-16 Rahul Singh , Qinsheng Zhang , Yongxin Chen

We consider the problem of estimating the number of hidden states (the order) of a nonparametric hidden Markov model (HMM). We propose two different methods and prove their almost sure consistency without any prior assumption, be it on the…

Statistics Theory · Mathematics 2017-05-19 Luc Lehéricy

A stochastic hybrid system, also known as a switching diffusion, is a continuous-time Markov process with state space consisting of discrete and continuous parts. We consider parametric estimation of theQmatrix for the discrete state…

Probability · Mathematics 2020-10-14 Masaaki Fukasawa