English
Related papers

Related papers: Forgetting of the initial distribution for Hidden …

200 papers

We consider a Hidden Markov Model (HMM) where the integrated continuous-time Markov chain can be observed at discrete time points perturbed by a Brownian motion. The aim is to derive a filter for the underlying continuous-time Markov chain.…

Probability · Mathematics 2021-07-21 Nicole Bäuerle , Igor Gilitschenski , Uwe D. Hanebeck

We present a new algorithm for identifying the transition and emission probabilities of a hidden Markov model (HMM) from the emitted data. Expectation-maximization becomes computationally prohibitive for long observation records, which are…

Computation and Language · Computer Science 2018-06-20 Kejun Huang , Xiao Fu , Nicholas D. Sidiropoulos

Hidden Markov Models (HMMs) can be accurately approximated using co-occurrence frequencies of pairs and triples of observations by using a fast spectral method in contrast to the usual slow methods like EM or Gibbs sampling. We provide a…

Machine Learning · Statistics 2012-03-29 Dean P. Foster , Jordan Rodu , Lyle H. Ungar

We show how Markov mixed membership models (MMMM) can be used to predict the degradation of assets. We model the degradation path of individual assets, to predict overall failure rates. Instead of a separate distribution for each hidden…

Machine Learning · Computer Science 2020-06-03 Paul Hofmann , Zaid Tashman

The objective of this article is to study the asymptotic behavior of a new particle filtering approach in the context of hidden Markov models (HMMs). In particular, we develop an algorithm where the latent-state sequence is segmented into…

Statistics Theory · Mathematics 2014-09-16 Hock Peng Chan , Chiang Wee Heng , Ajay Jasra

We consider the smoothing probabilities of hidden Markov model (HMM). We show that under fairly general conditions for HMM, the exponential forgetting still holds, and the smoothing probabilities can be well approximated with the ones of…

Machine Learning · Statistics 2011-05-11 J. Lember

We consider the filtering of continuous-time finite-state hidden Markov models, where the rate and observation matrices depend on unknown time-dependent parameters, for which no prior or stochastic model is available. We quantify and…

Probability · Mathematics 2021-03-17 Andrew L. Allan

Regime-switching models, in particular Hidden Markov Models (HMMs) where the switching is driven by an unobservable Markov chain, are widely-used in financial applications, due to their tractability and good econometric properties. In this…

Statistical Finance · Quantitative Finance 2016-02-18 Vikram Krishnamurthy , Elisabeth Leoff , Jörn Sass

This work studies networked agents cooperating to track a dynamical state of nature under partial information. The proposed algorithm is a distributed Bayesian filtering algorithm for finite-state hidden Markov models (HMMs). It can be used…

Signal Processing · Electrical Eng. & Systems 2022-12-07 Mert Kayaalp , Virginia Bordignon , Stefan Vlaski , Vincenzo Matta , Ali H. Sayed

Recently, there has been a surge of interest in using spectral methods for estimating latent variable models. However, it is usually assumed that the distribution of the observations conditioned on the latent variables is either discrete or…

Machine Learning · Statistics 2016-09-22 Kirthevasan Kandasamy , Maruan Al-Shedivat , Eric P. Xing

The well-established methodology for the estimation of hidden semi-Markov models (HSMMs) as hidden Markov models (HMMs) with extended state spaces is further developed to incorporate covariate influences across all aspects of the state…

Methodology · Statistics 2024-05-24 Jan-Ole Koslik

Consider the problem of predicting the next symbol given a sample path of length n, whose joint distribution belongs to a distribution class that may have long-term memory. The goal is to compete with the conditional predictor that knows…

Statistics Theory · Mathematics 2024-04-25 Yanjun Han , Tianze Jiang , Yihong Wu

Hidden semi-Markov models (HSMMs) are latent variable models which allow latent state persistence and can be viewed as a generalization of the popular hidden Markov models (HMMs). In this paper, we introduce a novel spectral algorithm to…

Machine Learning · Statistics 2016-03-01 Igor Melnyk , Arindam Banerjee

Hidden Markov Models (HMMs) are one of the most fundamental and widely used statistical tools for modeling discrete time series. In general, learning HMMs from data is computationally hard (under cryptographic assumptions), and…

Machine Learning · Computer Science 2012-07-10 Daniel Hsu , Sham M. Kakade , Tong Zhang

This paper deals with parameter estimation in pair hidden Markov models (pair-HMMs). We first provide a rigorous formalism for these models and discuss possible definitions of likelihoods. The model being biologically motivated, some…

Statistics Theory · Mathematics 2010-12-09 Ana Arribas-Gil , Elisabeth Gassiat , Catherine Matias

We consider the problem of learning two families of time-evolving random measures from indirect observations. In the first model, the signal is a Fleming--Viot diffusion, which is reversible with respect to the law of a Dirichlet process,…

Statistics Theory · Mathematics 2014-11-19 Omiros Papaspiliopoulos , Matteo Ruggiero , Dario Spanò

In this letter we borrow from the inference techniques developed for unbounded state-cardinality (nonparametric) variants of the HMM and use them to develop a tuning-parameter free, black-box inference procedure for Explicit-state-duration…

Machine Learning · Statistics 2015-06-04 Michael Dewar , Chris Wiggins , Frank Wood

Hidden Markov models (HMMs) are flexible tools for clustering dependent data coming from unknown populations, allowing nonparametric modelling of the population densities. Identifiability fails when the data is in fact independent and…

Statistics Theory · Mathematics 2025-07-16 Kweku Abraham , Elisabeth Gassiat , Zacharie Naulet

The formalism of state estimation and hidden Markov models (HMMs) can simplify and clarify the discussion of stochastic thermodynamics in the presence of feedback and measurement errors. After reviewing the basic formalism, we use it to…

Statistical Mechanics · Physics 2015-11-13 John Bechhoefer

The use of non parametric hidden Markov models with finite state space is flourishing in practice while few theoretical guarantees are known in this framework. Here, we study asymptotic guarantees for these models in the Bayesian framework.…

Statistics Theory · Mathematics 2015-11-30 Elodie Vernet