English
Related papers

Related papers: On approximation of smoothing probabilities for hi…

200 papers

Suppose that we are given a time series where consecutive samples are believed to come from a probabilistic source, that the source changes from time to time and that the total number of sources is fixed. Our objective is to estimate the…

Information Theory · Computer Science 2018-04-24 Mark Kozdoba , Shie Mannor

This paper presents algorithms for parallelization of inference in hidden Markov models (HMMs). In particular, we propose parallel backward-forward type of filtering and smoothing algorithm as well as parallel Viterbi-type…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-07 Sakira Hassan , Simo Särkkä , Ángel F. García-Fernández

Online (also called "recursive" or "adaptive") estimation of fixed model parameters in hidden Markov models is a topic of much interest in times series modelling. In this work, we propose an online parameter estimation algorithm that…

Computation · Statistics 2011-02-16 Olivier Cappé

We describe a generalization of the Hierarchical Dirichlet Process Hidden Markov Model (HDP-HMM) which is able to encode prior information that state transitions are more likely between "nearby" states. This is accomplished by defining a…

Machine Learning · Statistics 2017-07-24 Colin Reimer Dawson , Chaofan Huang , Clayton T. Morrison

Hidden Markov models (HMM) have been widely used by scientists to model stochastic systems: the underlying process is a discrete Markov chain and the observations are noisy realizations of the underlying process. Determining the number of…

Statistics Theory · Mathematics 2024-07-18 Yang Chen , Cheng-Der Fuh , Chu-Lan Michael Kao

The Hidden Markov Model (HMM) is one of the mainstays of statistical modeling of discrete time series, with applications including speech recognition, computational biology, computer vision and econometrics. Estimating an HMM from its…

Machine Learning · Statistics 2015-12-29 Fanny Yang , Sivaraman Balakrishnan , Martin J. Wainwright

Hidden Markov models (HMMs) are commonly used for disease progression modeling when the true patient health state is not fully known. Since HMMs typically have multiple local optima, incorporating additional patient covariates can improve…

Machine Learning · Statistics 2021-10-05 Matt Baucum , Anahita Khojandi , Theodore Papamarkou

Likelihood-free inference methods based on neural conditional density estimation were shown to drastically reduce the simulation burden in comparison to classical methods such as ABC. When applied in the context of any latent variable…

Machine Learning · Statistics 2024-05-06 Sanmitra Ghosh , Paul J. Birrell , Daniela De Angelis

In this paper, we consider the filtering and smoothing recursions in nonparametric finite state space hidden Markov models (HMMs) when the parameters of the model are unknown and replaced by estimators. We provide an explicit and time…

Statistics Theory · Mathematics 2015-07-24 Yohann De Castro , Elisabeth Gassiat , Sylvain Le Corff

Hidden Markov models and their variants are the predominant sequential classification method in such domains as speech recognition, bioinformatics and natural language processing. Being generative rather than discriminative models, however,…

Machine Learning · Statistics 2013-02-18 John A. Quinn , Masashi Sugiyama

This paper deals with parameter estimation in pair hidden Markov models (pair-HMMs). We first provide a rigorous formalism for these models and discuss possible definitions of likelihoods. The model being biologically motivated, some…

Statistics Theory · Mathematics 2010-12-09 Ana Arribas-Gil , Elisabeth Gassiat , Catherine Matias

This paper is concerned with the computational complexity of learning the Hidden Markov Model (HMM). Although HMMs are some of the most widely used tools in sequential and time series modeling, they are cryptographically hard to learn in…

Machine Learning · Computer Science 2024-02-27 Sham M. Kakade , Akshay Krishnamurthy , Gaurav Mahajan , Cyril Zhang

Since the early days of digital communication, Hidden Markov Models (HMMs) have now been routinely used in speech recognition, processing of natural languages, images, and in bioinformatics. An HMM $(X_i,Y_i)_{i\ge 1}$ assumes observations…

Statistics Theory · Mathematics 2009-02-06 J. Lember , A. Koloydenko

A popular way to estimate the parameters of a hidden Markov model (HMM) is direct numerical maximization (DNM) of the (log-)likelihood function. The advantages of employing the TMB (Kristensen et al., 2016) framework in R for this purpose…

Computation · Statistics 2023-05-16 Timothée Bacri , Geir D. Berentsen , Jan Bulla , Bård Støve

In this paper, the forgetting of the initial distribution for a non-ergodic Hidden Markov Models (HMM) is studied. A new set of conditions is proposed to establish the forgetting property of the filter, which significantly extends all the…

Probability · Mathematics 2008-10-14 Elisabeth Gassiat , Benoit Landelle , Eric Moulines

A hidden Markov model (HMM) is said to have path-mergeable states if for any two states i,j there exists a word w and state k such that it is possible to transition from both i and j to k while emitting w. We show that for a finite HMM with…

Probability · Mathematics 2014-02-06 Nicholas F. Travers

This paper intends to apply the Hidden Markov Model into stock market and and make predictions. Moreover, four different methods of improvement, which are GMM-HMM, XGB-HMM, GMM-HMM+LSTM and XGB-HMM+LSTM, will be discussed later with the…

Pricing of Securities · Quantitative Finance 2021-04-21 Mingwen Liu , Junbang Huo , Yulin Wu , Jinge Wu

As deep neural networks continue to revolutionize various application domains, there is increasing interest in making these powerful models more understandable and interpretable, and narrowing down the causes of good and bad predictions. We…

Machine Learning · Statistics 2016-11-21 Viktoriya Krakovna , Finale Doshi-Velez

The Hidden Markov Model (HMM) can predict the future value of a time series based on its current and previous values, making it a powerful algorithm for handling various types of time series. Numerous studies have explored the improvement…

Machine Learning · Computer Science 2024-02-28 YeXin Huang

The stock market presents a challenging environment for accurately predicting future stock prices due to its intricate and ever-changing nature. However, the utilization of advanced methodologies can significantly enhance the precision of…

Systems and Control · Electrical Eng. & Systems 2025-12-02 Luigi Catello , Ludovica Ruggiero , Lucia Schiavone , Mario Valentino