English
Related papers

Related papers: Spectral dimensionality reduction for HMMs

200 papers

We introduce an extension of finite mixture models by incorporating skew-normal distributions within a Hidden Markov Model framework. By assuming a constant transition probability matrix and allowing emission distributions to vary according…

Methodology · Statistics 2025-09-25 Andrea Nigri , Marco Forti , Han Lin Shang

There is much interest in the Hierarchical Dirichlet Process Hidden Markov Model (HDP-HMM) as a natural Bayesian nonparametric extension of the traditional HMM. However, in many settings the HDP-HMM's strict Markovian constraints are…

Machine Learning · Computer Science 2012-03-19 Matthew J. Johnson , Alan Willsky

We propose a streamlined spectral algorithm for community detection in the two-community stochastic block model (SBM) under constant edge density assumptions. By reducing algorithmic complexity through the elimination of non-essential…

Social and Information Networks · Computer Science 2026-02-20 Sie Hendrata Dharmawan , Peter Chin

Language models based on deep neural networks and traditional stochastic modelling have become both highly functional and effective in recent times. In this work, a general survey into the two types of language modelling is conducted. We…

Machine Learning · Computer Science 2021-03-02 Larkin Liu , Yu-Chung Lin , Joshua Reid

This paper uses stochastic dominance principles to construct upper and lower sample path bounds for Hidden Markov Model (HMM) filters. Given a HMM, by using convex optimization methods for nuclear norm minimization with copositive…

Computation · Statistics 2015-06-22 Vikram Krishnamurthy , Cristian Rojas

We measure the influence of individual observations on the sequence of the hidden states of the Hidden Markov Model (HMM) by means of the Kullback-Leibler distance (KLD). Namely, we consider the KLD between the conditional distribution of…

Information Theory · Computer Science 2015-06-11 Vittorio Perduca , Gregory Nuel

The Hidden Markov Model (HMM) can predict the future value of a time series based on its current and previous values, making it a powerful algorithm for handling various types of time series. Numerous studies have explored the improvement…

Machine Learning · Computer Science 2024-02-28 YeXin Huang

We explore the use of traditional and contemporary hidden Markov models (HMMs) for sequential physiological data analysis and sepsis prediction in preterm infants. We investigate the use of classical Gaussian mixture model based HMM, and a…

Machine Learning · Computer Science 2019-10-31 Antoine Honore , Dong Liu , David Forsberg , Karen Coste , Eric Herlenius , Saikat Chatterjee , Mikael Skoglund

We consider probabilistic systems with hidden state and unobservable transitions, an extension of Hidden Markov Models (HMMs) that in particular admits unobservable {\epsilon}-transitions (also called null transitions), allowing state…

Machine Learning · Computer Science 2022-05-30 Rebecca Bernemann , Barbara König , Matthias Schaffeld , Torben Weis

Interpretable classification of time series presents significant challenges in high dimensions. Traditional feature selection methods in the frequency domain often assume sparsity in spectral density matrices (SDMs) or their inverses, which…

Machine Learning · Statistics 2024-08-19 Sarbojit Roy , Malik Shahid Sultan , Hernando Ombao

We consider Markov models of stochastic processes where the next-step conditional distribution is defined by a kernel density estimator (KDE), similar to Markov forecast densities and certain time-series bootstrap schemes. The KDE Markov…

Machine Learning · Computer Science 2018-07-31 Gustav Eje Henter , Arne Leijon , W. Bastiaan Kleijn

This work proposes a multi-agent filtering algorithm over graphs for finite-state hidden Markov models (HMMs), which can be used for sequential state estimation or for tracking opinion formation over dynamic social networks. We show that…

Signal Processing · Electrical Eng. & Systems 2022-03-10 Mert Kayaalp , Virginia Bordignon , Stefan Vlaski , Ali H. Sayed

Linear mixed models (LMMs) are used extensively to model dependecies of observations in linear regression and are used extensively in many application areas. Parameter estimation for LMMs can be computationally prohibitive on big data.…

Machine Learning · Statistics 2019-03-08 Zilong Tan , Kimberly Roche , Xiang Zhou , Sayan Mukherjee

Extending classical probabilistic reasoning using the quantum mechanical view of probability has been of recent interest, particularly in the development of hidden quantum Markov models (HQMMs) to model stochastic processes. However, there…

Machine Learning · Computer Science 2019-12-05 Sandesh Adhikary , Siddarth Srinivasan , Geoff Gordon , Byron Boots

Hyper-spectral data can be analyzed to recover physical properties at large planetary scales. This involves resolving inverse problems which can be addressed within machine learning, with the advantage that, once a relationship between…

Applications · Statistics 2015-12-31 Antoine Deleforge , Florence Forbes , Sileye Ba , Radu Horaud

Pairwise Markov Models (PMMs) extend the wellknown Hidden Markov Models (HMMs). Being significantly more general, PMMs enable several types of processing, like Bayesian filtering or smoothing, similar to those used in HMMs. In this paper,…

Dynamical Systems · Mathematics 2024-02-13 Marc Escudier , Ikram Abdelkefi , Clément Fernandes , Wojciech Pieczynski

In a mixed generalized linear model, the goal is to learn multiple signals from unlabeled observations: each sample comes from exactly one signal, but it is not known which one. We consider the prototypical problem of estimating two…

Statistics Theory · Mathematics 2026-01-12 Yihan Zhang , Marco Mondelli , Ramji Venkataramanan

This paper intends to apply the Hidden Markov Model into stock market and and make predictions. Moreover, four different methods of improvement, which are GMM-HMM, XGB-HMM, GMM-HMM+LSTM and XGB-HMM+LSTM, will be discussed later with the…

Pricing of Securities · Quantitative Finance 2021-04-21 Mingwen Liu , Junbang Huo , Yulin Wu , Jinge Wu

There is an increase in interest to model driving maneuver patterns via the automatic unsupervised clustering of naturalistic sequential kinematic driving data. The patterns learned are often used in transportation research areas such as…

Machine Learning · Statistics 2023-11-14 Matthew Aguirre , Wenbo Sun , Jionghua , Jin , Yang Chen

Hidden Markov models provide a natural statistical framework for the detection of the copy number variations (CNV) in genomics. In this paper, we consider a Hidden Markov Model involving several correlated hidden processes at the same time.…

Methodology · Statistics 2017-06-22 Xiaoqiang Wang , Emilie Lebarbier , Julie Aubert , Stéphane Robin