English
Related papers

Related papers: Spectral Learning of Large Structured HMMs for Com…

200 papers

Hidden Markov Models (HMMs) are one of the most fundamental and widely used statistical tools for modeling discrete time series. In general, learning HMMs from data is computationally hard (under cryptographic assumptions), and…

Machine Learning · Computer Science 2012-07-10 Daniel Hsu , Sham M. Kakade , Tong Zhang

We consider learning parameters of Binomial Hidden Markov Models, which may be used to model DNA methylation data. The standard algorithm for the problem is EM, which is computationally expensive for sequences of the scale of the mammalian…

Machine Learning · Computer Science 2018-02-08 Chicheng Zhang , Eran A. Mukamel , Kamalika Chaudhuri

Hidden Markov models (HMMs) are widely used statistical models for modeling sequential data. The parameter estimation for HMMs from time series data is an important learning problem. The predominant methods for parameter estimation are…

Machine Learning · Computer Science 2014-04-30 Carl Mattfeld

Hidden semi-Markov models (HSMMs) are latent variable models which allow latent state persistence and can be viewed as a generalization of the popular hidden Markov models (HMMs). In this paper, we introduce a novel spectral algorithm to…

Machine Learning · Statistics 2016-03-01 Igor Melnyk , Arindam Banerjee

Hidden Markov Models (HMMs) can be accurately approximated using co-occurrence frequencies of pairs and triples of observations by using a fast spectral method in contrast to the usual slow methods like EM or Gibbs sampling. We provide a…

Machine Learning · Statistics 2012-03-29 Dean P. Foster , Jordan Rodu , Lyle H. Ungar

Hidden Markov Models (HMMs) are powerful tools for modeling sequential data, where the underlying states evolve in a stochastic manner and are only indirectly observable. Traditional HMM approaches are well-established for linear sequences,…

Machine Learning · Statistics 2024-06-05 Farzan Vafa , Sahand Hormoz

We consider the task of learning mappings from sequential data to real-valued responses. We present and evaluate an approach to learning a type of hidden Markov model (HMM) for regression. The learning process involves inferring the…

Machine Learning · Computer Science 2012-06-18 Keith Noto , Mark Craven

This work considers the problem of learning the structure of multivariate linear tree models, which include a variety of directed tree graphical models with continuous, discrete, and mixed latent variables such as linear-Gaussian models,…

Machine Learning · Computer Science 2011-11-09 Animashree Anandkumar , Kamalika Chaudhuri , Daniel Hsu , Sham M. Kakade , Le Song , Tong Zhang

Hidden Quantum Markov Models (HQMMs) can be thought of as quantum probabilistic graphical models that can model sequential data. We extend previous work on HQMMs with three contributions: (1) we show how classical hidden Markov models…

Machine Learning · Statistics 2017-10-26 Siddarth Srinivasan , Geoff Gordon , Byron Boots

This paper is concerned with the computational complexity of learning the Hidden Markov Model (HMM). Although HMMs are some of the most widely used tools in sequential and time series modeling, they are cryptographically hard to learn in…

Machine Learning · Computer Science 2024-02-27 Sham M. Kakade , Akshay Krishnamurthy , Gaurav Mahajan , Cyril Zhang

We address the problem of analyzing sets of noisy time-varying signals that all report on the same process but confound straightforward analyses due to complex inter-signal heterogeneities and measurement artifacts. In particular we…

Hidden Markov models have successfully been applied as models of discrete time series in many fields. Often, when applied in practice, the parameters of these models have to be estimated. The currently predominating identification methods,…

Machine Learning · Statistics 2015-07-24 Robert Mattila , Cristian R. Rojas , Bo Wahlberg

Low level images representation in feature space performs poorly for classification with high accuracy since this level of representation is not able to project images into the discriminative feature space. In this work, we propose an…

Computer Vision and Pattern Recognition · Computer Science 2016-10-06 Fariborz Taherkhani , Reza Hedayati

When learning a hidden Markov model (HMM), sequen- tial observations can often be complemented by real-valued summary response variables generated from the path of hid- den states. Such settings arise in numerous domains, includ- ing many…

Machine Learning · Statistics 2015-12-17 Yizhe Zhang , Ricardo Henao , Lawrence Carin , Jianling Zhong , Alexander J. Hartemink

Recently, there has been a surge of interest in using spectral methods for estimating latent variable models. However, it is usually assumed that the distribution of the observations conditioned on the latent variables is either discrete or…

Machine Learning · Statistics 2016-09-22 Kirthevasan Kandasamy , Maruan Al-Shedivat , Eric P. Xing

Hidden Markov Models (HMMs) are foundational tools for modeling sequential data with latent Markovian structure, yet fitting them to real-world data remains computationally challenging. In this work, we show that pre-trained large language…

Machine Learning · Computer Science 2026-04-27 Yijia Dai , Zhaolin Gao , Yahya Sattar , Sarah Dean , Jennifer J. Sun

In unsupervised classification, Hidden Markov Models (HMM) are used to account for a neighborhood structure between observations. The emission distributions are often supposed to belong to some parametric family. In this paper, a…

Machine Learning · Statistics 2012-06-25 Stevenn Volant , Caroline Bérard , Marie-Laure Martin-Magniette , Stéphane Robin

The proliferation of malware variants poses a significant challenges to traditional malware detection approaches, such as signature-based methods, necessitating the development of advanced machine learning techniques. In this research, we…

Machine Learning · Computer Science 2024-12-30 Ritik Mehta , Olha Jureckova , Mark Stamp

The hidden Markov model (HMM) is a fundamental tool for sequence modeling that cleanly separates the hidden state from the emission structure. However, this separation makes it difficult to fit HMMs to large datasets in modern NLP, and they…

Computation and Language · Computer Science 2020-11-10 Justin T. Chiu , Alexander M. Rush

The hidden Markov model (HMM) is a generative model that treats sequential data under the assumption that each observation is conditioned on the state of a discrete hidden variable that evolves in time as a Markov chain. In this paper, we…

Artificial Intelligence · Computer Science 2011-09-07 Emanuele Coviello , Antoni B. Chan , Gert R. G. Lanckriet
‹ Prev 1 2 3 10 Next ›