English
Related papers

Related papers: Compressed Inference for Probabilistic Sequential …

200 papers

The hidden Markov model (HMM) is a fundamental tool for sequence modeling that cleanly separates the hidden state from the emission structure. However, this separation makes it difficult to fit HMMs to large datasets in modern NLP, and they…

Computation and Language · Computer Science 2020-11-10 Justin T. Chiu , Alexander M. Rush

Hidden Markov Models (HMMs) are a ubiquitous tool to model time series data, and have been widely used in two main tasks of Automatic Music Transcription (AMT): note segmentation, i.e. identifying the played notes after a multi-pitch…

Machine Learning · Statistics 2017-04-13 D. Cazau , G. Nuel

Time series classification is one of the very popular machine learning tasks. In this paper, we explore the application of Hidden Markov Model (HMM) for time series classification. We distinguish between two modes of HMM application. The…

Machine Learning · Computer Science 2022-04-29 Jakub Michał Bilski , Agnieszka Jastrzębska

Hidden Markov Models (HMMs) are one of the most fundamental and widely used statistical tools for modeling discrete time series. In general, learning HMMs from data is computationally hard (under cryptographic assumptions), and…

Machine Learning · Computer Science 2012-07-10 Daniel Hsu , Sham M. Kakade , Tong Zhang

This work attempts to approximate a linear Gaussian system with a finite-state hidden Markov model (HMM), which is found useful in solving sophisticated event-based state estimation problems. An indirect modeling approach is developed,…

Systems and Control · Electrical Eng. & Systems 2020-07-10 Kaikai Zheng , Dawei Shi , Ling Shi

The Hidden Markov Model (HMM) can predict the future value of a time series based on its current and previous values, making it a powerful algorithm for handling various types of time series. Numerous studies have explored the improvement…

Machine Learning · Computer Science 2024-02-28 YeXin Huang

Hidden Markov models (HMMs) are popular models to identify a finite number of latent states from sequential data. However, fitting them to large data sets can be computationally demanding because most likelihood maximization techniques…

We introduce the Reduced-Rank Hidden Markov Model (RR-HMM), a generalization of HMMs that can model smooth state evolution as in Linear Dynamical Systems (LDSs) as well as non-log-concave predictive distributions as in…

Machine Learning · Computer Science 2009-12-23 Sajid M. Siddiqi , Byron Boots , Geoffrey J. Gordon

There is an interest to replace computed tomography (CT) images with magnetic resonance (MR) images for a number of diagnostic and therapeutic workflows. In this article, predicting CT images from a number of magnetic resonance imaging…

Applications · Statistics 2017-05-05 Kristi Kuljus , Fekadu L. Bayisa , David Bolin , Jüri Lember , Jun Yu

As deep neural networks continue to revolutionize various application domains, there is increasing interest in making these powerful models more understandable and interpretable, and narrowing down the causes of good and bad predictions. We…

Machine Learning · Statistics 2016-11-21 Viktoriya Krakovna , Finale Doshi-Velez

The ability to predict the intentions of people based solely on their visual actions is a skill only performed by humans and animals. The intelligence of current computer algorithms has not reached this level of complexity, but there are…

Artificial Intelligence · Computer Science 2011-02-07 Michael DelRose , Christian Wagner , Philip Frederick

Over the last decade, hidden Markov models (HMMs) have become increasingly popular in statistical ecology, where they constitute natural tools for studying animal behavior based on complex sensor data. Corresponding analyses sometimes…

Methodology · Statistics 2025-10-15 Jan-Ole Koslik , Carlina C. Feldmann , Sina Mews , Rouven Michels , Roland Langrock

We consider the task of learning mappings from sequential data to real-valued responses. We present and evaluate an approach to learning a type of hidden Markov model (HMM) for regression. The learning process involves inferring the…

Machine Learning · Computer Science 2012-06-18 Keith Noto , Mark Craven

Nowadays, neural network models achieve state-of-the-art results in many areas as computer vision or speech processing. For sequential data, especially for Natural Language Processing (NLP) tasks, Recurrent Neural Networks (RNNs) and their…

Computation and Language · Computer Science 2021-02-23 Elie Azeraf , Emmanuel Monfrini , Emmanuel Vignon , Wojciech Pieczynski

In textual information extraction and other sequence labeling tasks it is now common to use recurrent neural networks (such as LSTM) to form rich embedded representations of long-term input co-occurrence patterns. Representation of output…

Computation and Language · Computer Science 2017-08-03 Dung Thai , Shikhar Murty , Trapit Bansal , Luke Vilnis , David Belanger , Andrew McCallum

We consider penalized estimation in hidden Markov models (HMMs) with multivariate Normal observations. In the moderate-to-large dimensional setting, estimation for HMMs remains challenging in practice, due to several concerns arising from…

Methodology · Statistics 2014-01-09 Nicolas Städler , Sach Mukherjee

Hidden Quantum Markov Models (HQMMs) can be thought of as quantum probabilistic graphical models that can model sequential data. We extend previous work on HQMMs with three contributions: (1) we show how classical hidden Markov models…

Machine Learning · Statistics 2017-10-26 Siddarth Srinivasan , Geoff Gordon , Byron Boots

There is much interest in the Hierarchical Dirichlet Process Hidden Markov Model (HDP-HMM) as a natural Bayesian nonparametric extension of the ubiquitous Hidden Markov Model for learning from sequential and time-series data. However, in…

Methodology · Statistics 2012-09-11 Matthew J. Johnson , Alan S. Willsky

Sequential data modeling and analysis have become indispensable tools for analyzing sequential data, such as time-series data, because larger amounts of sensed event data have become available. These methods capture the sequential structure…

Artificial Intelligence · Computer Science 2019-02-15 Hiromi Narimatsu , Hiroyuki Kasai

Hidden Markov Models (HMMs) have become very popular as a computational tool for the analysis of sequential data. They are memoryless machines which transition from one internal state to another, while producing symbols. These symbols…

Quantum Physics · Physics 2012-10-01 Ben O`Neill , Tom M. Barlow , Dominik Safranek , Almut Beige