English
Related papers

Related papers: Scaling Hidden Markov Language Models

200 papers

As deep neural networks continue to revolutionize various application domains, there is increasing interest in making these powerful models more understandable and interpretable, and narrowing down the causes of good and bad predictions. We…

Machine Learning · Statistics 2016-10-04 Viktoriya Krakovna , Finale Doshi-Velez

Hidden Markov Models (HMMs) are foundational tools for modeling sequential data with latent Markovian structure, yet fitting them to real-world data remains computationally challenging. In this work, we show that pre-trained large language…

Machine Learning · Computer Science 2026-04-27 Yijia Dai , Zhaolin Gao , Yahya Sattar , Sarah Dean , Jennifer J. Sun

As deep neural networks continue to revolutionize various application domains, there is increasing interest in making these powerful models more understandable and interpretable, and narrowing down the causes of good and bad predictions. We…

Machine Learning · Statistics 2016-11-21 Viktoriya Krakovna , Finale Doshi-Velez

Language models based on deep neural networks and traditional stochastic modelling have become both highly functional and effective in recent times. In this work, a general survey into the two types of language modelling is conducted. We…

Machine Learning · Computer Science 2021-03-02 Larkin Liu , Yu-Chung Lin , Joshua Reid

State Space Models (SSMs) and Hidden Markov Models (HMMs) are foundational frameworks for modeling sequential data with latent variables and are widely used in signal processing, control theory, and machine learning. Despite their shared…

Machine Learning · Computer Science 2026-01-21 Aydin Ghojogh , M. Hadi Sepanj , Benyamin Ghojogh

Hidden Markov Model (HMM) is often regarded as the dynamical model of choice in many fields and applications. It is also at the heart of most state-of-the-art speech recognition systems since the 70's. However, from Gaussian mixture models…

Computation and Language · Computer Science 2016-07-04 Sébastien Gagnon , Jean Rouat

Hidden Markov Models (HMMs) are one of the most fundamental and widely used statistical tools for modeling discrete time series. In general, learning HMMs from data is computationally hard (under cryptographic assumptions), and…

Machine Learning · Computer Science 2012-07-10 Daniel Hsu , Sham M. Kakade , Tong Zhang

Hidden Markov models (HMMs) are ubiquitous in time-series modelling, with applications ranging from chemical reaction modelling to speech recognition. These HMMs are often large, with high-dimensional memories. A recently-proposed…

Quantum Physics · Physics 2026-01-23 Rishi Sundar , Thomas Elliott

Hidden Markov models (HMMs) are probabilistic functions of finite Markov chains, or, put in other words, state space models with finite state space. In this paper, we examine subspace estimation methods for HMMs whose output lies a finite…

Statistics Theory · Mathematics 2009-11-20 Sofia Andersson , Tobias Rydén

Hidden Quantum Markov Models (HQMMs) can be thought of as quantum probabilistic graphical models that can model sequential data. We extend previous work on HQMMs with three contributions: (1) we show how classical hidden Markov models…

Machine Learning · Statistics 2017-10-26 Siddarth Srinivasan , Geoff Gordon , Byron Boots

Nature, as far as we know, evolves continuously through space and time. Yet the ubiquitous hidden Markov model (HMM)--originally developed for discrete time and space analysis in natural language processing--remains a central tool in…

Biomolecules · Quantitative Biology 2025-06-09 Max Schweiger , Ayush Saurabh , Steve Pressé

Hidden semi-Markov models (HSMMs) are latent variable models which allow latent state persistence and can be viewed as a generalization of the popular hidden Markov models (HMMs). In this paper, we introduce a novel spectral algorithm to…

Machine Learning · Statistics 2016-03-01 Igor Melnyk , Arindam Banerjee

We demonstrate the application of pattern recognition algorithms via hidden Markov models (HMM) for qubit readout. This scheme provides a state-path trajectory approach capable of detecting qubit state transitions and makes for a robust…

Quantum Physics · Physics 2021-01-04 Luis A. Martinez , Yaniv J. Rosen , Jonathan L. DuBois

The hidden Markov model (HMM) provides a powerful framework for inference in time-varying environments, where the underlying state evolves according to a Markov chain. To address the optimal filtering problem in general dynamic settings, we…

Systems and Control · Electrical Eng. & Systems 2025-06-10 Dongyan Sui , Haotian Pu , Siyang Leng , Stefan Vlaski

Factorial Hidden Markov Models (FHMMs) are powerful models for sequential data but they do not scale well with long sequences. We propose a scalable inference and learning algorithm for FHMMs that draws on ideas from the stochastic…

Machine Learning · Statistics 2016-10-31 Yin Cheng Ng , Pawel Chilinski , Ricardo Silva

Large Language Models (LLMs) based on the pre-trained fine-tuning paradigm have become pivotal in solving natural language processing tasks, consistently achieving state-of-the-art performance. Nevertheless, the theoretical understanding of…

Machine Learning · Computer Science 2024-10-02 Jing Luo , Huiyuan Wang , Weiran Huang

Hidden Markov Model (HMM) combined with Gaussian Process (GP) emission can be effectively used to estimate the hidden state with a sequence of complex input-output relational observations. Especially when the spectral mixture (SM) kernel is…

Machine Learning · Computer Science 2020-01-08 Yohan Jung , Jinkyoo Park

Hidden Markov models (HMMs) and their extensions have proven to be powerful tools for classification of observations that stem from systems with temporal dependence as they take into account that observations close in time are likely…

Applications · Statistics 2021-11-22 Sofia Ruiz-Suarez , Vianey Leos-Barajas , Juan Manuel Morales

Hidden Markov models (HMMs) are commonly used for disease progression modeling when the true patient health state is not fully known. Since HMMs typically have multiple local optima, incorporating additional patient covariates can improve…

Machine Learning · Statistics 2021-10-05 Matt Baucum , Anahita Khojandi , Theodore Papamarkou

This work attempts to approximate a linear Gaussian system with a finite-state hidden Markov model (HMM), which is found useful in solving sophisticated event-based state estimation problems. An indirect modeling approach is developed,…

Systems and Control · Electrical Eng. & Systems 2020-07-10 Kaikai Zheng , Dawei Shi , Ling Shi
‹ Prev 1 2 3 10 Next ›