English
Related papers

Related papers: Reduced-Rank Hidden Markov Models

200 papers

The minimum realization problem of hidden Markov models (HMM's) is a fundamental question of stationary discrete-time processes with a finite alphabet. It was shown in the literature that tensor decomposition methods give the hidden Markov…

Optimization and Control · Mathematics 2020-08-27 Yoshito Ohta

Hidden Markov models (HMMs) and partially observable Markov decision processes (POMDPs) provide useful tools for modeling dynamical systems. They are particularly useful for representing the topology of environments such as road networks…

Artificial Intelligence · Computer Science 2011-06-06 L. P. Kaelbling , H. Shatkay

In this article, we use the theory of quantum channels and open quantum systems to provide an efficient unitary characterization of a class of stochastic generators known as quantum hidden Markov models (QHMMs). By utilizing the unitary…

Quantum Physics · Physics 2025-02-27 Vanio Markov , Vladimir Rastunkov , Amol Deshmukh , Daniel Fry , Charlee Stefanski

Lane determination and lane sequence determination are important components for many Connected and Automated Vehicle (CAV) applications. Lane determination has been solved using Hidden Markov Model (HMM) among other methods. The existing…

Robotics · Computer Science 2025-05-13 Mike Stas , Wang Hu , Jay A. Farrell

Industrial processes generate a massive amount of monitoring data that can be exploited to uncover hidden time losses in the system. This can be used to enhance the accuracy of maintenance policies and increase the effectiveness of the…

Applications · Statistics 2025-08-27 Fernando Miguelez , Josu Doncel , Maria Dolores Ugarte

Support matrix machine (SMM) is an emerging classification framework that directly handles matrix-structured observations, thereby avoiding the spatial correlations destroyed by vectorization. However, most existing SMM variants rely on…

Machine Learning · Computer Science 2026-03-03 Xianchao Xiu , Shenghao Sun , Xinrong Li , Jiyuan Tao

The Hidden Markov Model (HMM) is one of the mainstays of statistical modeling of discrete time series, with applications including speech recognition, computational biology, computer vision and econometrics. Estimating an HMM from its…

Machine Learning · Statistics 2015-12-29 Fanny Yang , Sivaraman Balakrishnan , Martin J. Wainwright

We develop a predictive-first optimisation framework for streaming hidden Markov models. Unlike classical approaches that prioritise full posterior recovery under a fully specified generative model, we assume access to regime-specific…

Machine Learning · Statistics 2026-04-13 Gerardo Duran-Martin

Social learning strategies enable agents to infer the underlying true state of nature in a distributed manner by receiving private environmental signals and exchanging beliefs with their neighbors. Previous studies have extensively focused…

Multiagent Systems · Computer Science 2025-03-18 Dongyan Sui , Haitian Zheng , Siyang Leng , Stefan Vlaski

Hidden Markov Models (HMMs) are learning methods for pattern recognition. The probabilistic HMMs have been one of the most used techniques based on the Bayesian model. First-order probabilistic HMMs were adapted to the theory of belief…

Artificial Intelligence · Computer Science 2015-01-23 Jungyeul Park , Mouna Chebbah , Siwar Jendoubi , Arnaud Martin

We present a model-based approach to learning robust runtime monitors for autonomous systems. Runtime monitors play a crucial role in raising the level of assurance by observing system behavior and predicting potential safety violations. In…

Logic in Computer Science · Computer Science 2026-02-17 Antonina Skurka , Luko van der Maas , Sebastian Junges , Hazem Torfah

In this paper, we propose an algorithm for estimating the parameters of a time-homogeneous hidden Markov model from aggregate observations. This problem arises when only the population level counts of the number of individuals at each time…

Machine Learning · Computer Science 2021-11-16 Rahul Singh , Qinsheng Zhang , Yongxin Chen

Labeling of sequential data is a prevalent meta-problem for a wide range of real world applications. While the first-order Hidden Markov Models (HMM) provides a fundamental approach for unsupervised sequential labeling, the basic model does…

Machine Learning · Computer Science 2019-04-08 Maoying Qiao , Wei Bian , Richard Yida Xu , Dacheng Tao

Consider the problem of predicting the next symbol given a sample path of length n, whose joint distribution belongs to a distribution class that may have long-term memory. The goal is to compete with the conditional predictor that knows…

Statistics Theory · Mathematics 2024-04-25 Yanjun Han , Tianze Jiang , Yihong Wu

Hidden Markov Models (HMMs) have become very popular as a computational tool for the analysis of sequential data. They are memoryless machines which transition from one internal state to another, while producing symbols. These symbols…

Quantum Physics · Physics 2012-10-01 Ben O`Neill , Tom M. Barlow , Dominik Safranek , Almut Beige

We aim at the construction of a Hidden Markov Model (HMM) of assigned complexity (number of states of the underlying Markov chain) which best approximates, in Kullback-Leibler divergence rate, a given stationary process. We establish, under…

Optimization and Control · Mathematics 2014-07-03 Lorenzo Finesso , Angela Grassi , Peter Spreij

Dynamic modeling of longitudinal networks has been an increasingly important topic in applied research. While longitudinal network data commonly exhibit dramatic changes in its structures, existing methods have largely focused on modeling…

Methodology · Statistics 2018-11-06 Jong Hee Park , Yunkyu Sohn

The ability to predict the intentions of people based solely on their visual actions is a skill only performed by humans and animals. The intelligence of current computer algorithms has not reached this level of complexity, but there are…

Artificial Intelligence · Computer Science 2011-02-07 Michael DelRose , Christian Wagner , Philip Frederick

The technological applications of hidden Markov models have been extremely diverse and successful, including natural language processing, gesture recognition, gene sequencing, and Kalman filtering of physical measurements. HMMs are highly…

Algebraic Geometry · Mathematics 2012-09-04 Andrew J. Critch

We show how models for prediction with expert advice can be defined concisely and clearly using hidden Markov models (HMMs); standard HMM algorithms can then be used to efficiently calculate, among other things, how the expert predictions…

Machine Learning · Computer Science 2008-02-15 Wouter Koolen , Steven de Rooij