English
Related papers

Related papers: Exactly Optimal Bayesian Quickest Change Detection…

200 papers

Infinite Hidden Markov Models (iHMM's) are an attractive, nonparametric generalization of the classical Hidden Markov Model which can automatically infer the number of hidden states in the system. However, due to the infinite-dimensional…

Machine Learning · Statistics 2015-06-10 Nilesh Tripuraneni , Shane Gu , Hong Ge , Zoubin Ghahramani

Many real-world decision making tasks require us to choose among several expensive observations. In a sensor network, for example, it is important to select the subset of sensors that is expected to provide the strongest reduction in…

Artificial Intelligence · Computer Science 2014-01-16 Andreas Krause , Carlos Guestrin

Traditional hidden Markov models have been a useful tool to understand and model stochastic dynamic data; in the case of non-Gaussian data, models such as mixture of Gaussian hidden Markov models can be used. However, these suffer from the…

Machine Learning · Statistics 2023-05-16 Carlos Puerto-Santana , Concha Bielza , Pedro Larrañaga , Gustav Eje Henter

We derive a robust update rule for the online infinite hidden Markov model (iHMM) for when the streaming data contains outliers and the model is misspecified. Leveraging recent advances in generalised Bayesian inference, we define…

Machine Learning · Statistics 2026-05-13 Horace Yiu , Leandro Sánchez-Betancourt , Álvaro Cartea , Gerardo Duran-Martin

Hidden Markov Models (HMMs) are foundational tools for modeling sequential data with latent Markovian structure, yet fitting them to real-world data remains computationally challenging. In this work, we show that pre-trained large language…

Machine Learning · Computer Science 2026-04-27 Yijia Dai , Zhaolin Gao , Yahya Sattar , Sarah Dean , Jennifer J. Sun

Mixtures of Hidden Markov Models (MHMMs) are frequently used for clustering of sequential data. An important aspect of MHMMs, as of any clustering approach, is that they can be interpretable, allowing for novel insights to be gained from…

Artificial Intelligence · Computer Science 2021-03-24 Negar Safinianaini , Henrik Boström

The classical problem of quickest change detection is studied with an additional constraint on the cost of observations used in the detection process. The change point is modeled as an unknown constant, and minimax formulations are proposed…

Statistics Theory · Mathematics 2012-11-19 Taposh Banerjee , Venugopal V. Veeravalli

Momentum is a popular technique for improving convergence rates during gradient descent. In this research, we experiment with adding momentum to the Baum-Welch expectation-maximization algorithm for training Hidden Markov Models. We compare…

Machine Learning · Computer Science 2022-06-10 Andrew Miller , Fabio Di Troia , Mark Stamp

Hidden Markov models (HMMs) are probabilistic methods in which observations are seen as realizations of a latent Markov process with discrete states that switch over time. Moving beyond standard statistical tests, HMMs offer a statistical…

Methodology · Statistics 2024-03-20 S. Mildiner Moraga , E. Aarts

Information seeking process is an important topic in information seeking behavior research. Both qualitative and empirical methods have been adopted in analyzing information seeking processes, with major focus on uncovering the latent…

Information Retrieval · Computer Science 2013-04-09 Shuguang Han , Zhen Yue , Daqing He

The problem of quickest change detection (QCD) in autoregressive (AR) models is investigated. A system is being monitored with sequentially observed samples. At some unknown time, a disturbance signal occurs and changes the distribution of…

Signal Processing · Electrical Eng. & Systems 2023-10-16 Zhongchang Sun , Shaofeng Zou

We consider the problem of estimating the number of hidden states (the order) of a nonparametric hidden Markov model (HMM). We propose two different methods and prove their almost sure consistency without any prior assumption, be it on the…

Statistics Theory · Mathematics 2017-05-19 Luc Lehéricy

To analyze whole-genome genetic data inherited in families, the likelihood is typically obtained from a Hidden Markov Model (HMM) having a state space of 2^n hidden states where n is the number of meioses or edges in the pedigree. There…

Probability · Mathematics 2013-10-07 Bonnie Kirkpatrick , Kay Kirkpatrick

Industrial processes generate a massive amount of monitoring data that can be exploited to uncover hidden time losses in the system. This can be used to enhance the accuracy of maintenance policies and increase the effectiveness of the…

Applications · Statistics 2025-08-27 Fernando Miguelez , Josu Doncel , Maria Dolores Ugarte

In this article we suggest a new statistical approach considering survival heterogeneity as a breakpoint model in an ordered sequence of time to event variables. The survival responses need to be ordered according to a numerical covariate.…

Applications · Statistics 2016-09-26 Olivier Bouaziz , Grégory Nuel

Nature, as far as we know, evolves continuously through space and time. Yet the ubiquitous hidden Markov model (HMM)--originally developed for discrete time and space analysis in natural language processing--remains a central tool in…

Biomolecules · Quantitative Biology 2025-06-09 Max Schweiger , Ayush Saurabh , Steve Pressé

Hyperspectral images can be represented either as a set of images or as a set of spectra. Spectral classification and segmentation and data reduction are the main problems in hyperspectral image analysis. In this paper we propose a Bayesian…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Ali Mohammad-Djafari , Adel Mohammadpoor , Nadia Bali

Hidden Markov models (HMMs) are one of the most widely used statistical methods for analyzing sequence data. However, the reporting of output from HMMs has largely been restricted to the presentation of the most-probable (MAP) hidden state…

Methodology · Statistics 2015-05-01 Michalis K. Titsias , Christopher Yau , Christopher C. Holmes

The hidden Markov model (HMM) is a widely-used generative model that copes with sequential data, assuming that each observation is conditioned on the state of a hidden Markov chain. In this paper, we derive a novel algorithm to cluster HMMs…

Machine Learning · Computer Science 2012-10-26 Emanuele Coviello , Antoni B. Chan , Gert R. G. Lanckriet

Hidden Markov Model (HMM) is often regarded as the dynamical model of choice in many fields and applications. It is also at the heart of most state-of-the-art speech recognition systems since the 70's. However, from Gaussian mixture models…

Computation and Language · Computer Science 2016-07-04 Sébastien Gagnon , Jean Rouat