English
Related papers

Related papers: Online EM Algorithm for Hidden Markov Models

200 papers

Hidden Quantum Markov Models (HQMMs) can be thought of as quantum probabilistic graphical models that can model sequential data. We extend previous work on HQMMs with three contributions: (1) we show how classical hidden Markov models…

Machine Learning · Statistics 2017-10-26 Siddarth Srinivasan , Geoff Gordon , Byron Boots

Scripts have been proposed to model the stereotypical event sequences found in narratives. They can be applied to make a variety of inferences including filling gaps in the narratives and resolving ambiguous references. This paper proposes…

Computation and Language · Computer Science 2018-09-12 J. Walker Orr , Prasad Tadepalli , Janardhan Rao Doppa , Xiaoli Fern , Thomas G. Dietterich

This paper studies online algorithms augmented with multiple machine-learned predictions. While online algorithms augmented with a single prediction have been extensively studied in recent years, the literature for the multiple predictions…

Machine Learning · Computer Science 2022-07-14 Keerti Anand , Rong Ge , Amit Kumar , Debmalya Panigrahi

Hidden Markov Models (HMM) model a sequence of observations that are dependent on a hidden (or latent) state that follow a Markov chain. These models are widely used in diverse fields including ecology, speech recognition, and…

Optimization and Control · Mathematics 2024-09-05 Sidonie Foulon , Thérèse Truong , Anne-Louise Leutenegger , Hervé Perdry

We show how models for prediction with expert advice can be defined concisely and clearly using hidden Markov models (HMMs); standard HMM algorithms can then be used to efficiently calculate, among other things, how the expert predictions…

Machine Learning · Computer Science 2008-02-15 Wouter Koolen , Steven de Rooij

In this paper we derive the consistency of the penalized likelihood method for the number state of the hidden Markov chain in autoregressive models with Markov regimen. Using a SAEM type algorithm to estimate the models parameters. We test…

Statistics Theory · Mathematics 2016-08-16 Ricardo Ríos , Luis Rodríguez

This paper explores innovations to parameter estimation in generalized linear and nonlinear models, which may be used in item response modeling to account for guessing/pretending or slipping/dissimulation and for the effect of covariates.…

Methodology · Statistics 2025-07-03 Adéla Hladká , Patrícia Martinková , Marek Brabec

Extreme Learning Machine (ELM) is an emerging learning paradigm for nonlinear regression problems and has shown its effectiveness in the machine learning community. An important feature of ELM is that the learning speed is extremely fast…

Systems and Control · Computer Science 2012-11-08 Vijay Manikandan Janakiraman , Dennis Assanis

Expectation maximization (EM) is a technique for estimating maximum-likelihood parameters of a latent variable model given observed data by alternating between taking expectations of sufficient statistics, and maximizing the expected log…

Methodology · Statistics 2018-07-10 Donna Henderson , Gerton Lunter

We propose an online algorithm for tracking a multidimensional time-varying parameter of a time series, which is also allowed to be a predictable process with respect to the underlying time series. The algorithm is driven by a gain…

Statistics Theory · Mathematics 2013-11-15 Eduard Belitser , Paulo Serra

Learning-augmented algorithms have received significant attention in recent years, particularly in the context of online optimization. Motivated by the high computational cost of generating predictions, a growing line of work studies the…

Data Structures and Algorithms · Computer Science 2026-05-27 Yongho Shin , Phanu Vajanopath

In this paper, we consider a recursive estimation problem for linear regression where the signal to be estimated admits a sparse representation and measurement samples are only sequentially available. We propose a convergent parallel…

Optimization and Control · Mathematics 2017-12-12 Yang Yang , Mengyi Zhang , Marius Pesavento , Daniel P. Palomar

A regularized vector autoregressive hidden semi-Markov model is developed to analyze multivariate financial time series with switching data generating regimes. Furthermore, an augmented EM algorithm is proposed for parameter estimation by…

Applications · Statistics 2021-05-19 Zekun Xu , Ye Liu

This paper presents algorithms for parallelization of inference in hidden Markov models (HMMs). In particular, we propose parallel backward-forward type of filtering and smoothing algorithm as well as parallel Viterbi-type…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-09-07 Sakira Hassan , Simo Särkkä , Ángel F. García-Fernández

Expectation-Maximization (EM) algorithm is a widely used iterative algorithm for computing maximum likelihood estimate when dealing with Gaussian Mixture Model (GMM). When the sample size is smaller than the data dimension, this could lead…

Machine Learning · Statistics 2023-07-06 Pierre Houdouin , Matthieu Jonkcheere , Frederic Pascal

The performance of ensemble-based data assimilation techniques that estimate the state of a dynamical system from partial observations depends crucially on the prescribed uncertainty of the model dynamics and of the observations. These are…

Computation · Statistics 2021-02-24 Tadeo Javier Cocucci , Manuel Pulido , Magdalena Lucini , Pierre Tandeo

The hidden Markov model (HMM) provides a powerful framework for inference in time-varying environments, where the underlying state evolves according to a Markov chain. To address the optimal filtering problem in general dynamic settings, we…

Systems and Control · Electrical Eng. & Systems 2025-06-10 Dongyan Sui , Haotian Pu , Siyang Leng , Stefan Vlaski

Situations in which recommender systems are used to augument decision making are becoming prevalent in many application domains. Almost always, these prediction tools (recommenders) are created with a view to affecting behavioural change.…

Optimization and Control · Mathematics 2020-11-11 Jonathan P. Epperlein , Robert Shorten , Sergiy Zhuk

Hidden Markov models have successfully been applied as models of discrete time series in many fields. Often, when applied in practice, the parameters of these models have to be estimated. The currently predominating identification methods,…

Machine Learning · Statistics 2015-07-24 Robert Mattila , Cristian R. Rojas , Bo Wahlberg

For constrained linear systems with bounded disturbances and parametric uncertainty, we propose a robust adaptive model predictive control strategy with online parameter estimation. Constraints enforcing persistently exciting closed loop…

Optimization and Control · Mathematics 2023-03-08 Xiaonan Lu , Mark Cannon