English
Related papers

Related papers: Temporal Parallelization of Inference in Hidden Ma…

200 papers

In this paper, we present a novel algorithm for the maximum a posteriori decoding (MAPD) of time-homogeneous Hidden Markov Models (HMM), improving the worst-case running time of the classical Viterbi algorithm by a logarithmic factor. In…

Machine Learning · Computer Science 2015-12-14 Massimo Cairo , Gabriele Farina , Romeo Rizzi

Hidden Markov models (HMMs) are one of the most widely used statistical methods for analyzing sequence data. However, the reporting of output from HMMs has largely been restricted to the presentation of the most-probable (MAP) hidden state…

Methodology · Statistics 2015-05-01 Michalis K. Titsias , Christopher Yau , Christopher C. Holmes

We consider active maximum a posteriori (MAP) inference problem for Hidden Markov Models (HMM), where, given an initial MAP estimate of the hidden sequence, we select to label certain states in the sequence to improve the estimation…

Machine Learning · Statistics 2015-09-02 Armen E. Allahverdyan , Aram Galstyan

We consider a class of filtering problems for large populations where each individual is modeled by the same hidden Markov model (HMM). In this paper, we focus on aggregate inference problems in HMMs with discrete state space and continuous…

Machine Learning · Statistics 2020-11-09 Qinsheng Zhang , Rahul Singh , Yongxin Chen

Hidden semi-Markov models (HSMMs) are latent variable models which allow latent state persistence and can be viewed as a generalization of the popular hidden Markov models (HMMs). In this paper, we introduce a novel spectral algorithm to…

Machine Learning · Statistics 2016-03-01 Igor Melnyk , Arindam Banerjee

Hidden semi-Markov Models (HSMM's) - while broadly in use - are restricted to a discrete and uniform time grid. They are thus not well suited to explain often irregularly spaced discrete event data from continuous-time phenomena. We show…

Machine Learning · Statistics 2022-10-18 Nicolai Engelmann , Heinz Koeppl

This paper proposes a parallel-in-time method for computing continuous-time maximum-a-posteriori (MAP) trajectory estimates of the states of partially observed stochastic differential equations (SDEs), with the goal of improving…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-16 Hassan Razavi , Ángel F. García-Fernández , Simo Särkkä

Motivated by the unceasing interest in hidden Markov models (HMMs), this paper re-examines hidden path inference in these models, using primarily a risk-based framework. While the most common maximum a posteriori (MAP), or Viterbi, path…

Machine Learning · Statistics 2013-04-17 Jüri Lember , Alexey A. Koloydenko

The marginal maximum a posteriori probability (MAP) estimation problem, which calculates the mode of the marginal posterior distribution of a subset of variables with the remaining variables marginalized, is an important inference problem…

Machine Learning · Statistics 2013-07-19 Qiang Liu , Alexander Ihler

The study of animal behavioural states inferred through hidden Markov models and similar state switching models has seen a significant increase in popularity in recent years. The ability to account for varying levels of behavioural scale…

Computation · Statistics 2021-05-06 Giada Sacchi , Ben Swallow

Background: Hidden Markov models (HMM) are powerful machine learning tools successfully applied to problems of computational Molecular Biology. In a predictive task, the HMM is endowed with a decoding algorithm in order to assign the most…

Biomolecules · Quantitative Biology 2007-05-23 Piero Fariselli , Pier Luigi Martelli , Rita Casadio

The objective of this article is to study the asymptotic behavior of a new particle filtering approach in the context of hidden Markov models (HMMs). In particular, we develop an algorithm where the latent-state sequence is segmented into…

Statistics Theory · Mathematics 2014-09-16 Hock Peng Chan , Chiang Wee Heng , Ajay Jasra

Current inference systems for Mixture-of-Experts (MoE) models primarily employ static parallelization strategies. However, these static approaches cannot consistently achieve optimal performance across different inference scenarios, as they…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-28 Haoran Lin , Xianzhi Yu , Kang Zhao , Han Bao , Zongyuan Zhan , Ting Hu , Wulong Liu , Zekun Yin , Xin Li , Weiguo Liu

The article studies different methods for estimating the Viterbi path in the Bayesian framework. The Viterbi path is an estimate of the underlying state path in hidden Markov models (HMMs), which has a maximum posterior probability (MAP).…

Computation · Statistics 2019-05-14 Jüri Lember , Dario Gasbarra , Alexey Koloydenko , Kristi Kuljus

We propose HAMSI (Hessian Approximated Multiple Subsets Iteration), which is a provably convergent, second order incremental algorithm for solving large-scale partially separable optimization problems. The algorithm is based on a local…

Since the early days of digital communication, hidden Markov models (HMMs) have now been also routinely used in speech recognition, processing of natural languages, images, and in bioinformatics. In an HMM $(X_i,Y_i)_{i\ge 1}$, observations…

Statistics Theory · Mathematics 2012-07-24 J. Lember , A. Koloydenko

We present a polyphonic MIDI score-following algorithm capable of following performances with arbitrary repeats and skips, based on a probabilistic model of musical performances. It is attractive in practical applications of score following…

Artificial Intelligence · Computer Science 2014-07-08 Eita Nakamura , Tomohiko Nakamura , Yasuyuki Saito , Nobutaka Ono , Shigeki Sagayama

We consider the problem of estimating the maximum posterior probability (MAP) state sequence for a finite state and finite emission alphabet hidden Markov model (HMM) in the Bayesian setup, where both emission and transition matrices have…

Machine Learning · Statistics 2020-04-20 Alexey Koloydenko , Kristi Kuljus , Jüri Lember

The performance of Maximum a posteriori (MAP) estimation is studied analytically for binary symmetric multi-channel Hidden Markov processes. We reduce the estimation problem to a 1D Ising spin model and define order parameters that…

Statistical Mechanics · Physics 2015-06-11 Avik Halder , Ansuman Adhikary

Online (also called "recursive" or "adaptive") estimation of fixed model parameters in hidden Markov models is a topic of much interest in times series modelling. In this work, we propose an online parameter estimation algorithm that…

Computation · Statistics 2011-02-16 Olivier Cappé
‹ Prev 1 2 3 10 Next ›