English
Related papers

Related papers: Exact and Approximate Hidden Markov Chain Filters …

200 papers

We propose a framework, named Aggregated Wasserstein, for computing a dissimilarity measure or distance between two Hidden Markov Models with state conditional distributions being Gaussian. For such HMMs, the marginal distribution at any…

Machine Learning · Computer Science 2016-08-08 Yukun Chen , Jianbo Ye , Jia Li

Information seeking process is an important topic in information seeking behavior research. Both qualitative and empirical methods have been adopted in analyzing information seeking processes, with major focus on uncovering the latent…

Information Retrieval · Computer Science 2013-04-09 Shuguang Han , Zhen Yue , Daqing He

We introduce the Reduced-Rank Hidden Markov Model (RR-HMM), a generalization of HMMs that can model smooth state evolution as in Linear Dynamical Systems (LDSs) as well as non-log-concave predictive distributions as in…

Machine Learning · Computer Science 2009-12-23 Sajid M. Siddiqi , Byron Boots , Geoffrey J. Gordon

Particle filters (PFs) are recursive Monte Carlo algorithms for Bayesian tracking and prediction in state space models. This paper addresses continuous-discrete filtering problems, where the hidden state evolves as an It\^o stochastic…

Computation · Statistics 2026-04-24 Utku Erdogan , Gabriel J. Lord , Joaquin Miguez

Herein, the Hidden Markov Model is expanded to allow for Markov chain observations. In particular, the observations are assumed to be a Markov chain whose one step transition probabilities depend upon the hidden Markov chain. An…

Machine Learning · Statistics 2023-04-18 Michael A. Kouritzin

Hidden Markov models (HMMs) and partially observable Markov decision processes (POMDPs) form a useful tool for modeling dynamical systems. They are particularly useful for representing environments such as road networks and office…

Artificial Intelligence · Computer Science 2013-01-30 Hagit Shatkay

In this note we introduce an estimate for the marginal likelihood associated to hidden Markov models (HMMs) using sequential Monte Carlo (SMC) approximations of the generalized two-filter smoothing decomposition (Briers, 2010). This…

Methodology · Statistics 2012-09-04 Adam Persing , Ajay Jasra

Hidden Markov Models (HMMs) are a ubiquitous tool to model time series data, and have been widely used in two main tasks of Automatic Music Transcription (AMT): note segmentation, i.e. identifying the played notes after a multi-pitch…

Machine Learning · Statistics 2017-04-13 D. Cazau , G. Nuel

A time-dependent finite-state Markov chain that uses doubly stochastic transition matrices, is considered. Entropic quantities that describe the randomness of the probability vectors, and also the randomness of the discrete paths, are…

Quantum Physics · Physics 2022-03-18 A. Vourdas

State space models have long played an important role in signal processing. The Gaussian case can be treated algorithmically using the famous Kalman filter. Similarly since the 1970s there has been extensive application of Hidden Markov…

Statistics Theory · Mathematics 2007-06-13 Peter Bickel , Yaacov Ritov , Tobias Rydén

This work proposes a multi-agent filtering algorithm over graphs for finite-state hidden Markov models (HMMs), which can be used for sequential state estimation or for tracking opinion formation over dynamic social networks. We show that…

Signal Processing · Electrical Eng. & Systems 2022-03-10 Mert Kayaalp , Virginia Bordignon , Stefan Vlaski , Ali H. Sayed

We investigate the local times of a continuous-time Markov chain on an arbitrary discrete state space. For fixed finite range of the Markov chain, we derive an explicit formula for the joint density of all local times on the range, at any…

Probability · Mathematics 2009-09-29 David Brydges , Remco van der Hofstad , Wolfgang König

As deep neural networks continue to revolutionize various application domains, there is increasing interest in making these powerful models more understandable and interpretable, and narrowing down the causes of good and bad predictions. We…

Machine Learning · Statistics 2016-11-21 Viktoriya Krakovna , Finale Doshi-Velez

Given a nonparametric Hidden Markov Model (HMM) with two states, the question of constructing efficient multiple testing procedures is considered, treating one of the states as an unknown null hypothesis. A procedure is introduced, based on…

Statistics Theory · Mathematics 2021-01-12 Kweku Abraham , Ismael Castillo , Elisabeth Gassiat

As one of Bayesian analysis tools, Hidden Markov Model (HMM) has been used to in extensive applications. Most HMMs are solved by Baum-Welch algorithm (BWHMM) to predict the model parameters, which is difficult to find global optimal…

Machine Learning · Statistics 2018-11-09 L. Chang , Yacine Ouzrout , Antoine Nongaillard , Abdelaziz Bouras

Over the last decade, hidden Markov models (HMMs) have become increasingly popular in statistical ecology, where they constitute natural tools for studying animal behavior based on complex sensor data. Corresponding analyses sometimes…

Methodology · Statistics 2025-10-15 Jan-Ole Koslik , Carlina C. Feldmann , Sina Mews , Rouven Michels , Roland Langrock

The detection of change-points in heterogeneous sequences is a statistical challenge with many applications in fields such as finance, signal analysis and biology. A wide variety of literature exists for finding an ideal set of…

Applications · Statistics 2012-12-11 The Minh Luong , Vittorio Perduca , Gregory Nuel

Hidden Markov models (HMMs) have been extensively used in the univariate and multivariate literature. However, there has been an increased interest in the analysis of matrix-variate data over the recent years. In this manuscript we…

Methodology · Statistics 2021-07-16 Salvatore D. Tomarchio , Antonio Punzo , Antonello Maruotti

Particle Marginal Metropolis-Hastings (PMMH) is a general approach to Bayesian inference when the likelihood is intractable, but can be estimated unbiasedly. Our article develops an efficient PMMH method that scales up better to higher…

Computation · Statistics 2023-05-10 David Gunawan , Pratiti Chatterjee , Robert Kohn

An intrinsic problem of classifiers based on machine learning (ML) methods is that their learning time grows as the size and complexity of the training dataset increases. For this reason, it is important to have efficient computational…

Machine Learning · Computer Science 2013-04-16 Khadoudja Ghanem