English
Related papers

Related papers: Exponential forgetting of smoothing distributions …

200 papers

Analysis of multivariate healthcare time series data is inherently challenging: irregular sampling, noisy and missing values, and heterogeneous patient groups with different dynamics violating exchangeability. In addition, interpretability…

Machine Learning · Computer Science 2023-11-15 Onur Poyraz , Pekka Marttinen

The hidden Markov model (HMM) is a classic modeling tool with a wide swath of applications. Its inception considered observations restricted to a finite alphabet, but it was quickly extended to multivariate continuous distributions. In this…

Methodology · Statistics 2022-05-30 Adam B Kashlak , Prachi Loliencar , Giseon Heo

We propose a Bayesian nonparametric mixture model for prediction- and information extraction tasks with an efficient inference scheme. It models categorical-valued time series that exhibit dynamics from multiple underlying patterns (e.g.…

Machine Learning · Statistics 2017-06-21 Jan Reubold , Thorsten Strufe , Ulf Brefeld

We show how models for prediction with expert advice can be defined concisely and clearly using hidden Markov models (HMMs); standard HMM algorithms can then be used to efficiently calculate, among other things, how the expert predictions…

Machine Learning · Computer Science 2008-02-15 Wouter Koolen , Steven de Rooij

When statistical analyses consider multiple data sources, Markov melding provides a method for combining the source-specific Bayesian models. Markov melding joins together submodels that have a common quantity. One challenge is that the…

Methodology · Statistics 2022-03-17 Andrew A. Manderson , Robert J. B. Goudie

In this note, we propose a new approach for the proof of the consistency and normality of the maximum likelihood estimator for nonlinear AR processes with markov-switching under the assumptions of uniform exponential forgetting of the…

Statistics Theory · Mathematics 2016-06-01 Luis-Angel Rodríguez

We study a class of stochastic models of mass transport on discrete vertex set $V$. For these models, a one-parameter family of homogeneous product measures $\otimes_{i\in V} \nu_\theta$ is reversible. We prove that the set of mixtures of…

Probability · Mathematics 2024-06-04 Cristian Giardinà , Frank Redig , Berend van Tol

For a wide class of continuous-time Markov processes, including all irreducible hypoelliptic diffusions evolving on an open, connected subset of $\RL^d$, the following are shown to be equivalent: (i) The process satisfies (a slightly weaker…

Probability · Mathematics 2016-04-27 Ioannis Kontoyiannis , Sean P. Meyn

We develop a predictive-first optimisation framework for streaming hidden Markov models. Unlike classical approaches that prioritise full posterior recovery under a fully specified generative model, we assume access to regime-specific…

Machine Learning · Statistics 2026-04-13 Gerardo Duran-Martin

This paper studies the robustness of quasi-maximum-likelihood (QML) estimation in hidden Markov models (HMMs) when the regime-switching structure is misspecified. Specifically, we examine the case where the true data-generating process…

Econometrics · Economics 2026-01-14 Demian Pouzo , Martin Sola , Zacharias Psaradakis

Consider a discrete time Markov chain with rather general state space which has an invariant probability measure $\mu$. There are several sufficient conditions in the literature which guarantee convergence of all or $\mu$-almost all…

Probability · Mathematics 2025-08-29 Michael Scheutzow , Juni Schindler

Hidden semi-Markov models (HSMMs) are latent variable models which allow latent state persistence and can be viewed as a generalization of the popular hidden Markov models (HMMs). In this paper, we introduce a novel spectral algorithm to…

Machine Learning · Statistics 2016-03-01 Igor Melnyk , Arindam Banerjee

Consider a compact metric space $S$ and a pair $(j,k)$ with $k \ge 2$ and $1 \le j \le k$. For any probability distribution $\theta \in P(S)$, define a Markov chain on $S$ by: from state $s$, take $k$ i.i.d. ($\theta$) samples, and jump to…

Probability · Mathematics 2024-04-03 David J. Aldous , Shi Feng

Consider a compact metric space $S$ and a pair $(j,k)$ with $k \ge 2$ and $1 \le j \le k$. For any probability distribution $\theta \in P(S)$, define a Markov chain on $S$ by: from state $s$, take $k$ i.i.d. ($\theta$) samples, and jump to…

Probability · Mathematics 2024-03-28 David J. Aldous , Madelyn Cruz , Shi Feng

A prevalent problem in general state-space models is the approximation of the smoothing distribution of a state, or a sequence of states, conditional on the observations from the past, the present, and the future. The aim of this paper is…

Statistics Theory · Mathematics 2009-04-03 Randal Douc , Aurelien Garivier , Eric Moulines , Jimmy Olsson

The Hidden Markov Model (HMM) is one of the mainstays of statistical modeling of discrete time series, with applications including speech recognition, computational biology, computer vision and econometrics. Estimating an HMM from its…

Machine Learning · Statistics 2015-12-29 Fanny Yang , Sivaraman Balakrishnan , Martin J. Wainwright

This paper presents a method for calculating the smoothed state distribution for Jump Markov Linear Systems. More specifically, the paper details a novel two-filter smoother that provides closed-form expressions for the smoothed hybrid…

Methodology · Statistics 2020-04-21 Mark P. Balenzuela , Adrian G. Wills , Christopher Renton , Brett Ninness

State Space Models (SSMs) and Hidden Markov Models (HMMs) are foundational frameworks for modeling sequential data with latent variables and are widely used in signal processing, control theory, and machine learning. Despite their shared…

Machine Learning · Computer Science 2026-01-21 Aydin Ghojogh , M. Hadi Sepanj , Benyamin Ghojogh

The problem of situational awareness (SAW) is investigated from the probabilistic modeling point of view. Taking the situation as a hidden variable, we introduce a hidden Markov model (HMM) and an extended state space model (ESSM) to…

Applications · Statistics 2015-10-08 Bin Liu

Generalized linear mixed models are powerful tools for analyzing clustered data, where the unknown parameters are classically (and most commonly) estimated by the maximum likelihood and restricted maximum likelihood procedures. However,…

Statistics Theory · Mathematics 2023-03-23 Andrea M. Bratsberg , Magne Thoresen , Abhik Ghosh