English
Related papers

Related papers: Identifiability and consistent estimation of nonpa…

200 papers

Multi-type Markov point processes offer a flexible framework for modelling complex multi-type point patterns where it is pertinent to capture both interactions between points as well as large scale trends depending on observed covariates.…

Methodology · Statistics 2025-10-15 Ib Thorsgaard Jensen , Jean-François Coeurjolly , Rasmus Waagepetersen

This paper gives a method for computing distributions associated with patterns in the state sequence of a hidden Markov model, conditional on observing all or part of the observation sequence. Probabilities are computed for very general…

Methodology · Statistics 2007-12-18 John A. D. Aston , Donald E. K. Martin

Hierarchical parametric models consisting of observable and latent variables are widely used for unsupervised learning tasks. For example, a mixture model is a representative hierarchical model for clustering. From the statistical point of…

Machine Learning · Statistics 2014-01-24 Keisuke Yamazaki

Hidden Markov models (HMMs) offer a robust and efficient framework for analyzing time series data, modelling both the underlying latent state progression over time and the observation process, conditional on the latent state. However, a…

Applications · Statistics 2024-07-19 Ioannis Rotous , Alex Diana , Alessio Farcomeni , Eleni Matechou , Andréa Thiebault

We consider probabilistic systems with hidden state and unobservable transitions, an extension of Hidden Markov Models (HMMs) that in particular admits unobservable {\epsilon}-transitions (also called null transitions), allowing state…

Machine Learning · Computer Science 2022-05-30 Rebecca Bernemann , Barbara König , Matthias Schaffeld , Torben Weis

Undirected graphical models are widely used in statistics, physics and machine vision. However Bayesian parameter estimation for undirected models is extremely challenging, since evaluation of the posterior typically involves the…

Computation · Statistics 2012-03-19 Richard G. Everitt

Motivated by applications in movement ecology, in this paper I propose a new class of integrated continuous-time hidden Markov models in which each observation depends on the underlying state of the process over the whole interval since the…

Methodology · Statistics 2019-10-01 Paul G Blackwell

We propose an information theoretic framework for quantitative assessment of acoustic modeling for hidden Markov model (HMM) based automatic speech recognition (ASR). Acoustic modeling yields the probabilities of HMM sub-word states for a…

Sound · Computer Science 2017-11-09 Pranay Dighe , Afsaneh Asaei , Hervé Bourlard

This paper describes the conversion of a Hidden Markov Model into a sequential transducer that closely approximates the behavior of the stochastic model. This transformation is especially advantageous for part-of-speech tagging because the…

cmp-lg · Computer Science 2008-02-03 Andre Kempe

We consider the estimation of high-dimensional network structures from partially observed Markov random field data using a penalized pseudo-likelihood approach. We fit a misspecified model obtained by ignoring the missing data problem. We…

Statistics Theory · Mathematics 2011-08-16 Yves F. Atchade

We describe a Markov latent state space (MLSS) model, where the latent state distribution is a decaying mixture over multiple past states. We present a simple sampling algorithm that allows to approximate such high-order MLSS with fixed…

Machine Learning · Computer Science 2017-11-09 Kristjan Kalm

Discrete-time hidden Markov models are a broadly useful class of latent-variable models with applications in areas such as speech recognition, bioinformatics, and climate data analysis. It is common in practice to introduce temporal…

Applications · Statistics 2017-01-16 Tracy Holsclaw , Arthur M. Greene , Andrew W. Robertson , Padhraic Smyth

Predictive equivalence in discrete stochastic processes have been applied with great success to identify randomness and structure in statistical physics and chaotic dynamical systems and to inferring hidden Markov models. We examine the…

Statistical Mechanics · Physics 2021-09-21 Samuel P. Loomis , James P. Crutchfield

Large Language Models (LLMs) perform internal computations in continuous vector spaces yet produce discrete tokens -- a fundamental mismatch whose geometric consequences remain poorly understood. We develop a mathematical framework that…

Machine Learning · Computer Science 2026-03-25 Mohamed A. Mabrok

This work studies networked agents cooperating to track a dynamical state of nature under partial information. The proposed algorithm is a distributed Bayesian filtering algorithm for finite-state hidden Markov models (HMMs). It can be used…

Signal Processing · Electrical Eng. & Systems 2022-12-07 Mert Kayaalp , Virginia Bordignon , Stefan Vlaski , Vincenzo Matta , Ali H. Sayed

We obtain a perfect sampling characterization of weak ergodicity for backward products of finite stochastic matrices, and equivalently, simultaneous tail triviality of the corresponding nonhomogeneous Markov chains. Applying these ideas to…

Statistics Theory · Mathematics 2016-01-07 Nick Whiteley , Anthony Lee

We consider a network of sensors deployed to sense a spatio-temporal field and estimate a parameter of interest. We are interested in the case where the temporal process sensed by each sensor can be modeled as a state-space process that is…

Distributed, Parallel, and Cluster Computing · Computer Science 2008-04-12 S. Sundhar Ram , V. V. Veeravalli , A. Nedic

We introduce a restricted latent class exploratory model for longitudinal data with ordinal attributes and respondent-specific covariates. Responses follow a time inhomogeneous hidden Markov model where the probability of a respondent's…

Methodology · Statistics 2026-03-11 Eric Alan Wayman , Steven Andrew Culpepper , Jeff Douglas , Jesse Bowers

In this paper, we introduce a variant of hidden Markov models in which the transition probabilities between the states, as well as the emission distributions, are not constant in time but vary in a periodic manner. This class of models,…

Applications · Statistics 2018-02-23 Augustin Touron

This work presents a scalable control framework based on nonlinear Model Predictive Control for high-dimensional dynamical systems. The proposed approach addresses the key challenges of model scalability and partial observability by…