English
Related papers

Related papers: Maximum likelihood estimation of hidden Markov mod…

200 papers

Hidden Markov models have successfully been applied as models of discrete time series in many fields. Often, when applied in practice, the parameters of these models have to be estimated. The currently predominating identification methods,…

Machine Learning · Statistics 2015-07-24 Robert Mattila , Cristian R. Rojas , Bo Wahlberg

We develop a recursion for hidden Markov model of any order h, which allows us to obtain the posterior distribution of the latent state at every occasion, given the previous h states and the observed data. With respect to the well-known…

Statistics Theory · Mathematics 2012-01-04 Francesco Bartolucci

This research deals with the estimation and imputation of missing data in longitudinal models with a Poisson response variable inflated with zeros. A methodology is proposed that is based on the use of maximum likelihood, assuming that data…

Methodology · Statistics 2024-09-18 D. S. Martinez-Lobo , O. O. Melo , N. A. Cruz

While advances continue to be made in model-based clustering, challenges persist in modeling various data types such as panel data. Multivariate panel data present difficulties for clustering algorithms because they are often plagued by…

Methodology · Statistics 2024-08-26 Mackenzie R. Neal , Alexa A. Sochaniwsky , Paul D. McNicholas

We propose a class of continuous-time Markov counting processes for analyzing correlated binary data and establish a correspondence between these models and sums of exchangeable Bernoulli random variables. Our approach generalizes many…

Methodology · Statistics 2014-08-28 Forrest W. Crawford , Daniel Zelterman

Motivated by applications in movement ecology, in this paper I propose a new class of integrated continuous-time hidden Markov models in which each observation depends on the underlying state of the process over the whole interval since the…

Methodology · Statistics 2019-10-01 Paul G Blackwell

The Expectation Maximization (EM) algorithm is a versatile tool for model parameter estimation in latent data models. When processing large data sets or data stream however, EM becomes intractable since it requires the whole data set to be…

Statistics Theory · Mathematics 2012-10-18 Sylvain Le Corff , Gersende Fort

We compare different selection criteria to choose the number of latent states of a multivariate latent Markov model for longitudinal data. This model is based on an underlying Markov chain to represent the evolution of a latent…

Methodology · Statistics 2012-12-04 Silvia Bacci , Silvia Pandolfi , Fulvia Pennoni

Pre-trained machine learning (ML) predictions have been increasingly used to complement incomplete data to enable downstream scientific inquiries, but their naive integration risks biased inferences. Recently, multiple methods have been…

Methodology · Statistics 2025-11-12 Xingran Chen , Tyler McCormick , Bhramar Mukherjee , Zhenke Wu

Continuous-time multistate models are widely used for analyzing interval-censored data on disease progression over time. Sometimes, diseases manifest differently and what appears to be a coherent collection of symptoms is the expression of…

Methodology · Statistics 2024-10-08 Yidan Shi , Leilei Zeng , Mary E. Thompson , Suzanne L. Tyas

A hidden Markov model with trends is a hidden Markov model whose emission distributions are translated by a trend that depends on the current hidden state and on the current time. Contrary to standard hidden Markov models, such processes…

Statistics Theory · Mathematics 2021-12-17 Luc Lehéricy , Augustin Touron

Continuous-time Markov processes over finite state-spaces are widely used to model dynamical processes in many fields of natural and social science. Here, we introduce an maximum likelihood estimator for constructing such models from data…

Data Analysis, Statistics and Probability · Physics 2015-07-01 Robert T. McGibbon , Vijay S. Pande

Maximum likelihood (ML) estimation is widely used in statistics. The h-likelihood has been proposed as an extension of Fisher's likelihood to statistical models including unobserved latent variables of recent interest. Its advantage is that…

Methodology · Statistics 2022-07-21 Jeongseop Han , Youngjo Lee , Jae Kwang Kim

Deep latent variable models (DLVMs) combine the approximation abilities of deep neural networks and the statistical foundations of generative models. Variational methods are commonly used for inference; however, the exact likelihood of…

Machine Learning · Statistics 2018-06-29 Pierre-Alexandre Mattei , Jes Frellsen

We introduce an extension of finite mixture models by incorporating skew-normal distributions within a Hidden Markov Model framework. By assuming a constant transition probability matrix and allowing emission distributions to vary according…

Methodology · Statistics 2025-09-25 Andrea Nigri , Marco Forti , Han Lin Shang

We propose a joint model for a time-to-event outcome and a quantile of a continuous response repeatedly measured over time. The quantile and survival processes are associated via shared latent and manifest variables. Our joint model…

Methodology · Statistics 2014-04-07 Alessio Farcomeni , Sara Viviani

We consider a discrete latent variable model for two-way data arrays, which allows one to simultaneously produce clusters along one of the data dimensions (e.g. exchangeable observational units or features) and contiguous groups, or…

De-interleaving of the mixtures of Hidden Markov Processes (HMPs) generally depends on its representation model. Existing representation models consider Markov chain mixtures rather than hidden Markov, resulting in the lack of robustness to…

Machine Learning · Statistics 2024-06-04 Jiadi Bao , Mengtao Zhu , Yunjie Li , Shafei Wang

In the context of multilevel longitudinal data, where sample units are collected in clusters, an important aspect that should be accounted for is the unobserved heterogeneity between sample units and between clusters. For this aim we…

Statistics Theory · Mathematics 2012-08-10 F. Bartolucci , M. Lupparelli

Inference in hidden Markov model has been challenging in terms of scalability due to dependencies in the observation data. In this paper, we utilize the inherent memory decay in hidden Markov models, such that the forward and backward…

Machine Learning · Statistics 2025-01-14 Felix X. -F. Ye , Yi-an Ma , Hong Qian