English
Related papers

Related papers: Penalized estimation in high-dimensional hidden Ma…

200 papers

A penalized maximum likelihood estimation approach is proposed for discrete-time hidden Markov models where covariates affect the observed responses and serial dependence is considered. The proposed penalized maximum likelihood method…

Methodology · Statistics 2025-07-04 Luca Brusa , Fulvia Pennoni , Francesco Bartolucci , Romina Peruilh Bagolini

Hidden Markov models (HMMs) are flexible time series models in which the distributions of the observations depend on unobserved serially correlated states. The state-dependent distributions in HMMs are usually taken from some class of…

Methodology · Statistics 2014-06-19 Roland Langrock , Thomas Kneib , Alexander Sohn , Stacy DeRuiter

Hidden Markov models (HMMs) have been extensively used in the univariate and multivariate literature. However, there has been an increased interest in the analysis of matrix-variate data over the recent years. In this manuscript we…

Methodology · Statistics 2021-07-16 Salvatore D. Tomarchio , Antonio Punzo , Antonello Maruotti

This work attempts to approximate a linear Gaussian system with a finite-state hidden Markov model (HMM), which is found useful in solving sophisticated event-based state estimation problems. An indirect modeling approach is developed,…

Systems and Control · Electrical Eng. & Systems 2020-07-10 Kaikai Zheng , Dawei Shi , Ling Shi

We deal with the estimation of the regime number in a linear Gaussian autoregressive process with a Markov regime (AR-MR). The problem of estimating the number of regimes in this type of series is that of determining the number of states in…

Statistics Theory · Mathematics 2008-11-21 Ricardo Ríos , Luis-Angel Rodríguez

The hidden Markov model (HMM) is a fundamental tool for sequence modeling that cleanly separates the hidden state from the emission structure. However, this separation makes it difficult to fit HMMs to large datasets in modern NLP, and they…

Computation and Language · Computer Science 2020-11-10 Justin T. Chiu , Alexander M. Rush

Classical penalized likelihood regression problems deal with the case that the independent variables data are known exactly. In practice, however, it is common to observe data with incomplete covariate information. We are concerned with a…

Methodology · Statistics 2010-08-04 Xiwen Ma , Bin Dai , Ronald Klein , Barbara E. K. Klein , Kristine E. Lee , Grace Wahba

Hidden Markov models (HMMs) are popular models to identify a finite number of latent states from sequential data. However, fitting them to large data sets can be computationally demanding because most likelihood maximization techniques…

Hidden Markov models (HMM) have been widely used by scientists to model stochastic systems: the underlying process is a discrete Markov chain and the observations are noisy realizations of the underlying process. Determining the number of…

Statistics Theory · Mathematics 2024-07-18 Yang Chen , Cheng-Der Fuh , Chu-Lan Michael Kao

Undirected graphs are often used to describe high dimensional distributions. Under sparsity conditions, the graph can be estimated using $\ell_1$-penalization methods. We propose and study the following method. We combine a multiple…

Machine Learning · Statistics 2012-01-11 Shuheng Zhou , Philipp Rutimann , Min Xu , Peter Buhlmann

Hidden Markov Models (HMMs) comprise a powerful generative approach for modeling sequential data and time-series in general. However, the commonly employed assumption of the dependence of the current time frame to a single or multiple…

Machine Learning · Computer Science 2021-09-13 Konstantinos P. Panousis , Sotirios Chatzis , Sergios Theodoridis

Hidden Quantum Markov Models (HQMMs) can be thought of as quantum probabilistic graphical models that can model sequential data. We extend previous work on HQMMs with three contributions: (1) we show how classical hidden Markov models…

Machine Learning · Statistics 2017-10-26 Siddarth Srinivasan , Geoff Gordon , Byron Boots

Hidden Markov models (HMMs) offer a robust and efficient framework for analyzing time series data, modelling both the underlying latent state progression over time and the observation process, conditional on the latent state. However, a…

Applications · Statistics 2024-07-19 Ioannis Rotous , Alex Diana , Alessio Farcomeni , Eleni Matechou , Andréa Thiebault

Hidden Markov models (HMMs) are widely applied in studies where a discrete-valued process of interest is observed indirectly. They have for example been used to model behaviour from human and animal tracking data, disease status from…

Methodology · Statistics 2025-05-22 Théo Michelot

Hidden semi-Markov models (HSMMs) are latent variable models which allow latent state persistence and can be viewed as a generalization of the popular hidden Markov models (HMMs). In this paper, we introduce a novel spectral algorithm to…

Machine Learning · Statistics 2016-03-01 Igor Melnyk , Arindam Banerjee

We develop a method for estimating well-conditioned and sparse covariance and inverse covariance matrices from a sample of vectors drawn from a sub-gaussian distribution in high dimensional setting. The proposed estimators are obtained by…

Statistics Theory · Mathematics 2016-11-21 Ashwini Maurya

Non-homogeneous hidden Markov models (NHHMM) are a subclass of dependent mixture models used for semi-supervised learning, where both transition probabilities between the latent states and mean parameter of the probability distribution of…

Machine Learning · Statistics 2019-12-23 Aliaksandr Hubin

We present an efficient exact algorithm for estimating state sequences from outputs (or observations) in imprecise hidden Markov models (iHMM), where both the uncertainty linking one state to the next, and that linking a state to its…

Artificial Intelligence · Computer Science 2012-10-08 Jasper De Bock , Gert de Cooman

We consider a finite mixture of regressions (FMR) model for high-dimensional inhomogeneous data where the number of covariates may be much larger than sample size. We propose an l1-penalized maximum likelihood estimator in an appropriate…

Methodology · Statistics 2012-02-28 Nicolas Städler , Peter Bühlmann , Sara van de Geer

We consider finite state space stationary hidden Markov models (HMMs) in the situation where the number of hidden states is unknown. We provide a frequentist asymptotic evaluation of Bayesian analysis methods. Our main result gives…

Statistics Theory · Mathematics 2014-10-27 Elisabeth Gassiat , Judith Rousseau
‹ Prev 1 2 3 10 Next ›