English
Related papers

Related papers: Estimation of High-Dimensional Markov-Switching VA…

200 papers

The Expectation--Maximization (EM) algorithm is a simple meta-algorithm that has been used for many years as a methodology for statistical inference when there are missing measurements in the observed data or when the data is composed of…

Machine Learning · Statistics 2022-11-15 Hideitsu Hino , Shotaro Akaho , Noboru Murata

Locally adapted parameterizations of a model (such as locally weighted regression) are expressive but often suffer from high variance. We describe an approach for reducing the variance, based on the idea of estimating simultaneously a…

Machine Learning · Computer Science 2012-07-03 Doina Precup , Philip Bachman

Expectation Maximization (EM) is among the most popular algorithms for estimating parameters of statistical models. However, EM, which is an iterative algorithm based on the maximum likelihood principle, is generally only guaranteed to find…

Statistics Theory · Mathematics 2016-08-30 Ji Xu , Daniel Hsu , Arian Maleki

Inference for mechanistic models is challenging because of nonlinear interactions between model parameters and a lack of identifiability. Here we focus on a specific class of mechanistic models, which we term stable differential equations.…

Computation · Statistics 2017-12-13 Philip Maybank , Ingo Bojak , Richard G. Everitt

The vector autoregressive (VAR) model is a powerful tool in modeling complex time series and has been exploited in many fields. However, fitting high dimensional VAR model poses some unique challenges: On one hand, the dimensionality,…

Machine Learning · Statistics 2014-10-30 Fang Han , Huanran Lu , Han Liu

High-dimensional time series data appear in many scientific areas in the current data-rich environment. Analysis of such data poses new challenges to data analysts because of not only the complicated dynamic dependence between the series,…

Methodology · Statistics 2022-06-22 Di Wang , Ruey S. Tsay

Markov chains are simple yet powerful mathematical structures to model temporally dependent processes. They generally assume stationary data, i.e., fixed transition probabilities between observations/states. However, live, real-world…

Machine Learning · Computer Science 2024-11-27 Kutalmış Coşkun , Borahan Tümer , Bjarne C. Hiller , Martin Becker

In this work, a Bayesian approximate message passing algorithm is proposed for solving the multiple measurement vector (MMV) problem in compressive sensing, in which a collection of sparse signal vectors that share a common support are…

Information Theory · Computer Science 2013-01-29 Justin Ziniel , Philip Schniter

Finite mixture models have been widely used for the modelling and analysis of data from heterogeneous populations. Maximum likelihood estimation of the parameters is typically carried out via the Expectation-Maximization (EM) algorithm. The…

Computation · Statistics 2016-06-08 Sharon X Lee , Kaleb L Lee , Geoffrey J McLachlan

We develop a forward-reverse EM (FREM) algorithm for estimating parameters that determine the dynamics of a discrete time Markov chain evolving through a certain measurable state space. As a key tool for the construction of the FREM method…

Statistics Theory · Mathematics 2015-01-29 Christian Bayer , Hilmar Mai , John Schoenmakers

Online variants of the Expectation Maximization (EM) algorithm have recently been proposed to perform parameter inference with large data sets or data streams, in independent latent models and in hidden Markov models. Nevertheless, the…

Statistics Theory · Mathematics 2012-06-01 Sylvain Le Corff , Gersende Fort

Pel-recursive motion estimation isa well-established approach. However, in the presence of noise, it becomes an ill-posed problem that requires regularization. In this paper, motion vectors are estimated in an iterative fashion by means of…

Computer Vision and Pattern Recognition · Computer Science 2014-03-31 Vania Vieira Estrela , Marcos Henrique da Silva Bassani

In the paper, we introduce the maximum entropy estimator based on 2-dimensional empirical distribution of the observation sequence of hidden Markov model , when the sample size is big: in that case computing the maximum likelihood estimator…

Statistics Theory · Mathematics 2023-03-16 Shulan Hu , Xinyu Wang , Liming Wu

We study estimation of large Dynamic Factor models implemented through the Expectation Maximization (EM) algorithm, jointly with the Kalman smoother. We prove that as both the cross-sectional dimension, $n$, and the sample size, $T$,…

Statistics Theory · Mathematics 2024-09-26 Matteo Barigozzi , Matteo Luciani

In this paper, we propose a time-series stochastic model based on a scale mixture distribution with Markov transitions to detect epileptic seizures in electroencephalography (EEG). In the proposed model, an EEG signal at each time point is…

Signal Processing · Electrical Eng. & Systems 2021-11-15 Akira Furui , Tomoyuki Akiyama , Toshio Tsuji

Predicting a driver's cognitive state, or more specifically, modeling a driver's reaction time (RT) in response to the appearance of a potential hazard warrants urgent research. In the last two decades, the electric field that is generated…

Human-Computer Interaction · Computer Science 2019-05-28 Chun-Hsiang Chuang , Zehong Cao , Po-Tsang Chen , Chih-Sheng Huang , Nikhil R. Pal , Chin-Teng Lin

Empirical mode decomposition (EMD) has developed into a prominent tool for adaptive, scale-based signal analysis in various fields like robotics, security and biomedical engineering. Since the dramatic increase in amount of data puts…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Jin Zhang , Fan Feng , Pere Marti-Puig , Cesar F. Caiafa , Zhe Sun , Feng Duan , Jordi Solé-Casals

This paper provides a mixture modeling framework using the bivariate generalized exponential distribution. We study different properties of this mixture distribution. Hierarchical EM algorithm is developed for finding the estimates of the…

Computation · Statistics 2018-04-03 Arabin Kumar Dey , Debasis Kundu , Tumati Kiran Kumar

Hidden semi-Markov models (HSMMs) are latent variable models which allow latent state persistence and can be viewed as a generalization of the popular hidden Markov models (HMMs). In this paper, we introduce a novel spectral algorithm to…

Machine Learning · Statistics 2016-03-01 Igor Melnyk , Arindam Banerjee

Normal mean-variance mixture distributions are widely applied to simplify a model's implementation and improve their computational efficiency under the Maximum Likelihood (ML) approach. Especially for distributions with normal mean-variance…

Methodology · Statistics 2015-06-18 Thanakorn Nitithumbundit , Jennifer S. K. Chan