English
Related papers

Related papers: Principal Component Analysis and Hidden Markov Mod…

200 papers

We introduce a novel statistical framework for the analysis of replicated point processes that allows for the study of point pattern variability at a population level. By treating point process realizations as random measures, we adopt a…

Statistics Theory · Mathematics 2025-11-05 Franck Picard , Vincent Rivoirard , Angelina Roche , Victor Panaretos

Hidden Markov Models (HMMs) are a ubiquitous tool to model time series data, and have been widely used in two main tasks of Automatic Music Transcription (AMT): note segmentation, i.e. identifying the played notes after a multi-pitch…

Machine Learning · Statistics 2017-04-13 D. Cazau , G. Nuel

We extend the principal component analysis (PCA) to second-order stationary vector time series in the sense that we seek for a contemporaneous linear transformation for a $p$-variate time series such that the transformed series is segmented…

Methodology · Statistics 2018-12-21 Jinyuan Chang , Bin Guo , Qiwei Yao

Happ and Greven (2018) developed a methodology for principal components analysis of multivariate functional data observed on different dimensional domains. Their approach relies on an estimation of univariate functional principal components…

Methodology · Statistics 2025-01-28 Steven Golovkine , Edward Gunning , Andrew J. Simpkin , Norma Bargary

We propose a model to forecast large realized covariance matrices of returns, applying it to the constituents of the S\&P 500 daily. To address the curse of dimensionality, we decompose the return covariance matrix using standard firm-level…

Statistical Finance · Quantitative Finance 2023-03-29 Rafael Alves , Diego S. de Brito , Marcelo C. Medeiros , Ruy M. Ribeiro

Principal Component Analysis is a key technique for reducing the complexity of high-dimensional data while preserving its fundamental data structure, ensuring models remain stable and interpretable. This is achieved by transforming the…

Methodology · Statistics 2025-03-25 Nuwan Weeraratne , Lyn Hunt , Jason Kurz

One of the pillars to build a country's economy is the stock market. Over the years, people are investing in stock markets to earn as much profit as possible from the amount of money that they possess. Hence, it is vital to have a…

Statistical Finance · Quantitative Finance 2022-03-17 Ishu Gupta , Tarun Kumar Madan , Sukhman Singh , Ashutosh Kumar Singh

Sparse principal component analysis (PCA) is a popular dimensionality reduction technique for obtaining principal components which are linear combinations of a small subset of the original features. Existing approaches cannot supply…

Optimization and Control · Mathematics 2022-02-22 Dimitris Bertsimas , Ryan Cory-Wright , Jean Pauphilet

Principal component analysis is a multivariate statistical method frequently used in science and engineering to reduce the dimension of a problem or extract the most significant features from a dataset. In this paper, using a similar notion…

Quantum Physics · Physics 2016-11-09 Anmer Daskin

We study principal components regression (PCR) in an asymptotic high-dimensional regression setting, where the number of data points is proportional to the dimension. We derive exact limiting formulas for the estimation and prediction…

Statistics Theory · Mathematics 2025-09-18 Alden Green , Elad Romanov

Principal component analysis is a versatile tool to reduce dimensionality which has wide applications in statistics and machine learning. It is particularly useful for modeling data in high-dimensional scenarios where the number of…

Methodology · Statistics 2022-08-18 Xiaoyu Hu , Fang Yao

With the development of high-throughput technologies, principal component analysis (PCA) in the high-dimensional regime is of great interest. Most of the existing theoretical and methodological results for high-dimensional PCA are based on…

Statistics Theory · Mathematics 2019-03-11 Rounak Dey , Seunggeun Lee

It is known that the common factors in a large panel of data can be consistently estimated by the method of principal components, and principal components can be constructed by iterative least squares regressions. Replacing least squares…

Methodology · Statistics 2017-11-16 Jushan Bai , Serena Ng

Hidden semi-Markov models (HSMMs) are latent variable models which allow latent state persistence and can be viewed as a generalization of the popular hidden Markov models (HMMs). In this paper, we introduce a novel spectral algorithm to…

Machine Learning · Statistics 2016-03-01 Igor Melnyk , Arindam Banerjee

Sparse PCA is a widely used technique for high-dimensional data analysis. In this paper, we propose a new method called low-rank principal eigenmatrix analysis. Different from sparse PCA, the dominant eigenvectors are allowed to be dense…

Machine Learning · Statistics 2019-04-30 Krishna Balasubramanian , Elynn Y. Chen , Jianqing Fan , Xiang Wu

Generalized principal component analysis (GLM-PCA) facilitates dimension reduction of non-normally distributed data. We provide a detailed derivation of GLM-PCA with a focus on optimization. We also demonstrate how to incorporate…

Machine Learning · Computer Science 2019-07-08 F. William Townes

This paper investigates the intrinsic group structures within the framework of large-dimensional approximate factor models, which portrays homogeneous effects of the common factors on the individuals that fall into the same group. To this…

Methodology · Statistics 2025-03-18 Yong He , Dong Liu , Guangming Pan , Yiming Wang

Over the past decades, more and more methods gain a giant development due to the development of technology. Evolutionary Algorithms are widely used as a heuristic method. However, the budget of computation increases exponentially when the…

Neural and Evolutionary Computing · Computer Science 2021-05-12 Yangjie Mei , Hao Wang

We propose a new method for statistical inference in generalized linear models. In the overparameterized regime, Principal Component Regression (PCR) reduces variance by projecting high-dimensional data to a low-dimensional principal…

Machine Learning · Statistics 2026-04-27 Yixuan Florence Wu , Yilun Zhu , Lei Cao , Naichen Shi

Non-homogeneous hidden Markov models (NHHMM) are a subclass of dependent mixture models used for semi-supervised learning, where both transition probabilities between the latent states and mean parameter of the probability distribution of…

Machine Learning · Statistics 2019-12-23 Aliaksandr Hubin