English
Related papers

Related papers: Robust high dimensional factor models with applica…

200 papers

This paper makes a selective survey on the recent development of the factor model and its application on statistical learnings. We focus on the perspective of the low-rank structure of factor models, and particularly draws attentions to…

Econometrics · Economics 2020-09-23 Jianqing Fan , Kunpeng Li , Yuan Liao

The problem of complex data analysis is a central topic of modern statistical science and learning systems and is becoming of broader interest with the increasing prevalence of high-dimensional data. The challenge is to develop statistical…

Machine Learning · Statistics 2018-03-05 Faicel Chamroukhi , Hien D. Nguyen

In recent times, functional data analysis (FDA) has been successfully applied in the field of high dimensional data classification. In this paper, we present a novel classification framework using functional data and classwise Principal…

Machine Learning · Statistics 2021-06-29 Avishek Chatterjee , Satyaki Mazumder , Koel Das

Principal component analysis is a versatile tool to reduce dimensionality which has wide applications in statistics and machine learning. It is particularly useful for modeling data in high-dimensional scenarios where the number of…

Methodology · Statistics 2022-08-18 Xiaoyu Hu , Fang Yao

Regression analysis is a key area of interest in the field of data analysis and machine learning which is devoted to exploring the dependencies between variables, often using vectors. The emergence of high dimensional data in technologies…

Machine Learning · Statistics 2023-08-23 Jiani Liu , Ce Zhu , Zhen Long , Yipeng Liu

Robust principal component analysis (RPCA) is a critical tool in modern machine learning, which detects outliers in the task of low-rank matrix reconstruction. In this paper, we propose a scalable and learnable non-convex approach for…

Machine Learning · Computer Science 2023-02-28 HanQin Cai , Jialin Liu , Wotao Yin

Probabilistic principal component analysis (PPCA) is a probabilistic reformulation of principal component analysis (PCA), under the framework of a Gaussian latent variable model. To improve the robustness of PPCA, it has been proposed to…

Methodology · Statistics 2023-11-28 Yiping Guo , Howard D. Bondell

Classical methods such as Principal Component Analysis (PCA) and Canonical Correlation Analysis (CCA) are ubiquitous in statistics. However, these techniques are only able to reveal linear relationships in data. Although nonlinear variants…

Machine Learning · Statistics 2014-05-14 David Lopez-Paz , Suvrit Sra , Alex Smola , Zoubin Ghahramani , Bernhard Schölkopf

High dimensional data has introduced challenges that are difficult to address when attempting to implement classical approaches of statistical process control. This has made it a topic of interest for research due in recent years. However,…

Applications · Statistics 2019-04-23 Mohammad Nabhan , Yajun Mei , Jianjun Shi

Principal components analysis (PCA) is a well-known technique for approximating a tabular data set by a low rank matrix. Here, we extend the idea of PCA to handle arbitrary data sets consisting of numerical, Boolean, categorical, ordinal,…

Machine Learning · Statistics 2015-05-06 Madeleine Udell , Corinne Horn , Reza Zadeh , Stephen Boyd

This is a tutorial and survey paper on factor analysis, probabilistic Principal Component Analysis (PCA), variational inference, and Variational Autoencoder (VAE). These methods, which are tightly related, are dimensionality reduction and…

Machine Learning · Statistics 2022-05-25 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

We consider the problem of decomposing a large covariance matrix into the sum of a low-rank matrix and a diagonally dominant matrix, and we call this problem the "Diagonally-Dominant Principal Component Analysis (DD-PCA)". DD-PCA is an…

Methodology · Statistics 2019-06-04 Zheng Tracy Ke , Lingzhou Xue , Fan Yang

In dealing with high-dimensional data sets, factor models are often useful for dimension reduction. The estimation of factor models has been actively studied in various fields. In the first part of this paper, we present a new approach to…

Statistical Finance · Quantitative Finance 2017-11-27 Joongyeub Yeo , George Papanicolaou

Principal Component Analysis (PCA) is a cornerstone of dimensionality reduction, yet its classical formulation relies critically on second-order moments and is therefore fragile in the presence of heavy-tailed data and impulsive noise.…

Machine Learning · Computer Science 2026-05-05 Mario Sayde , Christopher Khater , Jihad Fahs , Ibrahim Abou-Faycal

The amount of high-dimensional large-scale RNA sequencing data derived from multiple heterogeneous sources has increased exponentially in biological science. During data collection, significant technical noise or errors may occur. To…

Applications · Statistics 2025-06-24 Xiaolu Jiang , Wei Liu

We develop asymptotic theory for principal component analysis (PCA) of a high-dimensional factor model in which the working dimension $R$ is fixed and only required to satisfy $R \ge r$, where $r$ is the true number of factors. Building on…

Statistics Theory · Mathematics 2026-05-19 Yuan Liao , Xin Tong , Wanjie Wang , Dacheng Xiu

This paper considers the estimation and inference of the low-rank components in high-dimensional matrix-variate factor models, where each dimension of the matrix-variates ($p \times q$) is comparable to or greater than the number of…

Statistics Theory · Mathematics 2022-10-20 Elynn Y. Chen , Jianqing Fan

Robust PCA has drawn significant attention in the last decade due to its success in numerous application domains, ranging from bio-informatics, statistics, and machine learning to image and video processing in computer vision. Robust PCA…

Optimization and Control · Mathematics 2018-06-12 Shiqian Ma , Necdet Serhat Aybat

We study the robust principal component analysis (RPCA) problem in a distributed setting. The goal of RPCA is to find an underlying low-rank estimation for a raw data matrix when the data matrix is subject to the corruption of gross sparse…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-16 Wenda Chu

This review article provides an overview of random matrix theory (RMT) with a focus on its growing impact on the formulation and inference of statistical models and methodologies. Emphasizing applications within high-dimensional statistics,…

Methodology · Statistics 2024-12-11 Swapnaneel Bhattacharyya , Srijan Chattopadhyay , Sevantee Basu