English
Related papers

Related papers: Estimation of high-dimensional factor models and i…

200 papers

Large tensor (multi-dimensional array) data are now routinely collected in a wide range of applications, due to modern data collection capabilities. Often such observations are taken over time, forming tensor time series. In this paper we…

Methodology · Statistics 2020-05-20 Rong Chen , Dan Yang , Cun-hui Zhang

Robust physics (e.g., governing equations and laws) discovery is of great interest for many engineering fields and explainable machine learning. A critical challenge compared with general training is that the term and format of governing…

Numerical Analysis · Mathematics 2021-02-15 Zhiming Zhang , Yongming Liu

In this paper, we propose an analytical framework to quantify the amount of data samples needed to obtain accurate state estimation in a power system - a problem known as sample complexity analysis in computer science. Motivated by the…

Optimization and Control · Mathematics 2019-09-20 Joshua Comden , Marcello Colombino , Andrey Bernstein , Zhenhua Liu

First-passage probability estimation of high-dimensional nonlinear stochastic systems is a significant task to be solved in many science and engineering fields, but remains still an open challenge. The present paper develops a novel…

This paper studies a factor modeling-based approach for clustering high-dimensional data generated from a mixture of strongly correlated variables. Statistical modeling with correlated structures pervades modern applications in economics,…

Statistics Theory · Mathematics 2024-08-23 Shange Tang , Soham Jana , Jianqing Fan

We develop an efficient sampling approach for handling complex missing data patterns and a large number of missing observations in conditionally Gaussian state space models. Two important examples are dynamic factor models with unbalanced…

Econometrics · Economics 2023-02-08 Joshua C. C. Chan , Aubrey Poon , Dan Zhu

Testing large covariance matrices is of fundamental importance in statistical analysis with high-dimensional data. In the past decade, three types of test statistics have been studied in the literature: quadratic form statistics, maximum…

Statistics Theory · Mathematics 2020-06-02 Xiufan Yu , Danning Li , Lingzhou Xue

We derive high-dimensional scaling limits and fluctuations for the online least-squares Stochastic Gradient Descent (SGD) algorithm by taking the properties of the data generating model explicitly into consideration. Our approach treats the…

Probability · Mathematics 2024-04-05 Krishnakumar Balasubramanian , Promit Ghosal , Ye He

High-dimensional compositional data arise naturally in many applications such as metagenomic data analysis. The observed data lie in a high-dimensional simplex, and conventional statistical methods often fail to produce sensible results due…

Methodology · Statistics 2016-01-19 Yuanpei Cao , Wei Lin , Hongzhe Li

We consider the problem of extracting a low-dimensional, linear latent variable structure from high-dimensional random variables. Specifically, we show that under mild conditions and when this structure manifests itself as a linear space…

Machine Learning · Statistics 2015-10-14 Xiongzhi Chen , John D. Storey

The aim of this paper is to propose a new approach for the pattern recognition of power quality (PQ) disturbances based on Empirical mode decomposition (EMD) and $k$ Nearest Neighbor ($k$-NN) classifier. Since EMD decomposes a signal into…

Signal Processing · Electrical Eng. & Systems 2019-08-16 Faeza Hafiz , Celia Shahnaz

This paper deals with the dimension reduction for high-dimensional time series based on common factors. In particular we allow the dimension of time series $p$ to be as large as, or even larger than, the sample size $n$. The estimation for…

Statistics Theory · Mathematics 2010-06-15 Clifford Lam , Qiwei Yao , Neil Bathia

Factor analysis is a classical data reduction technique that seeks a potentially lower number of unobserved variables that can account for the correlations among the observed variables. This paper presents an extension of the factor…

Methodology · Statistics 2013-12-04 Tsung-I Lin , Pal H. Wu , Geoffrey J. McLachlan , Sharon X. Lee

Matrix-covariate is now frequently encountered in many biomedical researches. It is common to fit conventional statistical models by vectorizing matrix-covariate. This strategy, however, results in a large number of parameters, while the…

Applications · Statistics 2016-07-12 Hung Hung , Zhi-Yu Jou

The dependency structure of multivariate data can be analyzed using the covariance matrix $\Sigma$. In many fields the precision matrix $\Sigma^{-1}$ is even more informative. As the sample covariance estimator is singular in…

Methodology · Statistics 2015-06-04 Viktoria Öllerer , Christophe Croux

The accurate specification of the number of factors is critical to the validity of factor models and the topic almost occupies the central position in factor analysis. Plenty of estimators are available under the restrictive condition that…

Methodology · Statistics 2019-08-15 Long Yu , Yong He , Xinsheng Zhang

Simultaneously performing variable selection and inference in high-dimensional regression models is an open challenge in statistics and machine learning. The increasing availability of vast amounts of variables requires the adoption of…

Methodology · Statistics 2025-05-08 Marco Molinari , Magne Thoresen

Fault diagnosis plays an essential role in reducing the maintenance costs of rotating machinery manufacturing systems. In many real applications of fault detection and diagnosis, data tend to be imbalanced, meaning that the number of…

Machine Learning · Computer Science 2022-03-30 Masoud Jalayer , Amin Kaboli , Carlotta Orsenigo , Carlo Vercellis

This paper studies estimation of linear panel regression models with heterogeneous coefficients, when both the regressors and the residual contain a possibly common, latent, factor structure. Our theory is (nearly) efficient, because based…

Econometrics · Economics 2019-03-01 Marco Avarucci , Paolo Zaffaroni

The growing complexity of the power grid, driven by increasing share of distributed energy resources and by massive deployment of intelligent internet-connected devices, requires new modelling tools for planning and operation. Physics-based…

Machine Learning · Statistics 2018-11-26 Francesco Fusco