English
Related papers

Related papers: Sufficient Forecasting Using Factor Models

200 papers

Predict a new response from a covariate is a challenging task in regression, which raises new question since the era of high-dimensional data. In this paper, we are interested in the inverse regression method from a theoretical viewpoint.…

Statistics Theory · Mathematics 2018-07-10 Emilie Devijver , Emeline Perthame

Missing values are unavoidable in many applications of machine learning and present challenges both during training and at test time. When variables are missing in recurring patterns, fitting separate pattern submodels have been proposed as…

Machine Learning · Computer Science 2023-11-27 Lena Stempfle , Ashkan Panahi , Fredrik D. Johansson

Electricity load forecasting enables the grid operators to optimally implement the smart grid's most essential features such as demand response and energy efficiency. Electricity demand profiles can vary drastically from one region to…

Machine Learning · Computer Science 2023-05-15 Abdul Wahab , Muhammad Anas Tahir , Naveed Iqbal , Faisal Shafait , Syed Muhammad Raza Kazmi

Functional principal components (FPC's) provide the most important and most extensively used tool for dimension reduction and inference for functional data. The selection of the number, d, of the FPC's to be used in a specific procedure has…

Statistics Theory · Mathematics 2013-02-26 Stefan Fremdt , Lajos Horváth , Piotr Kokoszka , Josef G. Steinebach

A high-dimensional $r$-factor model for an $n$-dimensional vector time series is characterised by the presence of a large eigengap (increasing with $n$) between the $r$-th and the $(r+1)$-th largest eigenvalues of the covariance matrix.…

Methodology · Statistics 2021-03-09 Matteo Barigozzi , Haeran Cho

Estimates of the approximate factor model are increasingly used in empirical work. Their theoretical properties, studied some twenty years ago, also laid the ground work for analysis on large dimensional panel data models with cross-section…

Econometrics · Economics 2020-08-04 Jushan Bai , Serena Ng

Recurrent event time data arise in many studies, including biomedicine, public health, marketing, and social media analysis. High-dimensional recurrent event data involving many event types and observations have become prevalent with…

Methodology · Statistics 2025-04-02 Fangyi Chen , Yunxiao Chen , Zhiliang Ying , Kangjie Zhou

Time series forecasting is a critical task in various domains, where accurate predictions can drive informed decision-making. Traditional forecasting methods often rely on current observations of variables to predict future outcomes,…

Machine Learning · Computer Science 2026-03-17 Wentao Gao , Xiaojing Du , Wenjun Yu , Xiongren Chen , Yifan Guo , Feiyu Yang

Along with the widespread adoption of high-dimensional data, traditional statistical methods face significant challenges in handling problems with high correlation of variables, heavy-tailed distribution, and coexistence of sparse and dense…

Methodology · Statistics 2025-08-04 Xiaoyang Wei , Yanlin Tang , Xu Guo , Meiling Hao , Yanmei Shi

Factor analysis is a classical data reduction technique that seeks a potentially lower number of unobserved variables that can account for the correlations among the observed variables. This paper presents an extension of the factor…

Methodology · Statistics 2013-12-04 Tsung-I Lin , Pal H. Wu , Geoffrey J. McLachlan , Sharon X. Lee

We introduce a new sufficient dimension reduction framework that targets a statistical functional of interest, and propose an efficient estimator for the semiparametric estimation problems of this type. The statistical functional covers a…

Statistics Theory · Mathematics 2014-03-24 Wei Luo , Bing Li , Xiangrong Yin

Accurate electrical consumption forecasting is crucial for efficient energy management and resource allocation. While traditional time series forecasting relies on historical patterns and temporal dependencies, incorporating external…

Machine Learning · Computer Science 2025-06-18 Fabien Bernier , Maxime Cordy , Yves Le Traon

This paper deals with the dimension reduction for high-dimensional time series based on common factors. In particular we allow the dimension of time series $p$ to be as large as, or even larger than, the sample size $n$. The estimation for…

Statistics Theory · Mathematics 2010-06-15 Clifford Lam , Qiwei Yao , Neil Bathia

Modeling and forecasting covariance matrices of asset returns play a crucial role in finance. The availability of high frequency intraday data enables the modeling of the realized covariance matrix directly. However, most models in the…

Applications · Statistics 2015-04-15 Keren Shen , Jianfeng Yao , Wai Keung Li

We study one particular type of multivariate spatial autoregression (MSAR) model with diverging dimensions in both responses and covariates. This makes the usual MSAR models no longer applicable due to the high computational cost. To…

Methodology · Statistics 2025-09-03 Jiaxin Shi , Xuening Zhu , Jing Zhou , Baichen Yu , Hansheng Wang

This paper proposes a hierarchical approximate-factor approach to analyzing high-dimensional, large-scale heterogeneous time series data using distributed computing. The new method employs a multiple-fold dimension reduction procedure using…

Methodology · Statistics 2022-04-20 Zhaoxing Gao , Ruey S. Tsay

Machine learning models have achieved widespread success but often inherit and amplify historical biases, resulting in unfair outcomes. Traditional fairness methods typically impose constraints at the prediction level, without addressing…

Machine Learning · Statistics 2026-02-10 Enze Shi , Pankaj Bhagwat , Zhixian Yang , Linglong Kong , Bei Jiang

In this paper, we propose a distributed framework for reducing the dimensionality of high-dimensional, large-scale, heterogeneous matrix-variate time series data using a factor model. The data are first partitioned column-wise (or row-wise)…

Machine Learning · Statistics 2026-01-19 Hangjin Jiang , Yuzhou Li , Zhaoxing Gao

Dynamic factor models are often estimated by point-estimation methods, disregarding parameter uncertainty. We propose a method accounting for parameter uncertainty by means of posterior approximation, using variational inference. Our…

Methodology · Statistics 2022-10-14 Erik Spånberg

High-frequency quantitative investment is a crucial aspect of stock investment. Notably, order flow data plays a critical role as it provides the most detailed level of information among high-frequency trading data, including comprehensive…

Statistical Finance · Quantitative Finance 2023-08-17 Xianfeng Jiao , Zizhong Li , Chang Xu , Yang Liu , Weiqing Liu , Jiang Bian