English
Related papers

Related papers: High-Dimensional Matrix-Variate Diffusion Index Mo…

200 papers

We propose a novel approach for time series forecasting with many predictors, referred to as the GO-sdPCA, in this paper. The approach employs a variable selection method known as the group orthogonal greedy algorithm and the…

Methodology · Statistics 2024-06-17 Shuo-Chieh Huang , Ruey S. Tsay

Traditional principal component analysis (PCA) is well known in high-dimensional data analysis, but it requires to express data by a matrix with observations to be continuous. To overcome the limitations, a new method called flexible PCA…

Methodology · Statistics 2021-08-17 Tonglin Zhang , Baijian Yang , Qianqian Song , Jing Su

Motivated by multi-center biomedical studies that cannot share individual data due to privacy and ownership concerns, we develop communication-efficient iterative distributed algorithms for estimation and inference in the high-dimensional…

Methodology · Statistics 2024-06-25 Pierre Bayle , Jianqing Fan , Zhipeng Lou

In multivariate time series classification, although current sequence analysis models have excellent classification capabilities, they show significant shortcomings when dealing with long sequence multivariate data, such as prolonged…

Machine Learning · Computer Science 2024-10-29 Enshuo Yan , Huachuan Wang , Weihao Xia

The construction of deprivation indices is complicated by the inherent ambiguity in defining deprivation as well as the potential for partisan manipulation. Nevertheless, deprivation indices provide an essential tool for mitigating the…

Physics and Society · Physics 2020-07-22 Amin Ghafourian , Noli Brazil , Thilo Gross

Diffusion models have emerged as powerful generative tools with applications in computer vision and scientific machine learning (SciML), where they have been used to solve large-scale probabilistic inverse problems. Traditionally, these…

The mixture of factor analyzers (MFA) model provides a powerful tool for analyzing high-dimensional data as it can reduce the number of free parameters through its factor-analytic representation of the component covariance matrices. This…

Methodology · Statistics 2013-07-09 Tsung-I Lin , Geoffrey J. McLachlan , Sharon X. Lee

Modern empirical analysis often relies on high-dimensional panel datasets with non-negligible cross-sectional and time-series correlations. Factor models are natural for capturing such dependencies. A tensor factor model describes the…

Econometrics · Economics 2025-03-10 Andrii Babii , Eric Ghysels , Junsu Pan

In this paper, we develop a novel high-dimensional time-varying coefficient estimation method, based on high-dimensional It\^o diffusion processes. To account for high-dimensional time-varying coefficients, we first estimate local (or…

Methodology · Statistics 2026-01-06 Donggyu Kim , Minseog Oh , Minseok Shin

Probabilistic modeling is cyclical: we specify a model, infer its posterior, and evaluate its performance. Evaluation drives the cycle, as we revise our model based on how it performs. This requires a metric. Traditionally, predictive…

Machine Learning · Statistics 2016-05-25 Alp Kucukelbir , David M. Blei

In this article we consider the estimation of static parameters for partially observed diffusion processes with discrete-time observations over a fixed time interval. In particular, when one only has access to time-discretized solutions of…

Methodology · Statistics 2025-09-26 Miguel Alvarez , Ajay Jasra

We model two time and space scales discrete observations by using a unique continuous diffusion process with time dependent coefficient. We define new parameters for the large scale model as functions of the small scale distribution…

Methodology · Statistics 2009-09-09 V. Calian , G. Stefansson , L. P. Folkow , A. S. Blix

Diffusion models have shown remarkable empirical success in sampling from rich multi-modal distributions. Their inference relies on numerically solving a certain differential equation. This differential equation cannot be solved in closed…

Machine Learning · Computer Science 2026-01-16 Khashayar Gatmiry , Sitan Chen , Adil Salim

We study the problem of distributed adaptive estimation over networks where nodes cooperate to estimate physical parameters that can vary over both space and time domains. We use a set of basis functions to characterize the space-varying…

Systems and Control · Computer Science 2015-07-22 Reza Abdolee , Benoit Champagne , Ali H. Sayed

In many longitudinal studies, a large number of variables are measured repeatedly over time, with substantial missing data. Existing methods, such as probabilistic principal component analysis (PPCA), are ill-equipped to handle such…

Methodology · Statistics 2026-04-27 Xinyu Zhang , Ameer Qaqish , D. Y. Lin , Didong Li

Multivariate Hawkes Processes (MHPs) are an important class of temporal point processes that have enabled key advances in understanding and predicting social information systems. However, due to their complex modeling of temporal…

Machine Learning · Computer Science 2020-03-02 Maximilian Nickel , Matthew Le

Simultaneous variable selection and statistical inference is challenging in high-dimensional data analysis. Most existing post-selection inference methods require explicitly specified regression models, which are often linear, as well as…

Methodology · Statistics 2026-03-19 Shangyuan Ye , Shauna Rakshe , Ye Liang

This paper re-examines the problem of estimating risk premia in linear factor pricing models. Typically, the data used in the empirical literature are characterized by weakness of some pricing factors, strong cross-sectional dependence in…

Econometrics · Economics 2019-04-09 Stanislav Anatolyev , Anna Mikusheva

We consider forecasting a single time series using a large number of predictors in the presence of a possible nonlinear forecast function. Assuming that the predictors affect the response through the latent factors, we propose to first…

Statistics Theory · Mathematics 2021-04-22 Wei Luo , Lingzhou Xue , Jiawei Yao , Xiufan Yu

Factor analysis is a widely used technique for dimension reduction in high-dimensional data. However, a key challenge in factor models lies in the interpretability of the latent factors. One intuitive way to interpret these factors is…

Methodology · Statistics 2025-10-08 Xin Wang , Xialu Liu