English
Related papers

Related papers: Estimation of high-dimensional factor models and i…

200 papers

In this paper, we propose a distributed framework for reducing the dimensionality of high-dimensional, large-scale, heterogeneous matrix-variate time series data using a factor model. The data are first partitioned column-wise (or row-wise)…

Machine Learning · Statistics 2026-01-19 Hangjin Jiang , Yuzhou Li , Zhaoxing Gao

A resolution-independent data-driven stochastic parametrization method for subgrid-scale processes in coarsened fluid descriptions is proposed. The method enables the inclusion of high-fidelity data into the coarsened flow model, thereby…

Fluid Dynamics · Physics 2023-04-26 Sagy Ephrati , Paolo Cifani , Milo Viviani , Bernard Geurts

In this work we address the problem of approximating high-dimensional data with a low-dimensional representation. We make the following contributions. We propose an inverse regression method which exchanges the roles of input and response,…

Machine Learning · Computer Science 2015-09-04 Antoine Deleforge , Florence Forbes , Radu Horaud

Performance variability management is an active research area in high-performance computing (HPC). We focus on input/output (I/O) variability. To study the performance variability, computer scientists often use grid-based designs (GBDs) to…

Applications · Statistics 2022-01-25 Yueyao Wang , Li Xu , Yili Hong , Rong Pan , Tyler Chang , Thomas Lux , Jon Bernard , Layne Watson , Kirk Cameron

We study the covariance of the cross-power spectrum of different tracers for the large-scale structure. We develop the counts-in-cells framework for the multi-tracer approach, and use this to derive expressions for the full non-Gaussian…

Astrophysics · Physics 2015-05-13 Robert E. Smith

In this paper, we propose a robust data-driven process model whose hyperparameters are robustly estimated using the Schweppe-type generalized maximum likelihood estimator. The proposed model is trained on recorded time-series data of…

Systems and Control · Electrical Eng. & Systems 2023-01-24 Pooja Algikar , Yijun Xu , Somayeh Yarahmadi , Lamine Mili

Modeling large dependent datasets in modern time series analysis is a crucial research area. One effective approach to handle such datasets is to transform the observations into density functions and apply statistical methods for further…

Methodology · Statistics 2025-07-23 Yinzhi Wang , Yingqiu Zhu , Ben-Chang Shia , Lei Qin

The increasing complexity of the power grid, due to higher penetration of distributed resources and the growing availability of interconnected, distributed metering devices re- quires novel tools for providing a unified and consistent view…

Machine Learning · Statistics 2017-05-25 Francesco Fusco , Seshu Tirupathi , Robert Gormally

The performance of fault diagnosis systems is highly affected by data quality in cyber-physical power systems. These systems generate massive amounts of data that overburden the system with excessive computational costs. Another issue is…

Machine Learning · Computer Science 2024-09-04 Hossein Hassani , Ehsan Hallaji , Roozbeh Razavi-Far , Mehrdad Saif

Mixed membership models are an extension of finite mixture models, where each observation can partially belong to more than one mixture component. A probabilistic framework for mixed membership models of high-dimensional continuous data is…

Factor analysis is a flexible technique for assessment of multivariate dependence and codependence. Besides being an exploratory tool used to reduce the dimensionality of multivariate data, it allows estimation of common factors that often…

Methodology · Statistics 2020-02-19 Kelly C. M. Gonçalves , Afonso C. B. Silva

We consider forecasting a single time series when there is a large number of predictors and a possible nonlinear effect. The dimensionality was first reduced via a high-dimensional (approximate) factor model implemented by the principal…

Statistics Theory · Mathematics 2015-12-29 Jianqing Fan , Lingzhou Xue , Jiawei Yao

The widespread use of sensors in modern power grids has led to the accumulation of large amounts of voltage and current waveform data, especially during fault events. However, the lack of labeled datasets poses a significant challenge for…

Machine Learning · Computer Science 2025-05-26 Julian Oelhaf , Georg Kordowich , Andreas Maier , Johann Jager , Siming Bayer

We estimate the power spectrum of mass density fluctuations from peculiar velocities of galaxies by applying an improved maximum-likelihood technique to the new all-sky SFI catalog. Parametric models are used for the power spectrum and the…

Medical prediction applications often need to deal with small sample sizes compared to the number of covariates. Such data pose problems for prediction and variable selection, especially when the covariate-response relationship is…

Machine Learning · Statistics 2024-11-05 Jeroen M. Goedhart , Thomas Klausch , Jurriaan Janssen , Mark A. van de Wiel

We study the dynamics of dephasing in a quantum two-level system by modeling both 1/f and high-frequency noise by random telegraph processes. Our approach is based on a so-called spin-fluctuator model in which a noisy environment is modeled…

Quantum Physics · Physics 2014-12-01 Alexander I. Nesterov , Gennady P. Berman

Elliptical factor models play a central role in modern high-dimensional data analysis, particularly due to their ability to capture heavy-tailed and heterogeneous dependence structures. Within this framework, Tyler's M-estimator (Tyler,…

Methodology · Statistics 2025-12-23 Xinyue Xu , Huifang Ma , Hongfei Wang , Long Feng

Recurrent event time data arise in many studies, including biomedicine, public health, marketing, and social media analysis. High-dimensional recurrent event data involving many event types and observations have become prevalent with…

Methodology · Statistics 2025-04-02 Fangyi Chen , Yunxiao Chen , Zhiliang Ying , Kangjie Zhou

The current Poisson factor models often assume that the factors are unknown, which overlooks the explanatory potential of certain observable covariates. This study focuses on high dimensional settings, where the number of the count response…

Methodology · Statistics 2024-02-26 Wei Liu , Qingzhi Zhong

The application of standard sufficient dimension reduction methods for reducing the dimension space of predictors without losing regression information requires inverting the covariance matrix of the predictors. This has posed a number of…

Methodology · Statistics 2019-10-01 Kabir Opeyemi Olorede , Waheed Babatunde Yahya