English
Related papers

Related papers: A dynamic factor model approach to incorporate Big…

200 papers

The monthly Bureau of Labor Statistics Employment Situation Report is widely anticipated by economists, journalists, and politicians as it is used to forecast the economic condition of the United States. The report has broad impact on…

Human-Computer Interaction · Computer Science 2016-08-12 Peter Mancini , Benjamin Bengfort , Ben Shneiderman

Latent or unobserved phenomena pose a significant difficulty in data analysis as they induce complicated and confounding dependencies among a collection of observed variables. Factor analysis is a prominent multivariate statistical modeling…

Methodology · Statistics 2020-06-22 Armeen Taeb , Venkat Chandrasekaran

State-space mixed-frequency vector autoregressions are now widely used for nowcasting. Despite their popularity, estimating such models can be computationally intensive, especially for large systems with stochastic volatility. To tackle the…

Econometrics · Economics 2021-12-22 Joshua C. C. Chan , Aubrey Poon , Dan Zhu

This article aims at discovering the unknown variables in the system through data analysis. The main idea is to use the time of data collection as a surrogate variable and try to identify the unknown variables by modeling gradual and sudden…

Methodology · Statistics 2023-10-12 V. Roshan Joseph , William E. Lewis , Henry S. Yuchi , Kathryn A. Maupin

This paper considers a non-stationary dynamic factor model for large datasets to disentangle long-run from short-run co-movements. We first propose a new Quasi Maximum Likelihood estimator of the model based on the Kalman Smoother and the…

Methodology · Statistics 2017-11-08 Matteo Barigozzi , Matteo Luciani

We study a novel large dimensional approximate factor model with regime changes in the loadings driven by a latent first order Markov process. By exploiting the equivalent linear representation of the model, we first recover the latent…

Econometrics · Economics 2024-12-04 Matteo Barigozzi , Daniele Massacci

Matrix factorization from a small number of observed entries has recently garnered much attention as the key ingredient of successful recommendation systems. One unresolved problem in this area is how to adapt current methods to handle…

Machine Learning · Computer Science 2012-08-07 John Z. Sun , Kush R. Varshney , Karthik Subbian

In recent years, computational power and data availability breakthroughs have revolutionized our ability to analyze complex physical systems through the inverse problem approach. Data-driven techniques like system identification and machine…

Systems and Control · Electrical Eng. & Systems 2026-05-04 Sriram Narayanan , Mohamed Naveed Gul Mohamed , Ishan Paranjape , Indranil Nayak , Suman Chakravorty , Mrinal Kumar

High-dimensional multivariate spatial-temporal data arise frequently in a wide range of applications; however, there are relatively few statistical methods that can simultaneously deal with spatial, temporal and variable-wise dependencies…

Methodology · Statistics 2020-02-05 Elynn Y. Chen , Xin Yun , Rong Chen , Qiwei Yao

Latent factor models are widely used in the social and behavioral science as scaling tools to map discrete multivariate outcomes into low dimensional, continuous scales. In political science, dynamic versions of classical factor models have…

Applications · Statistics 2026-01-28 Rayleigh Lei , Abel Rodriguez

We propose modeling raw functional data as a mixture of a smooth function and a high-dimensional factor component. The conventional approach to retrieving the smooth function from the raw data is through various smoothing techniques.…

Methodology · Statistics 2022-04-13 Yuan Gao , Han Lin Shang , Yanrong Yang

This paper introduces a new spatial scan statistic designed to adjust cluster detection for longitudinal confounding factors indexed in space. The functional-model-adjusted statistic was developed using generalized functional linear models…

Methodology · Statistics 2019-03-05 Michael Genin , Mohamed-Salem Ahmed

This paper considers a structural-factor approach to modeling high-dimensional time series and space-time data by decomposing individual series into trend, seasonal, and irregular components. For ease in analyzing many time series, we…

Methodology · Statistics 2019-03-19 Zhaoxing Gao , Ruey S Tsay

In this work, we develop a scalable approach for a flexible latent factor model for high-dimensional dynamical systems. Each latent factor process has its own correlation and variance parameters, and the orthogonal factor loading matrix can…

Computation · Statistics 2025-06-23 Yizi Lin , Xubo Liu , Paul Segall , Mengyang Gu

Understanding the how the distribution of an economic outcome, such as income, changes with respect to space and covariates is a key concern for policy makers. To address this, we develop a Bayesian nonparametric model, the Normalised…

Methodology · Statistics 2026-04-28 Ziyou Wang , Jim Griffin , Maria Kalli

Dynamic factor models have been developed out of the need of analyzing and forecasting time series in increasingly high dimensions. While mathematical statisticians faced with inference problems in high-dimensional observation spaces were…

Econometrics · Economics 2024-01-03 Matteo Barigozzi , Marc Hallin

In this article, we formulate and analyze a new non-linear mathematical model to describe the dynamics of unemployment with a discouraged working population. We consider five dynamic variables, namely, unskilled unemployed individuals,…

Physics and Society · Physics 2026-01-13 Poushali Das , Shraddha Sachan , Mukul Chauhan , Narendra Kumar , Amit K. Verma

The paper proposes a latent variable model for binary data coming from an unobserved heterogeneous population. The heterogeneity is taken into account by replacing the traditional assumption of Gaussian distributed factors by a finite…

Methodology · Statistics 2010-10-13 Silvia Cagnone , Cinzia Viroli

The use of data-driven decision support by public agencies is becoming more widespread and already influences the allocation of public resources. This raises ethical concerns, as it has adversely affected minorities and historically…

Machine Learning · Computer Science 2023-02-03 Sebastian Scher , Simone Kopeinik , Andreas Trügler , Dominik Kowald

We propose a new estimator for the Generalised Dynamic Factor Model (GDFM) that simplifies estimation by avoiding frequency-domain methods. Our key theoretical insight shows that under reasonable conditions the dynamic common component can…

Econometrics · Economics 2026-05-08 Philipp Gersing