English
Related papers

Related papers: A two-way factor model for high-dimensional matrix…

200 papers

In this paper, we focus on exploiting the group structure for large-dimensional factor models, which captures the homogeneous effects of common factors on individuals within the same group. In view of the fact that datasets in…

Methodology · Statistics 2024-05-14 Yong He , Xiaoyang Ma , Xingheng Wang , Yalin Wang

This work considers Maximum Likelihood Estimation (MLE) of a Toeplitz structured covariance matrix. In this regard, an equivalent reformulation of the MLE problem is introduced and two iterative algorithms are proposed for the optimization…

Signal Processing · Electrical Eng. & Systems 2025-05-13 Augusto Aubry , Prabhu Babu , Antonio De Maio , Massimo Rosamilia

We propose a combined model, which integrates the latent factor model and the logistic regression model, for the citation network. It is noticed that neither a latent factor model nor a logistic regression model alone is sufficient to…

Machine Learning · Statistics 2019-12-03 Namjoon Suh , Xiaoming Huo , Eric Heim , Lee Seversky

We introduce a new family of one factor distributions for high-dimensional binary data. The model provides an explicit probability for each event, thus avoiding the numeric approximations often made by existing methods. Model interpretation…

Methodology · Statistics 2015-11-05 Matthieu Marbac , Mohammed Sedki

In high-dimensional classification problems, a commonly used approach is to first project the high-dimensional features into a lower dimensional space, and base the classification on the resulting lower dimensional projections. In this…

Statistics Theory · Mathematics 2025-08-05 Xin Bing , Marten Wegkamp

This paper presents a machine learning approach to multidimensional item response theory (MIRT), a class of latent factor models that can be used to model and predict student performance from observed assessment data. Inspired by…

Machine Learning · Statistics 2025-01-08 Yoav Bergner , Peter F. Halpin , Jill-Jênn Vie

Factor analysis for high-dimensional data is a canonical problem in statistics and has a wide range of applications. However, there is currently no factor model tailored to effectively analyze high-dimensional count responses with…

Methodology · Statistics 2024-08-21 Wei Liu , Qingzhi Zhong

High-dimensional and sparse (HiDS) matrices are omnipresent in a variety of big data-related applications. Latent factor analysis (LFA) is a typical representation learning method that extracts useful yet latent knowledge from HiDS matrices…

Machine Learning · Computer Science 2022-04-19 Di Wu , Peng Zhang , Yi He , Xin Luo

Applications of structural equation models (SEMs) are often restricted to linear associations between variables. Maximum likelihood (ML) estimation in non-linear models may be complex and require numerical integration. Furthermore, ML…

Methodology · Statistics 2019-03-15 Klaus Kähler Holst , Esben Budtz-Jørgensen

We examine a special case of the multilevel factor model, with covariance given by multilevel low rank (MLR) matrix~\cite{parshakova2023factor}. We develop a novel, fast implementation of the expectation-maximization algorithm, tailored for…

Machine Learning · Statistics 2025-08-26 Tetiana Parshakova , Trevor Hastie , Stephen Boyd

Matrix factor model is drawing growing attention for simultaneous two-way dimension reduction of well-structured matrix-valued observations. This paper focuses on robust statistical inference for matrix factor model in the ``diverging…

Methodology · Statistics 2023-06-07 Yong He , Xin-Bing Kong , Dong Liu , Ran Zhao

Matrix-variate data of high dimensions are frequently observed in finance and economics, spanning extended time periods, such as the long-term data on international trade flows among numerous countries. To address potential structural…

Methodology · Statistics 2024-04-03 Bin Chen , Elynn Y. Chen , Stevenson Bolivar , Rong Chen

Maximum likelihood (ML) estimation is widely used in statistics. The h-likelihood has been proposed as an extension of Fisher's likelihood to statistical models including unobserved latent variables of recent interest. Its advantage is that…

Methodology · Statistics 2022-07-21 Jeongseop Han , Youngjo Lee , Jae Kwang Kim

In a very high-dimensional vector space, two randomly-chosen vectors are almost orthogonal with high probability. Starting from this observation, we develop a statistical factor model, the random factor model, in which factors are chosen at…

Statistical Finance · Quantitative Finance 2018-12-27 Antti J. Tanskanen , Jani Lukkarinen , Kari Vatanen

Multidimensional scaling visualizes dissimilarities among objects and reduces data dimensionality. While many methods address symmetric proximity data, asymmetric and especially three-way proximity data (capturing relationships across…

Methodology · Statistics 2025-11-21 Aleix Alcacer , Rafael Benitez , Vicente J. Bolos , Irene Epifanio

This paper proposes a quasi-maximum likelihood (QML) estimator for break points in high-dimensional factor models, specifically accounting for multiple structural breaks. We begin by establishing a necessary and sufficient condition to…

Econometrics · Economics 2026-04-20 Jiangtao Duan , Jushan Bai , Xu Han

This paper develops a unified estimation framework, the Maximum Ideal Likelihood Estimation (MILE), for general parametric models with latent variables. Unlike traditional approaches relying on the marginal likelihood of the observed data,…

Statistics Theory · Mathematics 2025-10-08 Yizhou Cai , Ting Fung Ma

We propose a distributed computing framework, based on a divide and conquer strategy and hierarchical modeling, to accelerate posterior inference for high-dimensional Bayesian factor models. Our approach distributes the task of…

Methodology · Statistics 2016-12-30 Gautam Sabnis , Debdeep Pati , Barbara Engelhardt , Natesh Pillai

Over the past decades, there has been a surge of interest in studying low-dimensional structures within high-dimensional data. Statistical factor models $-$ i.e., low-rank plus diagonal covariance structures $-$ offer a powerful framework…

Machine Learning · Statistics 2025-05-20 Daniel Cederberg

As is known, factor analysis is a popular method to reduce dimension for high-dimensional data. For matrix data, the dimension reduction can be more effectively achieved through both row and column directions. In this paper, we introduce a…

Methodology · Statistics 2019-04-17 Xialu Liu , Elynn Chen