English

Robust bilinear factor analysis based on the matrix-variate $t$ distribution

Machine Learning 2024-01-05 v1 Machine Learning

Abstract

Factor Analysis based on multivariate tt distribution (ttfa) is a useful robust tool for extracting common factors on heavy-tailed or contaminated data. However, ttfa is only applicable to vector data. When ttfa is applied to matrix data, it is common to first vectorize the matrix observations. This introduces two challenges for ttfa: (i) the inherent matrix structure of the data is broken, and (ii) robustness may be lost, as vectorized matrix data typically results in a high data dimension, which could easily lead to the breakdown of ttfa. To address these issues, starting from the intrinsic matrix structure of matrix data, a novel robust factor analysis model, namely bilinear factor analysis built on the matrix-variate tt distribution (ttbfa), is proposed in this paper. The novelty is that it is capable to simultaneously extract common factors for both row and column variables of interest on heavy-tailed or contaminated matrix data. Two efficient algorithms for maximum likelihood estimation of ttbfa are developed. Closed-form expression for the Fisher information matrix to calculate the accuracy of parameter estimates are derived. Empirical studies are conducted to understand the proposed ttbfa model and compare with related competitors. The results demonstrate the superiority and practicality of ttbfa. Importantly, ttbfa exhibits a significantly higher breakdown point than ttfa, making it more suitable for matrix data.

Keywords

Cite

@article{arxiv.2401.02203,
  title  = {Robust bilinear factor analysis based on the matrix-variate $t$ distribution},
  author = {Xuan Ma and Jianhua Zhao and Changchun Shang and Fen Jiang and Philip L. H. Yu},
  journal= {arXiv preprint arXiv:2401.02203},
  year   = {2024}
}
R2 v1 2026-06-28T14:08:35.045Z