English

Robust Subspace-Constrained Quadratic Models for Low-Dimensional Structure Learning

Machine Learning 2026-05-21 v1 Artificial Intelligence

Abstract

In this paper, we propose a robust subspace-constrained quadratic model (SCQM) for learning low-dimensional structure from high-dimensional data. Building upon the subspace-constrained quadratic matrix factorization (SQMF) framework, the proposed model accommodates a broad class of noise distributions, including generalized Gaussian and radial Laplace models. This generalization enables reliable performance under both heavy-tailed and light-tailed noise, thereby substantially enhancing robustness across diverse data regimes. To efficiently address the resulting nonconvex optimization problem, we develop a gradient-based algorithm equipped with a backtracking line-search strategy that ensures stable and efficient convergence. In addition, we present a sensitivity analysis of the pp\ell_p^p and 2\ell_2 loss functions, elucidating their distinct behaviors under varying noise characteristics. Extensive numerical experiments corroborate the theoretical analysis and demonstrate that the proposed approach consistently outperforms existing methods in terms of robustness and reconstruction accuracy.

Keywords

Cite

@article{arxiv.2605.20300,
  title  = {Robust Subspace-Constrained Quadratic Models for Low-Dimensional Structure Learning},
  author = {Zheng Zhai and Xiaohui Li},
  journal= {arXiv preprint arXiv:2605.20300},
  year   = {2026}
}