English

Convergence of the majorized PAM method with subspace correction for low-rank composite factorization model

Optimization and Control 2025-10-08 v3 Machine Learning

Abstract

This paper focuses on the convergence certificates of the majorized proximal alternating minimization (PAM) method with subspace correction, proposed in \cite{TaoQianPan22} for the column 2,0\ell_{2,0}-norm regularized factorization model and now extended to a class of low-rank composite factorization models from matrix completion. The convergence analysis of this PAM method becomes extremely challenging because a subspace correction step is introduced to every proximal subproblem to ensure a closed-form solution. We establish the full convergence of the iterate sequence and column subspace sequences of factor pairs generated by the PAM, under the KL property of the objective function and a condition that holds automatically for the column 2,0\ell_{2,0}-norm function. Numerical comparison with the popular proximal alternating linearized minimization (PALM) method is conducted on one-bit matrix completion problems, which indicates that the PAM with subspace correction has an advantage in seeking lower relative error within less time.

Keywords

Cite

@article{arxiv.2406.04588,
  title  = {Convergence of the majorized PAM method with subspace correction for low-rank composite factorization model},
  author = {Ting Tao and Yitian Qian and Shaohua Pan},
  journal= {arXiv preprint arXiv:2406.04588},
  year   = {2025}
}

Comments

34 pages

R2 v1 2026-06-28T16:56:44.605Z