English

Completing Low-Rank Matrices with Corrupted Samples from Few Coefficients in General Basis

Information Theory 2016-11-18 v2 Machine Learning Numerical Analysis math.IT Numerical Analysis Machine Learning

Abstract

Subspace recovery from corrupted and missing data is crucial for various applications in signal processing and information theory. To complete missing values and detect column corruptions, existing robust Matrix Completion (MC) methods mostly concentrate on recovering a low-rank matrix from few corrupted coefficients w.r.t. standard basis, which, however, does not apply to more general basis, e.g., Fourier basis. In this paper, we prove that the range space of an m×nm\times n matrix with rank rr can be exactly recovered from few coefficients w.r.t. general basis, though rr and the number of corrupted samples are both as high as O(min{m,n}/log3(m+n))O(\min\{m,n\}/\log^3 (m+n)). Our model covers previous ones as special cases, and robust MC can recover the intrinsic matrix with a higher rank. Moreover, we suggest a universal choice of the regularization parameter, which is λ=1/logn\lambda=1/\sqrt{\log n}. By our 2,1\ell_{2,1} filtering algorithm, which has theoretical guarantees, we can further reduce the computational cost of our model. As an application, we also find that the solutions to extended robust Low-Rank Representation and to our extended robust MC are mutually expressible, so both our theory and algorithm can be applied to the subspace clustering problem with missing values under certain conditions. Experiments verify our theories.

Keywords

Cite

@article{arxiv.1506.07615,
  title  = {Completing Low-Rank Matrices with Corrupted Samples from Few Coefficients in General Basis},
  author = {Hongyang Zhang and Zhouchen Lin and Chao Zhang},
  journal= {arXiv preprint arXiv:1506.07615},
  year   = {2016}
}

Comments

To appear in IEEE Transactions on Information Theory

R2 v1 2026-06-22T09:59:54.198Z