English

A Computational Transition for Detecting Multivariate Shuffled Linear Regression by Low-Degree Polynomials

Machine Learning 2026-03-24 v2 Machine Learning Probability Statistics Theory Statistics Theory

Abstract

In this paper, we study the problem of multivariate shuffled linear regression, where the correspondence between predictors and responses in a linear model is obfuscated by a latent permutation. Specifically, we investigate the model Y=11+σ2(ΠXQ+σZ)Y=\tfrac{1}{\sqrt{1+\sigma^2}}(\Pi_* X Q_* + \sigma Z), where XX is an ndn*d standard Gaussian design matrix, ZZ is an nmn*m Gaussian noise matrix, Π\Pi_* is an unknown nnn*n permutation matrix, and QQ_* is an unknown dmd*m on the Grassmanian manifold satisfying QQ=ImQ_*^{\top} Q_* = \mathbb I_m. Consider the hypothesis testing problem of distinguishing this model from the case where XX and YY are independent Gaussian random matrices of sizes ndn*d and nmn*m, respectively. Our results reveal a phase transition phenomenon in the performance of low-degree polynomial algorithms for this task. (1) When m=o(d)m=o(d), we show that all degree-DD polynomials fail to distinguish these two models even when σ=0\sigma=0, provided with D4=o(dm)D^4=o\big( \tfrac{d}{m} \big). (2) When m=dm=d and σ=ω(1)\sigma=\omega(1), we show that all degree-DD polynomials fail to distinguish these two models provided with D=o(σ)D=o(\sigma). (3) When m=dm=d and σ=o(1)\sigma=o(1), we show that there exists a constant-degree polynomial that strongly distinguish these two models. These results establish a smooth transition in the effectiveness of low-degree polynomial algorithms for this problem, highlighting the interplay between the dimensions mm and dd, the noise level σ\sigma, and the computational complexity of the testing task.

Keywords

Cite

@article{arxiv.2504.03097,
  title  = {A Computational Transition for Detecting Multivariate Shuffled Linear Regression by Low-Degree Polynomials},
  author = {Zhangsong Li},
  journal= {arXiv preprint arXiv:2504.03097},
  year   = {2026}
}

Comments

27 pages; improved exposition

R2 v1 2026-06-28T22:46:06.351Z