English

Missing-Data-Induced Phase Transitions in Spectral PLS for Multimodal Learning

Machine Learning 2026-05-18 v2 Machine Learning

Abstract

Partial Least Squares (PLS) learns shared structure from paired data via the top singular vectors of the empirical cross-covariance (PLS-SVD), but multimodal datasets often have missing entries in both views. We study PLS-SVD under independent entry-wise missing-completely-at-random masking in a proportional high-dimensional spiked model. After appropriate normalization, the masked cross-covariance behaves like a spiked rectangular random matrix whose effective signal strength is attenuated by ρ\sqrt{\rho}, where ρ\rho is the joint entry retention probability. The replica-symmetric analysis predicts a sharp BBP-type phase transition: below a critical signal-to-noise threshold the leading singular vectors are asymptotically uninformative, while above it they achieve nontrivial alignment with the latent shared directions, with closed-form asymptotic overlap formulas. We also state a finite-rank extension as a conjecture, predicting that the same missingness-adjusted threshold applies componentwise when the latent spikes are separated. Simulations and semi-synthetic multimodal experiments agree with the predicted phase diagram and recovery curves across aspect ratios, signal strengths, and missingness levels.

Keywords

Cite

@article{arxiv.2601.21294,
  title  = {Missing-Data-Induced Phase Transitions in Spectral PLS for Multimodal Learning},
  author = {Anders Gjølbye and Ida Kargaard and Emma Kargaard and Lina Skerath and Lars Kai Hansen},
  journal= {arXiv preprint arXiv:2601.21294},
  year   = {2026}
}

Comments

Preprint

R2 v1 2026-07-01T09:25:04.279Z