English

PRISM: Structured Optimization via Anisotropic Spectral Shaping

Machine Learning 2026-02-04 v1 Artificial Intelligence

Abstract

We propose PRISM, an optimizer that enhances first-order spectral descent methods like Muon with partial second-order information. It constructs an efficient, low-rank quasi-second-order preconditioner via innovation-augmented polar decomposition. This mechanism enables PRISM to perform anisotropic spectral shaping, which adaptively suppresses updates in high-variance subspaces while preserving update strength in signal-dominated directions. Crucially, this is achieved with minimal computational overhead and zero additional memory compared to first-order baselines. PRISM demonstrates a practical strategy for integrating curvature-adaptive properties into the spectral optimization paradigm.

Keywords

Cite

@article{arxiv.2602.03096,
  title  = {PRISM: Structured Optimization via Anisotropic Spectral Shaping},
  author = {Yujie Yang},
  journal= {arXiv preprint arXiv:2602.03096},
  year   = {2026}
}
R2 v1 2026-07-01T09:33:28.791Z