English

Linear-Readout Floors and Threshold Recovery in Computation in Superposition

Machine Learning 2026-05-05 v1 Information Theory math.IT

Abstract

Two recent approaches to computation in superposition reach different recursive capacity regimes: H\"anni et al. certify O~(d3/2)\tilde{O}(d^{3/2}) computable features in width dd via an approximate-linear recursive template, while Adler and Shavit reach near-quadratic capacity (up to logarithmic factors) using thresholded Boolean recovery. The main contribution of this paper is conceptual: we argue these results are not contradictory because they maintain different interface invariants, and we formalize the distinction. As a tool, we record a rank-trace Welch-type lower bound for biorthogonal linear readouts: for FdF \gg d, the worst-case off-diagonal cross-talk of any unit-diagonal linear readout is Ω(d1/2)\Omega(d^{-1/2}), and the bound is tight on average for unit-norm tight frames. At quadratic feature load F=d2F=d^2, random-support threshold recovery succeeds for sparsities s=O(d/logd)s=O(d/\log d), while linear readouts still incur Ω(s/d)\Omega(s/d) average per-coordinate squared error on Bernoulli sparse states. Matching the Welch floor against the published tolerance of the H\"anni correction layer explains the d3/2d^{3/2} scale as a compatibility threshold for that template, not a universal upper bound. Robust nonlinear reset beyond the H\"anni template is left open.

Keywords

Cite

@article{arxiv.2605.01192,
  title  = {Linear-Readout Floors and Threshold Recovery in Computation in Superposition},
  author = {Hector Borobia and Elies Seguí-Mas and Guillermina Tormo-Carbó},
  journal= {arXiv preprint arXiv:2605.01192},
  year   = {2026}
}

Comments

38 pages, preprint, no figures; comments welcome

R2 v1 2026-07-01T12:46:12.330Z