English

Parametric RDT approach to computational gap of symmetric binary perceptron

Machine Learning 2026-01-16 v1 Disordered Systems and Neural Networks Information Theory Machine Learning math.IT Probability

Abstract

We study potential presence of statistical-computational gaps (SCG) in symmetric binary perceptrons (SBP) via a parametric utilization of \emph{fully lifted random duality theory} (fl-RDT) [96]. A structural change from decreasingly to arbitrarily ordered cc-sequence (a key fl-RDT parametric component) is observed on the second lifting level and associated with \emph{satisfiability} (αc\alpha_c) -- \emph{algorithmic} (αa\alpha_a) constraints density threshold change thereby suggesting a potential existence of a nonzero computational gap SCG=αcαaSCG=\alpha_c-\alpha_a. The second level estimate is shown to match the theoretical αc\alpha_c whereas the rr\rightarrow \infty level one is proposed to correspond to αa\alpha_a. For example, for the canonical SBP (κ=1\kappa=1 margin) we obtain αc1.8159\alpha_c\approx 1.8159 on the second and αa1.6021\alpha_a\approx 1.6021 (with converging tendency towards 1.59\sim 1.59 range) on the seventh level. Our propositions remarkably well concur with recent literature: (i) in [20] local entropy replica approach predicts αLE1.58\alpha_{LE}\approx 1.58 as the onset of clustering defragmentation (presumed driving force behind locally improving algorithms failures); (ii) in α0\alpha\rightarrow 0 regime we obtain on the third lifting level κ1.2385αalog(αa)\kappa\approx 1.2385\sqrt{\frac{\alpha_a}{-\log\left ( \alpha_a \right ) }} which qualitatively matches overlap gap property (OGP) based predictions of [43] and identically matches local entropy based predictions of [24]; (iii) cc-sequence ordering change phenomenology mirrors the one observed in asymmetric binary perceptron (ABP) in [98] and the negative Hopfield model in [100]; and (iv) as in [98,100], we here design a CLuP based algorithm whose practical performance closely matches proposed theoretical predictions.

Keywords

Cite

@article{arxiv.2601.10628,
  title  = {Parametric RDT approach to computational gap of symmetric binary perceptron},
  author = {Mihailo Stojnic},
  journal= {arXiv preprint arXiv:2601.10628},
  year   = {2026}
}
R2 v1 2026-07-01T09:06:21.538Z