English

Immediate Derivatives Suffice for Online Recurrent Adaptation

Machine Learning 2026-04-29 v3

Abstract

For three decades online recurrent learning has been assumed to require propagating a Jacobian tensor through the network's dynamics at O(n4)O(n^4) per step. We show it doesn't. Dropping the propagation entirely (d=0d=0, O(n2)O(n^2) memory) matches full RTRL within CI on held-out BCI cross-session drift (TOST equivalent within ±3\pm 3 pp at n=20n=20, Adam, float64), and across vanilla-RNN synthetic cells (sine and Lorenz under Adam and SGD) and LSTM/sine under Adam. A decomposition gRTRL=gimm+gpastg_{RTRL} = g_{imm} + g_{past} explains why. On BCI, gpastg_{past} concentrates in a single direction (top-1 singular fraction 0.62-0.74 across four optimizers, vs 0.333 for gimmg_{imm}), and the four-optimizer full-RTRL-vs-d=0d=0 recovery gap tracks each optimizer's per-layer update-magnitude ratio ΔWhh/ΔWout\|\Delta W_{hh}\|/\|\Delta W_{out}\| monotonically. A stationary (no-drift) control collapses both concentrations to ~0.6: the drift-specific signal is the differential, not gpastg_{past}'s absolute rank-1 structure. The signature and the behavioral gap both collapse on LSTM, consistent with a mechanism specific to additive linear recurrence. On synthetic sine, gimmg_{imm} is redundant with gpastg_{past}, which predicts the synthetic null. Full RTRL's one robust advantage is LARS (+17 to +27 pp), but d=0d=0+LARS also fails to adapt independently; the gap is an optimizer×\timesmethod interaction, not a method-quality claim. We characterize the regime: d=0d=0+Adam+float64 is robust; SGD, Adafactor, and float32 have specific fragilities documented in the paper. On the evaluated cells, the 1000×1000\times memory saving at n=1024n=1024 (O(n2)O(n^2) vs O(n4)O(n^4)) comes with no measured recovery cost.

Cite

@article{arxiv.2603.28750,
  title  = {Immediate Derivatives Suffice for Online Recurrent Adaptation},
  author = {Aur Shalev Merin},
  journal= {arXiv preprint arXiv:2603.28750},
  year   = {2026}
}

Comments

25 pages, 4 figures, 19 tables. Submitted to NeurIPS 2026

R2 v1 2026-07-01T11:44:35.424Z