English

Learning under Distributional Drift: Prequential Reproducibility as an Intrinsic Statistical Resource

Machine Learning 2026-05-19 v4 Machine Learning

Abstract

Statistical learning under distributional drift remains poorly characterized, especially in closed-loop settings where learning alters the data-generating law. We introduce an intrinsic drift budget CTC_T that quantifies cumulative information-geometric motion of the data distribution along the realized learner-environment trajectory, measured in Fisher-Rao distance. The budget separates exogenous environmental change from policy-sensitive feedback induced by the learner's actions. This gives a rate-based characterization of prequential reproducibility: when performance on the realized stream is used to predict one-step-ahead performance under the next distribution, the drift contribution enters through the average motion rate CT/TC_T/T, not through cumulative drift alone. We prove a drift-feedback bound of order T1/2+CT/TT^{-1/2}+C_T/T, up to controlled second-order remainder terms, and establish a matching sharpness lower bound for the same prequential reproducibility gap on a canonical regular subclass. Thus the dependence on the average Fisher-Rao motion rate is tight up to constants: CT/TC_T/T is sufficient for upper control and unavoidable on regular hard subclasses. We further prove an information-theoretic indistinguishability result showing that order-C/TC/T effects on the one-step-ahead target need not be identifiable from the realized performance stream alone. Finally, we show that fixed monitoring channels induce contracted observable Fisher motion, and experiments, including a misspecified real-data feedback setting, indicate that appropriately chosen channels can retain risk-relevant drift signal when the intrinsic data-generating law is unavailable. The resulting theory treats exogenous drift, adaptive data analysis, and performative feedback as different sources of Fisher-Rao motion along the same learner-environment trajectory.

Keywords

Cite

@article{arxiv.2512.13506,
  title  = {Learning under Distributional Drift: Prequential Reproducibility as an Intrinsic Statistical Resource},
  author = {Sofiya Zaichyk},
  journal= {arXiv preprint arXiv:2512.13506},
  year   = {2026}
}

Comments

Revised: Added additional experiment. Clarified lower bound

R2 v1 2026-07-01T08:25:35.514Z