English

Online learning of smooth functions on $\mathbb{R}$

Machine Learning 2026-04-07 v1

Abstract

We study adversarial online learning of real-valued functions on R\mathbb{R}. In each round the learner is queried at xtRx_t\in\mathbb{R}, predicts y^t\hat y_t, and then observes the true value f(xt)f(x_t); performance is measured by cumulative pp-loss t1y^tf(xt)p\sum_{t\ge 1}|\hat y_t-f(x_t)|^p. For the class Gq={f:RR absolutely continuous: Rf(x)qdx1}, \mathcal{G}_q=\Bigl\{f:\mathbb{R}\to\mathbb{R}\ \text{absolutely continuous}:\ \int_{\mathbb{R}}|f'(x)|^q\,dx\le 1\Bigr\}, we show that the standard model becomes ill-posed on R\mathbb{R}: for every p1p\ge 1 and q>1q>1, an adversary can force infinite loss. Motivated by this obstruction, we analyze three modified learning scenarios that limit the influence of queries that are far from previously observed inputs. In Scenario 1 the adversary must choose each new query within distance 11 of some past query. In Scenario 2 the adversary may query anywhere, but the learner is penalized only on rounds whose query lies within distance 11 of a past query. In Scenario 3 the loss in round tt is multiplied by a weight g(minj<txtxj)g(\min_{j<t}|x_t-x_j|). We obtain sharp characterizations for Scenarios 1-2 in several regimes. For Scenario 3 we identify a clean threshold phenomenon: if gg decays too slowly, then the adversary can force infinite weighted loss. In contrast, for rapidly decaying weights such as g(z)=eczg(z)=e^{-cz} we obtain finite and sharp guarantees in the quadratic case p=q=2p=q=2. Finally, we study a natural multivariable slice generalization Gq,d\mathcal{G}_{q,d} of Gq\mathcal{G}_q on Rd\mathbb{R}^d and show a sharp dichotomy: while the one-dimensional case admits finite opt-values in certain regimes, for every d2d\ge 2 the slice class Gq,d\mathcal{G}_{q,d} is too permissive, and even under Scenarios 1-3 an adversary can force infinite loss.

Keywords

Cite

@article{arxiv.2604.03525,
  title  = {Online learning of smooth functions on $\mathbb{R}$},
  author = {Jesse Geneson and Kuldeep Singh and Alexander Wang},
  journal= {arXiv preprint arXiv:2604.03525},
  year   = {2026}
}
R2 v1 2026-07-01T11:53:35.573Z