Online learning of smooth functions on $\mathbb{R}$
Abstract
We study adversarial online learning of real-valued functions on . In each round the learner is queried at , predicts , and then observes the true value ; performance is measured by cumulative -loss . For the class we show that the standard model becomes ill-posed on : for every and , an adversary can force infinite loss. Motivated by this obstruction, we analyze three modified learning scenarios that limit the influence of queries that are far from previously observed inputs. In Scenario 1 the adversary must choose each new query within distance of some past query. In Scenario 2 the adversary may query anywhere, but the learner is penalized only on rounds whose query lies within distance of a past query. In Scenario 3 the loss in round is multiplied by a weight . We obtain sharp characterizations for Scenarios 1-2 in several regimes. For Scenario 3 we identify a clean threshold phenomenon: if decays too slowly, then the adversary can force infinite weighted loss. In contrast, for rapidly decaying weights such as we obtain finite and sharp guarantees in the quadratic case . Finally, we study a natural multivariable slice generalization of on and show a sharp dichotomy: while the one-dimensional case admits finite opt-values in certain regimes, for every the slice class is too permissive, and even under Scenarios 1-3 an adversary can force infinite loss.
Keywords
Cite
@article{arxiv.2604.03525,
title = {Online learning of smooth functions on $\mathbb{R}$},
author = {Jesse Geneson and Kuldeep Singh and Alexander Wang},
journal= {arXiv preprint arXiv:2604.03525},
year = {2026}
}