English

Reasoning-Aware Training for Time Series Forecasting

Machine Learning 2026-05-12 v1 Artificial Intelligence

Abstract

Time Series Foundation Models (TSFMs) excel at numerical forecasting but operate as black boxes lacking qualitative reasoning. Conversely, applying LLMs directly to temporal data introduces a modality gap: text tokenizers fragment continuous numerical values, degrading mathematical relationships and exploding sequence lengths, leading to computational overhead. To resolve this, we introduce STRIDE (Strategic Time-series Reasoning Injected via Distilled Embeddings), a novel framework natively integrating LLM reasoning into the continuous embedding space of TSFMs. Instead of discrete tokens, STRIDE distills reasoning traces into a lightweight LLM, dynamically projecting its mean-pooled hidden states as a cross-modal prior into the target numerical encoder. The architecture is jointly optimized using cross-entropy and quantile losses. Evaluations demonstrate STRIDE establishes state-of-the-art numerical forecasting on GIFT-Eval (0.674 MASE, 0.454 CRPS) compared to TSFMs and exhibits superior in-domain and out-of-domain numerical as well as reasoning performance on TFRBench. Specifically, STRIDE acts as a plug-and-play enhancement, consistently improving diverse TSFMs (e.g., Chronos-2, Timer-S1) across various LLM configurations. Thus, injecting semantic reasoning as a continuous prior equips TSFMs with human-interpretable reasoning while fundamentally improving predictive accuracy.

Keywords

Cite

@article{arxiv.2605.08625,
  title  = {Reasoning-Aware Training for Time Series Forecasting},
  author = {Md Atik Ahamed and Mihir Parmar and Palash Goyal and Chun-Liang Li and Qiang Cheng and Tomas Pfister and Jinsung Yoon},
  journal= {arXiv preprint arXiv:2605.08625},
  year   = {2026}
}
R2 v1 2026-07-01T12:59:24.804Z