English

Deep TPC: Temporal-Prior Conditioning for Time Series Forecasting

Machine Learning 2026-02-19 v1

Abstract

LLM-for-time series (TS) methods typically treat time shallowly, injecting positional or prompt-based cues once at the input of a largely frozen decoder, which limits temporal reasoning as this information degrades through the layers. We introduce Temporal-Prior Conditioning (TPC), which elevates time to a first-class modality that conditions the model at multiple depths. TPC attaches a small set of learnable time series tokens to the patch stream; at selected layers these tokens cross-attend to temporal embeddings derived from compact, human-readable temporal descriptors encoded by the same frozen LLM, then feed temporal context back via self-attention. This disentangles time series signal and temporal information while maintaining a low parameter budget. We show that by training only the cross-attention modules and explicitly disentangling time series signal and temporal information, TPC consistently outperforms both full fine-tuning and shallow conditioning strategies, achieving state-of-the-art performance in long-term forecasting across diverse datasets. Code available at: https://github.com/fil-mp/Deep_tpc

Keywords

Cite

@article{arxiv.2602.16188,
  title  = {Deep TPC: Temporal-Prior Conditioning for Time Series Forecasting},
  author = {Filippos Bellos and NaveenJohn Premkumar and Yannis Avrithis and Nam H. Nguyen and Jason J. Corso},
  journal= {arXiv preprint arXiv:2602.16188},
  year   = {2026}
}

Comments

Accepted to ICASSP 2026

R2 v1 2026-07-01T10:40:51.530Z