English

Cross-RAG: Zero-Shot Retrieval-Augmented Time Series Forecasting via Cross-Attention

Machine Learning 2026-03-17 v1

Abstract

Recent advances in time series foundation models (TSFMs) demonstrate strong expressive capacity through large-scale pretraining across diverse time series domains. Zero-shot time series forecasting with TSFMs, however, exhibits limited generalization to unseen datasets, which retrieval-augmented forecasting addresses by leveraging an external knowledge base. Existing approaches rely on a fixed number of retrieved samples that may introduce irrelevant information. To this end, we propose Cross-RAG, a zero-shot retrieval-augmented forecasting framework that selectively attends to query-relevant retrieved samples. Cross-RAG models input-level relevance between the query and retrieved samples via query-retrieval cross-attention, while jointly incorporating information from the query and retrieved samples. Extensive experiments demonstrate that Cross-RAG consistently improves zero-shot forecasting performance across various TSFMs and RAG methods, and additional analyses confirm its effectiveness across diverse retrieval scenarios. Code is available at https://github.com/seunghan96/cross-rag/.

Keywords

Cite

@article{arxiv.2603.14709,
  title  = {Cross-RAG: Zero-Shot Retrieval-Augmented Time Series Forecasting via Cross-Attention},
  author = {Seunghan Lee and Jaehoon Lee and Jun Seo and Sungdong Yoo and Minjae Kim and Tae Yoon Lim and Dongwan Kang and Hwanil Choi and SoonYoung Lee and Wonbin Ahn},
  journal= {arXiv preprint arXiv:2603.14709},
  year   = {2026}
}
R2 v1 2026-07-01T11:21:13.346Z