English

Learning Pattern-Specific Experts for Time Series Forecasting Under Patch-level Distribution Shift

Machine Learning 2025-10-02 v2 Machine Learning

Abstract

Time series forecasting, which aims to predict future values based on historical data, has garnered significant attention due to its broad range of applications. However, real-world time series often exhibit complex non-uniform distribution with varying patterns across segments, such as season, operating condition, or semantic meaning, making accurate forecasting challenging. Existing approaches, which typically train a single model to capture all these diverse patterns, often struggle with the pattern drifts between patches and may lead to poor generalization. To address these challenges, we propose TFPS, a novel architecture that leverages pattern-specific experts for more accurate and adaptable time series forecasting. TFPS employs a dual-domain encoder to capture both time-domain and frequency-domain features, enabling a more comprehensive understanding of temporal dynamics. It then uses subspace clustering to dynamically identify distinct patterns across data patches. Finally, pattern-specific experts model these unique patterns, delivering tailored predictions for each patch. By explicitly learning and adapting to evolving patterns, TFPS achieves significantly improved forecasting accuracy. Extensive experiments on real-world datasets demonstrate that TFPS outperforms state-of-the-art methods, particularly in long-term forecasting, through its dynamic and pattern-aware learning approach. The data and codes are available: https://github.com/syrGitHub/TFPS.

Keywords

Cite

@article{arxiv.2410.09836,
  title  = {Learning Pattern-Specific Experts for Time Series Forecasting Under Patch-level Distribution Shift},
  author = {Yanru Sun and Zongxia Xie and Emadeldeen Eldele and Dongyue Chen and Qinghua Hu and Min Wu},
  journal= {arXiv preprint arXiv:2410.09836},
  year   = {2025}
}
R2 v1 2026-06-28T19:19:30.634Z