English

KEDformer:Knowledge Extraction Seasonal Trend Decomposition for Long-term Sequence Prediction

Machine Learning 2024-12-10 v1 Artificial Intelligence Machine Learning

Abstract

Time series forecasting is a critical task in domains such as energy, finance, and meteorology, where accurate long-term predictions are essential. While Transformer-based models have shown promise in capturing temporal dependencies, their application to extended sequences is limited by computational inefficiencies and limited generalization. In this study, we propose KEDformer, a knowledge extraction-driven framework that integrates seasonal-trend decomposition to address these challenges. KEDformer leverages knowledge extraction methods that focus on the most informative weights within the self-attention mechanism to reduce computational overhead. Additionally, the proposed KEDformer framework decouples time series into seasonal and trend components. This decomposition enhances the model's ability to capture both short-term fluctuations and long-term patterns. Extensive experiments on five public datasets from energy, transportation, and weather domains demonstrate the effectiveness and competitiveness of KEDformer, providing an efficient solution for long-term time series forecasting.

Keywords

Cite

@article{arxiv.2412.05421,
  title  = {KEDformer:Knowledge Extraction Seasonal Trend Decomposition for Long-term Sequence Prediction},
  author = {Zhenkai Qin and Baozhong Wei and Caifeng Gao and Jianyuan Ni},
  journal= {arXiv preprint arXiv:2412.05421},
  year   = {2024}
}
R2 v1 2026-06-28T20:26:13.842Z