KEDformer:Knowledge Extraction Seasonal Trend Decomposition for Long-term Sequence Prediction
Abstract
Time series forecasting is a critical task in domains such as energy, finance, and meteorology, where accurate long-term predictions are essential. While Transformer-based models have shown promise in capturing temporal dependencies, their application to extended sequences is limited by computational inefficiencies and limited generalization. In this study, we propose KEDformer, a knowledge extraction-driven framework that integrates seasonal-trend decomposition to address these challenges. KEDformer leverages knowledge extraction methods that focus on the most informative weights within the self-attention mechanism to reduce computational overhead. Additionally, the proposed KEDformer framework decouples time series into seasonal and trend components. This decomposition enhances the model's ability to capture both short-term fluctuations and long-term patterns. Extensive experiments on five public datasets from energy, transportation, and weather domains demonstrate the effectiveness and competitiveness of KEDformer, providing an efficient solution for long-term time series forecasting.
Cite
@article{arxiv.2412.05421,
title = {KEDformer:Knowledge Extraction Seasonal Trend Decomposition for Long-term Sequence Prediction},
author = {Zhenkai Qin and Baozhong Wei and Caifeng Gao and Jianyuan Ni},
journal= {arXiv preprint arXiv:2412.05421},
year = {2024}
}