English

DPANet: Dual Pyramid Attention Network for Multivariate Time Series Forecasting

Machine Learning 2025-09-22 v2 Artificial Intelligence

Abstract

Long-term time series forecasting (LTSF) is hampered by the challenge of modeling complex dependencies that span multiple temporal scales and frequency resolutions. Existing methods, including Transformer and MLP-based models, often struggle to capture these intertwined characteristics in a unified and structured manner. We propose the Dual Pyramid Attention Network (DPANet), a novel architecture that explicitly decouples and concurrently models temporal multi-scale dynamics and spectral multi-resolution periodicities. DPANet constructs two parallel pyramids: a Temporal Pyramid built on progressive downsampling, and a Frequency Pyramid built on band-pass filtering. The core of our model is the Cross-Pyramid Fusion Block, which facilitates deep, interactive information exchange between corresponding pyramid levels via cross-attention. This fusion proceeds in a coarse-to-fine hierarchy, enabling global context to guide local representation learning. Extensive experiments on public benchmarks show that DPANet achieves state-of-the-art performance, significantly outperforming prior models. Code is available at https://github.com/hit636/DPANet.

Keywords

Cite

@article{arxiv.2509.14868,
  title  = {DPANet: Dual Pyramid Attention Network for Multivariate Time Series Forecasting},
  author = {Qianyang Li and Xingjun Zhang and Shaoxun Wang and Jia Wei},
  journal= {arXiv preprint arXiv:2509.14868},
  year   = {2025}
}
R2 v1 2026-07-01T05:43:40.870Z