English

UniMamba: A Unified Spatial-Temporal Modeling Framework with State-Space and Attention Integration

Machine Learning 2026-05-15 v2 Artificial Intelligence

Abstract

Multivariate time series forecasting is fundamental to numerous domains such as energy, finance, and environmental monitoring, where complex temporal dependencies and cross-variable interactions pose enduring challenges. Existing Transformer-based methods capture temporal correlations through attention mechanisms but suffer from quadratic computational cost, while state-space models like Mamba achieve efficient long-context modeling yet lack explicit temporal pattern recognition. Therefore we introduce UniMamba, a unified spatial-temporal forecasting framework that integrates efficient state-space dynamics with attention-based dependency learning. UniMamba employs a Mamba Variate-Channel Encoding Layer enhanced with FFT-Laplace Transform and TCN to capture global temporal dependencies, and a Spatial Temporal Attention Layer to jointly model inter-variate correlations and temporal evolution. A Feedforward Temporal Dynamics Layer further fuses continuous and discrete contexts for accurate forecasting. Comprehensive experiments on eight public benchmark datasets demonstrate that UniMamba consistently outperforms state-of-the-art forecasting models in both forecasting accuracy and computational efficiency, establishing a scalable and robust solution for long-sequence multivariate time-series prediction.

Keywords

Cite

@article{arxiv.2604.16325,
  title  = {UniMamba: A Unified Spatial-Temporal Modeling Framework with State-Space and Attention Integration},
  author = {Xingsheng Chen and Xianpei Mu and Deyu Yi and Yilin Yuan and Xingwei He and Bo Gao and Regina Zhang and Pietro Lio and Siu-Ming Yiu},
  journal= {arXiv preprint arXiv:2604.16325},
  year   = {2026}
}

Comments

The authors wish to withdraw this preprint due to a lack of consensus regarding the final authorship list and the order of authors

R2 v1 2026-07-01T12:14:49.475Z