UniMamba: A Unified Spatial-Temporal Modeling Framework with State-Space and Attention Integration
Abstract
Multivariate time series forecasting is fundamental to numerous domains such as energy, finance, and environmental monitoring, where complex temporal dependencies and cross-variable interactions pose enduring challenges. Existing Transformer-based methods capture temporal correlations through attention mechanisms but suffer from quadratic computational cost, while state-space models like Mamba achieve efficient long-context modeling yet lack explicit temporal pattern recognition. Therefore we introduce UniMamba, a unified spatial-temporal forecasting framework that integrates efficient state-space dynamics with attention-based dependency learning. UniMamba employs a Mamba Variate-Channel Encoding Layer enhanced with FFT-Laplace Transform and TCN to capture global temporal dependencies, and a Spatial Temporal Attention Layer to jointly model inter-variate correlations and temporal evolution. A Feedforward Temporal Dynamics Layer further fuses continuous and discrete contexts for accurate forecasting. Comprehensive experiments on eight public benchmark datasets demonstrate that UniMamba consistently outperforms state-of-the-art forecasting models in both forecasting accuracy and computational efficiency, establishing a scalable and robust solution for long-sequence multivariate time-series prediction.
Cite
@article{arxiv.2604.16325,
title = {UniMamba: A Unified Spatial-Temporal Modeling Framework with State-Space and Attention Integration},
author = {Xingsheng Chen and Xianpei Mu and Deyu Yi and Yilin Yuan and Xingwei He and Bo Gao and Regina Zhang and Pietro Lio and Siu-Ming Yiu},
journal= {arXiv preprint arXiv:2604.16325},
year = {2026}
}
Comments
The authors wish to withdraw this preprint due to a lack of consensus regarding the final authorship list and the order of authors