English
Related papers

Related papers: UniMamba: A Unified Spatial-Temporal Modeling Fram…

200 papers

Accurate traffic forecasting is crucial for intelligent transportation systems, supporting effective traffic management, congestion reduction, and informed urban planning. However, traditional models often fail to adequately capture the…

Artificial Intelligence · Computer Science 2026-04-21 Dongyi He , Yuanquan Gao , Bin Jiang , He Yan

Motion prediction is crucial for autonomous driving, as it enables accurate forecasting of future vehicle trajectories based on historical inputs. This paper introduces Trajectory Mamba, a novel efficient trajectory prediction framework…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Yizhou Huang , Yihua Cheng , Kezhi Wang

Recent advancements in unified multimodal understanding and visual generation (or multimodal generation) models have been hindered by their quadratic computational complexity and dependence on large-scale training data. We present…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jialv Zou , Bencheng Liao , Qian Zhang , Wenyu Liu , Xinggang Wang

Multimodal image fusion aims to integrate information from different imaging techniques to produce a comprehensive, detail-rich single image for downstream vision tasks. Existing methods based on local convolutional neural networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xinyu Xie , Yawen Cui , Tao Tan , Xubin Zheng , Zitong Yu

In recent years, Transformers have become the de-facto architecture for long-term sequence forecasting (LTSF), but faces challenges such as quadratic complexity and permutation invariant bias. A recent model, Mamba, based on selective state…

Machine Learning · Computer Science 2024-05-28 Xiuding Cai , Yaoyao Zhu , Xueyao Wang , Yu Yao

Time series prediction, a crucial task across various domains, faces significant challenges due to the inherent complexities of time series data, including non-stationarity, multi-scale periodicity, and transient dynamics, particularly when…

Machine Learning · Computer Science 2025-07-18 Qianru Zhang , Chenglei Yu , Haixin Wang , Yudong Yan , Yuansheng Cao , Siu-Ming Yiu , Tailin Wu , Hongzhi Yin

Existing RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture. Nonetheless, these methods mainly adopt imagepair appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Simiao Lai , Chang Liu , Jiawen Zhu , Ben Kang , Yang Liu , Dong Wang , Huchuan Lu

Accurate and efficient multivariate time series (MTS) analysis is increasingly critical for a wide range of intelligent applications. Within this realm, Transformers have emerged as the predominant architecture due to their strong ability…

Machine Learning · Computer Science 2026-05-19 Rui An , Haohao Qu , Wenqi Fan , Xuequn Shang , Qing Li

Transformer-based architectures have become the backbone of both uni-modal and multi-modal foundation models, largely due to their scalability via attention mechanisms, resulting in a rich ecosystem of publicly available pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Xiuwei Chen , Wentao Hu , Xiao Dong , Sihao Lin , Zisheng Chen , Meng Cao , Yina Zhuang , Jianhua Han , Hang Xu , Xiaodan Liang

Recent 2D CNN-based domain adaptation approaches struggle with long-range dependencies due to limited receptive fields, making it difficult to adapt to target domains with significant spatial distribution changes. While transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 A. Enes Doruk , Hasan F. Ates

Time series data plays a pivotal role in a wide variety of fields but faces challenges related to privacy concerns. Recently, synthesizing data via diffusion models is viewed as a promising solution. However, existing methods still struggle…

Machine Learning · Computer Science 2025-11-25 Zihao Yao , Jiankai Zuo , Yaying Zhang

Mamba is an effective state space model with linear computation complexity. It has recently shown impressive efficiency in dealing with high-resolution inputs across various vision tasks. In this paper, we reveal that the powerful Mamba…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Dongchen Han , Ziyi Wang , Zhuofan Xia , Yizeng Han , Yifan Pu , Chunjiang Ge , Jun Song , Shiji Song , Bo Zheng , Gao Huang

Mamba, a selective state-space model (SSM), has emerged as an efficient alternative to Transformers for speech modeling, enabling long-sequence processing with linear complexity. While effective in speech separation, existing approaches,…

Sound · Computer Science 2026-01-26 Ke Xue , Chang Sun , Rongfei Fan , Jing Wang , Han Hu

The electricity sector is undergoing substantial transformations due to the rising electrification of demand, enhanced integration of renewable energy resources, and the emergence of new technologies. These changes are rendering the…

Machine Learning · Computer Science 2025-12-23 Ali Menati , Fatemeh Doudi , Dileep Kalathil , Le Xie

State space models (SSMs) have emerged as an efficient alternative to Transformer models for language modeling, offering linear computational complexity and constant memory usage as context length increases. However, despite their…

Computation and Language · Computer Science 2025-04-23 Zhifan Ye , Kejing Xia , Yonggan Fu , Xin Dong , Jihoon Hong , Xiangchi Yuan , Shizhe Diao , Jan Kautz , Pavlo Molchanov , Yingyan Celine Lin

We introduce VideoMamba, a novel adaptation of the pure Mamba architecture, specifically designed for video recognition. Unlike transformers that rely on self-attention mechanisms leading to high computational costs by quadratic complexity,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jinyoung Park , Hee-Seon Kim , Kangwook Ko , Minbeom Kim , Changick Kim

Channel prediction is a key technology for improving the performance of various functions such as precoding, adaptive modulation, and resource allocation in MIMO-OFDM systems. Especially in high-mobility scenarios with fast time-varying…

Signal Processing · Electrical Eng. & Systems 2025-12-19 Sheng Luo , Jiashu Xie , Yueling Che , Junmei Yao , Jian Tian , Daquan Feng , Kaishun Wu

Recent advances in deep learning have made it possible to predict phenotypic measures directly from functional magnetic resonance imaging (fMRI) brain volumes, sparking significant interest in the neuroimaging community. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Arunkumar Kannan , Martin A. Lindquist , Brian Caffo

Modeling multivariate time series is a well-established problem with a wide range of applications from healthcare to financial markets. Traditional State Space Models (SSMs) are classical approaches for univariate time series modeling due…

Machine Learning · Computer Science 2024-06-07 Ali Behrouz , Michele Santacatterina , Ramin Zabih

Multivariate long-term and efficient time series forecasting is a key requirement for a variety of practical applications, and there are complex interleaving time dynamics in time series data that require decomposition modeling. Traditional…

Machine Learning · Computer Science 2025-06-11 Hang Ye , Gaoxiang Duan , Haoran Zeng , Yangxin Zhu , Lingxue Meng , Xiaoying Zheng , Yongxin Zhu