English
Related papers

Related papers: CMamba: Channel Correlation Enhanced State Space M…

200 papers

In multichannel speech enhancement, effectively capturing spatial and spectral information across different microphones is crucial for noise reduction. Traditional methods, such as CNN or LSTM, attempt to model the temporal dynamics of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-15 Wenze Ren , Haibin Wu , Yi-Cheng Lin , Xuanjun Chen , Rong Chao , Kuo-Hsuan Hung , You-Jin Li , Wen-Yuan Ting , Hsin-Min Wang , Yu Tsao

Time series prediction plays a pivotal role across diverse domains such as finance, healthcare, energy systems, and environmental modeling. However, existing approaches often struggle to balance efficiency, scalability, and accuracy,…

Machine Learning · Computer Science 2026-01-13 Xingsheng Chen , Regina Zhang , Bo Gao , Xingwei He , Xiaofeng Liu , Pietro Lio , Kwok-Yan Lam , Siu-Ming Yiu

Selective state space models (SSMs), such as Mamba, highly excel at capturing long-range dependencies in 1D sequential data, while their applications to 2D vision tasks still face challenges. Current visual SSMs often convert images into 1D…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Chaodong Xiao , Minghan Li , Zhengqiang Zhang , Deyu Meng , Lei Zhang

Medical time series, such as electrocardiograms (ECG) and electroencephalograms (EEG), exhibit complex temporal dynamics and structured cross-channel dependencies, posing fundamental challenges for automated analysis. Conventional…

Signal Processing · Electrical Eng. & Systems 2026-05-08 ZhengXiao He , Huayu Li , Xiwen Chen , Janet M Roveda , Jinghao Wen , Siyuan Tian , Ao Li

This paper proposes a Mamba-assisted neural network framework incorporating self-attention mechanism to achieve improved channel estimation with low complexity for orthogonal frequency-division multiplexing (OFDM) waveforms, particularly…

Machine Learning · Computer Science 2026-01-27 Dianxin Luan , Chengsi Liang , Jie Huang , Zheng Lin , Kaitao Meng , John Thompson , Cheng-Xiang Wang

State space models (SSMs) have emerged as an efficient alternative to Transformer models for language modeling, offering linear computational complexity and constant memory usage as context length increases. However, despite their…

Computation and Language · Computer Science 2025-04-23 Zhifan Ye , Kejing Xia , Yonggan Fu , Xin Dong , Jihoon Hong , Xiangchi Yuan , Shizhe Diao , Jan Kautz , Pavlo Molchanov , Yingyan Celine Lin

State Space Model (SSM) is a mathematical model used to describe and analyze the behavior of dynamic systems. This model has witnessed numerous applications in several fields, including control theory, signal processing, economics and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Xiao Liu , Chenxu Zhang , Lei Zhang

Recently, state space models have exhibited strong global modeling capabilities and linear computational complexity in contrast to transformers. This research focuses on applying such architecture to more efficiently and effectively model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Tao Zhang , Haobo Yuan , Lu Qi , Jiangning Zhang , Qianyu Zhou , Shunping Ji , Shuicheng Yan , Xiangtai Li

Accurate precipitation nowcasting over extended horizons (0-3 hours) is essential for disaster mitigation and operational decision-making, yet remains a critical challenge in the field. Existing deterministic approaches are predominantly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Chunlei Shi , Cui Wu , Xiang Xu , Hao Li , Ni Fan , Xue Han , Yongchao Feng , Yufeng Zhu , Boyu Liu , Zengliang Zang , Hongbin Wang , Yanlan Yang , Dan Niu

Real-world time-series data often exhibit non-stationarity, including changing trends, irregular seasonality, and residuals. In terms of changing trends, recently proposed multi-layer perceptron (MLP)-based models have shown excellent…

Machine Learning · Computer Science 2025-09-26 Gawon Lee , Hanbyeol Park , Minseop Kim , Dohee Kim , Hyerim Bae

Accurate detection of cardiac abnormalities from electrocardiogram recordings is regarded as essential for clinical diagnostics and decision support. Traditional deep learning models such as residual networks and transformer architectures…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Huawei Jiang , Husna Mutahira , Gan Huang , Mannan Saeed Muhammad

Topological deep learning has emerged as a powerful paradigm for modeling higher-order relational structures beyond pairwise interactions that standard graph neural networks fail to capture. While combinatorial complexes (CCs) offer a…

Machine Learning · Computer Science 2026-03-16 Jiawen Chen , Qi Shao , Mingtong Zhou , Duxin Chen , Wenwu Yu

Recently, the Mamba architecture based on state space models has demonstrated remarkable performance in a series of natural language processing tasks and has been rapidly applied to remote sensing change detection (CD) tasks. However, most…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Haotian Zhang , Keyan Chen , Chenyang Liu , Hao Chen , Zhengxia Zou , Zhenwei Shi

State Space Models (SSMs)-most notably RNNs-have historically played a central role in sequential modeling. Although attention mechanisms such as Transformers have since dominated due to their ability to model global context, their…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Hyun-kyu Ko , Youbin Kim , Jihyeon Park , Dongheok Park , Gyeongjin Kang , Wonjun Cho , Hyung Yi , Eunbyung Park

Recent advancements in state space models, notably Mamba, have demonstrated significant progress in modeling long sequences for tasks like language understanding. Yet, their application in vision tasks has not markedly surpassed the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Tao Huang , Xiaohuan Pei , Shan You , Fei Wang , Chen Qian , Chang Xu

In a real-world traffic scenario, varying-scale objects are usually distributed in a cluttered background, which poses great challenges to accurate detection. Although current Mamba-based methods can efficiently model long-range…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Jun Li , Yingying Shi , Zhixuan Ruan , Nan Guo , Jianhua Xu

Mamba is emerging as a novel approach to overcome the challenges faced by Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) in computer vision. While CNNs excel at extracting local features, they often struggle to capture…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Md Maklachur Rahman , Abdullah Aman Tutul , Ankur Nath , Lamyanba Laishram , Soon Ki Jung , Tracy Hammond

In long-term time series forecasting, different variables often influence the target variable over distinct time intervals, a challenge known as the multi-delay issue. Traditional models typically process all variables or time points…

Machine Learning · Computer Science 2025-05-28 Xiaowen Ma , Zhenliang Ni , Shuai Xiao , Xinghao Chen

Existing RGB-T tracking algorithms have made remarkable progress by leveraging the global interaction capability and extensive pre-trained models of the Transformer architecture. Nonetheless, these methods mainly adopt imagepair appearance…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Simiao Lai , Chang Liu , Jiawen Zhu , Ben Kang , Yang Liu , Dong Wang , Huchuan Lu

Training urban spatio-temporal foundation models that generalize well across diverse regions and cities is critical for deploying urban services in unseen or data-scarce regions. Recent studies have typically focused on fusing cross-domain…

Machine Learning · Computer Science 2026-02-04 Rui An , Yifeng Zhang , Ziran Liang , Wenqi Fan , Yuxuan Liang , Xuequn Shang , Qing Li