English
Related papers

Related papers: X-VMamba: Explainable Vision Mamba

200 papers

Existing Transformer-based models for point cloud analysis suffer from quadratic complexity, leading to compromised point cloud resolution and information loss. In contrast, the newly proposed Mamba model, based on state space models (SSM),…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xu Han , Yuan Tang , Zhaoxuan Wang , Xianzhi Li

Motion forecasting is a crucial component of autonomous driving systems, enabling the generation of accurate and smooth future trajectories to ensure safe navigation to the destination. In previous methods, potential future trajectories are…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Shijie Li , Xun Xu , Si Yong Yeo , Xulei Yang

The typical Selective State-Space Model (SSM) used in Mamba addresses several limitations of Transformers, such as the quadratic computational complexity with respect to sequence length and the significant memory requirements during…

Computation and Language · Computer Science 2025-10-24 Shengkun Tang , Liqun Ma , Haonan Li , Mingjie Sun , Zhiqiang Shen

Recent advancements in transformers, specifically self-attention mechanisms, have significantly improved hyperspectral image (HSI) classification. However, these models often suffer from inefficiencies, as their computational complexity…

We propose Samba ASR,the first state of the art Automatic Speech Recognition(ASR)model leveraging the novel Mamba architecture as both encoder and decoder,built on the foundation of state space models(SSMs).Unlike transformerbased ASR…

Computation and Language · Computer Science 2025-01-09 Syed Abdul Gaffar Shakhadri , Kruthika KR , Kartik Basavaraj Angadi

A fundamental objective in robot manipulation is to enable models to comprehend visual scenes and execute actions. Although existing Vision-Language-Action (VLA) models for robots can handle a range of basic tasks, they still face…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Jiaming Liu , Mengzhen Liu , Zhenyu Wang , Pengju An , Xiaoqi Li , Kaichen Zhou , Senqiao Yang , Renrui Zhang , Yandong Guo , Shanghang Zhang

Video super-resolution remains a major challenge in low-level vision tasks. To date, CNN- and Transformer-based methods have delivered impressive results. However, CNNs are limited by local receptive fields, while Transformers struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Dinh Phu Tran , Dao Duy Hung , Daeyoung Kim

Recently, recurrent models based on linear state space models (SSMs) have shown promising performance in language modeling (LM), competititve with transformers. However, there is little understanding of the in-principle abilities of such…

Computation and Language · Computer Science 2025-12-15 Yash Sarrof , Yana Veitsman , Michael Hahn

Recently, state space models have exhibited strong global modeling capabilities and linear computational complexity in contrast to transformers. This research focuses on applying such architecture to more efficiently and effectively model…

Computer Vision and Pattern Recognition · Computer Science 2024-10-14 Tao Zhang , Haobo Yuan , Lu Qi , Jiangning Zhang , Qianyu Zhou , Shunping Ji , Shuicheng Yan , Xiangtai Li

Visual tracking aims to automatically estimate the state of a target object in a video sequence, which is challenging especially in dynamic scenarios. Thus, numerous methods are proposed to introduce temporal cues to enhance tracking…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Yinchao Ma , Dengqing Yang , Zhangyu He , Wenfei Yang , Tianzhu Zhang

State Space Models (SSMs) such as Mamba have become a popular alternative to Transformer models, due to their reduced memory consumption and higher throughput at generation compared to their Attention-based counterparts. On the other hand,…

Computation and Language · Computer Science 2026-04-17 Abhinav Moudgil , Ningyuan Huang , Eeshan Gunesh Dhekane , Pau Rodríguez , Luca Zappella , Federico Danieli

Recent learned image compression (LIC) leverages Mamba-style state-space models (SSMs) for global receptive fields with linear complexity. However, the standard Mamba adopts content-agnostic, predefined raster (or multi-directional) scans…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yunuo Chen , Zezheng Lyu , Bing He , Hongwei Hu , Qi Wang , Yuan Tian , Li Song , Wenjun Zhang , Guo Lu

Semantic segmentation is a vital task in the field of remote sensing (RS). However, conventional convolutional neural network (CNN) and transformer-based models face limitations in capturing long-range dependencies or are often…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Yin Hu , Xianping Ma , Jialu Sui , Man-On Pun

Motion prediction is crucial for autonomous driving, as it enables accurate forecasting of future vehicle trajectories based on historical inputs. This paper introduces Trajectory Mamba, a novel efficient trajectory prediction framework…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Yizhou Huang , Yihua Cheng , Kezhi Wang

Although Mamba models greatly improve Hyperspectral Image (HSI) classification, they have critical challenges in terms defining efficient and adaptive token sequences for improve performance. This paper therefore presents CSSMamba…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Zack Dewis , Yimin Zhu , Zhengsen Xu , Mabel Heffring , Saeid Taleghanidoozdoozan , Quinn Ledingham , Lincoln Linlin Xu

Semantic segmentation of remote sensing images is a fundamental task in geoscience research. However, there are some significant shortcomings for the widely used convolutional neural networks (CNNs) and Transformers. The former is limited…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Xianping Ma , Xiaokang Zhang , Man-On Pun

Spiking Transformers have shown strong potential for long-range visual modeling through spike-driven self-attention. However, their quadratic token interactions remain fundamentally misaligned with the sparse and event-driven nature of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Dewei Bai , Hongxiang Peng , Yunyun Zeng , Ziyu Zhang , Hong Qu , Yi Zhang

Pre-trained Vision Mamba (Vim) models have demonstrated exceptional performance across various computer vision tasks in a computationally efficient manner, attributed to their unique design of selective state space models. To further extend…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Yifeng Yao , Zichen Liu , Zhenyu Cui , Yuxin Peng , Jiahuan Zhou

Multimodal fusion has made great progress in the field of remote sensing image classification due to its ability to exploit the complementary spatial-spectral information. Deep learning methods such as CNN and Transformer have been widely…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Qingyu Wang , Xue Jiang , Guozheng Xu

Place recognition is the foundation for enabling autonomous systems to achieve independent decision-making and safe operations. It is also crucial in tasks such as loop closure detection and global localization within SLAM. Previous methods…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Qiuchi Xiang , Jintao Cheng , Jiehao Luo , Jin Wu , Rui Fan , Xieyuanli Chen , Xiaoyu Tang