English
Related papers

Related papers: SF-Mamba: Rethinking State Space Model for Vision

200 papers

Vision Mamba (ViM) models offer a compelling efficiency advantage over Transformers by leveraging the linear complexity of State Space Models (SSMs), yet efficiently deploying them on FPGAs remains challenging. Linear layers struggle with…

Hardware Architecture · Computer Science 2026-05-05 Shengzhe Lyu , Yuhan She , Patrick S. Y. Hung , Ray C. C. Cheung , Weitao Xu

Recent State Space Models (SSM), especially Mamba, have demonstrated impressive performance in visual modeling and possess superior model efficiency. However, the application of Mamba to visual tasks suffers inferior performance due to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Fei Xie , Jiahao Nie , Yujin Tang , Wenkang Zhang , Hongshen Zhao

State Space Model (SSM) is a mathematical model used to describe and analyze the behavior of dynamic systems. This model has witnessed numerous applications in several fields, including control theory, signal processing, economics and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Xiao Liu , Chenxu Zhang , Lei Zhang

Visual Mamba is an approach that extends the selective space state model, Mamba, to vision tasks. It processes image tokens sequentially in a fixed order, accumulating information to generate outputs. Despite its growing popularity for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Younghyun Cho , Changhun Lee , Seonggon Kim , Eunhyeok Park

Recently, State Space Models (SSMs), with Mamba as a prime example, have shown great promise for long-range dependency modeling with linear complexity. Then, Vision Mamba and the subsequent architectures are presented successively, and they…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Zhongping Ji

Compared to single view medical image classification, using multiple views can significantly enhance predictive accuracy as it can account for the complementarity of each view while leveraging correlations between views. Existing multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Xiaoyu Zheng , Xu Chen , Shaogang Gong , Xavier Griffin , Greg Slabaugh

Deep learning methods, especially Convolutional Neural Networks (CNN) and Vision Transformer (ViT), are frequently employed to perform semantic segmentation of high-resolution remotely sensed images. However, CNNs are constrained by their…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Qinfeng Zhu , Yuan Fang , Yuanzhi Cai , Cheng Chen , Lei Fan

Pan-sharpening involves integrating information from low-resolution multi-spectral and high-resolution panchromatic images to generate high-resolution multi-spectral counterparts. While recent advancements in the state space model,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Xuanhua He , Ke Cao , Keyu Yan , Rui Li , Chengjun Xie , Jie Zhang , Man Zhou

Video anomaly detection (VAD) methods are mostly CNN-based or Transformer-based, achieving impressive results, but the focus on detection accuracy often comes at the expense of inference speed. The emergence of state space models in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Jiahao Lyu , Minghua Zhao , Jing Hu , Xuewen Huang , Yifei Chen , Shuangli Du

Recent advancements have highlighted the Mamba framework, a state-space model known for its efficiency in capturing long-range dependencies with linear computational complexity. While Mamba has shown competitive performance in medical image…

Image and Video Processing · Electrical Eng. & Systems 2025-02-05 Weiren Zhao , Feng Wang , Yanran Wang , Yutong Xie , Qi Wu , Yuyin Zhou

Mamba and Vision Mamba (Vim) models have shown their potential as an alternative to methods based on Transformer architecture. This work introduces Fast Mamba for Vision (Famba-V), a cross-layer token fusion technique to enhance the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Hui Shen , Zhongwei Wan , Xin Wang , Mi Zhang

Multimodal fusion has made great progress in the field of remote sensing image classification due to its ability to exploit the complementary spatial-spectral information. Deep learning methods such as CNN and Transformer have been widely…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Qingyu Wang , Xue Jiang , Guozheng Xu

Recurrent neural networks and Transformers have recently dominated most applications in hyperspectral (HS) imaging, owing to their capability to capture long-range dependencies from spectrum sequences. However, despite the success of these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Jing Yao , Danfeng Hong , Chenyu Li , Jocelyn Chanussot

Mamba has shown great potential for computer vision due to its linear complexity in modeling the global context with respect to the input length. However, existing lightweight Mamba-based backbones cannot demonstrate performance that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Xiaowen Ma , Zhenliang Ni , Xinghao Chen

The growing demand for efficient long-sequence modeling on edge devices has propelled widespread adoption of State Space Models (SSMs) like Mamba, due to their superior computational efficiency and scalability. As its autoregressive…

Hardware Architecture · Computer Science 2025-09-25 Linfeng Zhong , Songqiang Xu , Huifeng Wen , Tong Xie , Qingyu Guo , Yuan Wang , Meng Li

Traditionally for improving the segmentation performance of models, most approaches prefer to use adding more complex modules. And this is not suitable for the medical field, especially for mobile medical devices, where computationally…

Image and Video Processing · Electrical Eng. & Systems 2025-06-30 Renkai Wu , Yinghao Liu , Pengchen Liang , Qing Chang

We propose a novel hybrid Mamba-Transformer backbone, MambaVision, specifically tailored for vision applications. Our core contribution includes redesigning the Mamba formulation to enhance its capability for efficient modeling of visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Ali Hatamizadeh , Jan Kautz

Recently, Mamba-based methods have become popular in medical image segmentation due to their lightweight design and long-range dependency modeling capabilities. However, current segmentation methods frequently encounter challenges in fetal…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Caixu Xu , Junming Wei , Huizhen Chen , Pengchen Liang , Bocheng Liang , Ying Tan , Xintong Wei

Transformers have widely adopted attention networks for sequence mixing and MLPs for channel mixing, playing a pivotal role in achieving breakthroughs across domains. However, recent literature highlights issues with attention networks,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Badri N. Patro , Vijay S. Agneeswaran

State space models (SSMs) like Mamba have recently attracted much attention. Compared to Transformer-based large language models (LLMs), Mamba achieves linear computation complexity with the sequence length and demonstrates superior…

Computation and Language · Computer Science 2025-10-13 Renjie Wei , Songqiang Xu , Linfeng Zhong , Zebin Yang , Qingyu Guo , Yuan Wang , Runsheng Wang , Meng Li