English
Related papers

Related papers: SWinMamba: Serpentine Window State Space Model for…

200 papers

In the field of medical image segmentation, models based on both CNN and Transformer have been thoroughly investigated. However, CNNs have limited modeling capabilities for long-range dependencies, making it challenging to exploit the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-15 Mingya Zhang , Yue Yu , Limei Gu , Tingsheng Lin , Xianping Tao

In the realm of medical image segmentation, both CNN-based and Transformer-based models have been extensively explored. However, CNNs exhibit limitations in long-range modeling capabilities, whereas Transformers are hampered by their…

Image and Video Processing · Electrical Eng. & Systems 2024-11-11 Jiacheng Ruan , Jincheng Li , Suncheng Xiang

In recent advancements in medical image analysis, Convolutional Neural Networks (CNN) and Vision Transformers (ViT) have set significant benchmarks. While the former excels in capturing local features through its convolution operations, the…

Image and Video Processing · Electrical Eng. & Systems 2024-04-02 Ziyang Wang , Jian-Qing Zheng , Yichi Zhang , Ge Cui , Lei Li

CrackMamba, a Mamba-based model, is designed for efficient and accurate crack segmentation for monitoring the structural health of infrastructure. Traditional Convolutional Neural Network (CNN) models struggle with limited receptive fields,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Xin Zuo , Yu Sheng , Jifeng Shen , Yongwei Shan

Selective state space models (SSMs), such as Mamba, highly excel at capturing long-range dependencies in 1D sequential data, while their applications to 2D vision tasks still face challenges. Current visual SSMs often convert images into 1D…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Chaodong Xiao , Minghan Li , Zhengqiang Zhang , Deyu Meng , Lei Zhang

Accurate segmentation of 3D clinical medical images is critical in the diagnosis and treatment of spinal diseases. However, the inherent complexity of spinal anatomy and uncertainty inherent in current imaging technologies, poses…

Image and Video Processing · Electrical Eng. & Systems 2024-08-29 Zhiqing Zhang , Tianyong Liu , Guojia Fan , Bin Li , Qianjin Feng , Shoujun Zhou

State Space Models (SSMs), especially recent Mamba architecture, have achieved remarkable success in sequence modeling tasks. However, extending SSMs to computer vision remains challenging due to the non-sequential structure of visual data…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Puskal Khadka , KC Santosh

Designing computationally efficient network architectures remains an ongoing necessity in computer vision. In this paper, we adapt Mamba, a state-space language model, into VMamba, a vision backbone with linear time complexity. At the core…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yue Liu , Yunjie Tian , Yuzhong Zhao , Hongtian Yu , Lingxi Xie , Yaowei Wang , Qixiang Ye , Jianbin Jiao , Yunfan Liu

State Space Models (SSMs) have recently emerged as an alternative to Vision Transformers (ViTs) due to their unique ability of modeling global relationships with linear complexity. SSMs are specifically designed to capture spatially…

In the domain of 3D biomedical image segmentation, Mamba exhibits the superior performance for it addresses the limitations in modeling long-range dependencies inherent to CNNs and mitigates the abundant computational overhead associated…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Weitong Wu , Zhaohu Xing , Jing Gong , Qin Peng , Lei Zhu

The realm of Mamba for vision has been advanced in recent years to strike for the alternatives of Vision Transformers (ViTs) that suffer from the quadratic complexity. While the recurrent scanning mechanism of Mamba offers computational…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Masakazu Yoshimura , Teruaki Hayashi , Yuki Hoshino , Wei-Yao Wang , Takeshi Ohashi

Mamba has garnered widespread attention due to its flexible design and efficient hardware performance to process 1D sequences based on the state space model (SSM). Recent studies have attempted to apply Mamba to the visual domain by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Chengkun Wang , Wenzhao Zheng , Yuanhui Huang , Jie Zhou , Jiwen Lu

Recently, Mamba-based methods have become popular in medical image segmentation due to their lightweight design and long-range dependency modeling capabilities. However, current segmentation methods frequently encounter challenges in fetal…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Caixu Xu , Junming Wei , Huizhen Chen , Pengchen Liang , Bocheng Liang , Ying Tan , Xintong Wei

In the field of biomedical image analysis, the quest for architectures capable of effectively capturing long-range dependencies is paramount, especially when dealing with 3D image segmentation, classification, and landmark detection.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Haifan Gong , Luoyao Kang , Yitao Wang , Xiang Wan , Haofeng Li

Sequence modeling plays a vital role across various domains, with recurrent neural networks being historically the predominant method of performing these tasks. However, the emergence of transformers has altered this paradigm due to their…

Medical image segmentation plays an important role in computer-aided diagnosis. Traditional convolution-based U-shape segmentation architectures are usually limited by the local receptive field. Existing vision transformers have been widely…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Qing Xu , Yanming Chen , Yue Li , Ziyu Liu , Zhenye Lou , Yixuan Zhang , Xiangjian He

Accurate medical image segmentation is an integral part of the medical image analysis pipeline that requires the ability to merge local and global information. While vision transformers are able to capture global interactions using vanilla…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Elisha Dayag , Nhat Thanh Tran , Jack Xin

We introduce VideoMamba, a novel adaptation of the pure Mamba architecture, specifically designed for video recognition. Unlike transformers that rely on self-attention mechanisms leading to high computational costs by quadratic complexity,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jinyoung Park , Hee-Seon Kim , Kangwook Ko , Minbeom Kim , Changick Kim

Mamba, a State Space Model (SSM), has recently shown competitive performance to Convolutional Neural Networks (CNNs) and Transformers in Natural Language Processing and general sequence modeling. Various attempts have been made to adapt…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Trung Dinh Quoc Dang , Huy Hoang Nguyen , Aleksei Tiulpin

Recently, state space models (SSM), particularly Mamba, have attracted significant attention from scholars due to their ability to effectively balance computational efficiency and performance. However, most existing visual Mamba methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Leiye Liu , Miao Zhang , Jihao Yin , Tingwei Liu , Wei Ji , Yongri Piao , Huchuan Lu