English
Related papers

Related papers: Swin-UMamba: Mamba-based UNet with ImageNet-based …

200 papers

Mamba, a special case of the State Space Model, is gaining popularity as an alternative to template-based deep learning approaches in medical image analysis. While transformers are powerful architectures, they have drawbacks, including…

Mamba, with its selective State Space Models (SSMs), offers a more computationally efficient solution than Transformers for long-range dependency modeling. However, there is still a debate about its effectiveness in high-resolution 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Chaohan Wang , Yutong Xie , Qi Chen , Yuyin Zhou , Qi Wu

Convolutional neural networks have primarily led 3D medical image segmentation but may be limited by small receptive fields. Transformer models excel in capturing global relationships through self-attention but are challenged by high…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Ao Chang , Jiajun Zeng , Ruobing Huang , Dong Ni

Recent advancements in state space models, notably Mamba, have demonstrated significant progress in modeling long sequences for tasks like language understanding. Yet, their application in vision tasks has not markedly surpassed the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Tao Huang , Xiaohuan Pei , Shan You , Fei Wang , Chen Qian , Chang Xu

Accurate segmentation of 3D clinical medical images is critical in the diagnosis and treatment of spinal diseases. However, the inherent complexity of spinal anatomy and uncertainty inherent in current imaging technologies, poses…

Image and Video Processing · Electrical Eng. & Systems 2024-08-29 Zhiqing Zhang , Tianyong Liu , Guojia Fan , Bin Li , Qianjin Feng , Shoujun Zhou

Mamba, a recent selective structured state space model, excels in long sequence modeling, which is vital in the large model era. Long sequence modeling poses significant challenges, including capturing long-range dependencies within the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Rui Xu , Shu Yang , Yihui Wang , Yu Cai , Bo Du , Hao Chen

Recent advancements in medical imaging have resulted in more complex and diverse images, with challenges such as high anatomical variability, blurred tissue boundaries, low organ contrast, and noise. Traditional segmentation methods…

Image and Video Processing · Electrical Eng. & Systems 2024-11-01 Yufeng Jiang , Zongxi Li , Xiangyan Chen , Haoran Xie , Jing Cai

Accurate medical image segmentation is an integral part of the medical image analysis pipeline that requires the ability to merge local and global information. While vision transformers are able to capture global interactions using vanilla…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Elisha Dayag , Nhat Thanh Tran , Jack Xin

State space models (SSMs) with selection mechanisms and hardware-aware architectures, namely Mamba, have recently demonstrated significant promise in long-sequence modeling. Since the self-attention mechanism in transformers has quadratic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Hanwei Zhang , Ying Zhu , Dan Wang , Lijun Zhang , Tianxiang Chen , Zi Ye

Recent advances in Vision Transformers (ViTs) and State Space Models (SSMs) have challenged the dominance of Convolutional Neural Networks (CNNs) in computer vision. ViTs excel at capturing global context, and SSMs like Mamba offer linear…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Mustafa Munir , Alex Zhang , Radu Marculescu

Recent advancements have highlighted the Mamba framework, a state-space model known for its efficiency in capturing long-range dependencies with linear computational complexity. While Mamba has shown competitive performance in medical image…

Image and Video Processing · Electrical Eng. & Systems 2025-02-05 Weiren Zhao , Feng Wang , Yanran Wang , Yutong Xie , Qi Wu , Yuyin Zhou

Medical image segmentation plays an important role in computer-aided diagnosis. Traditional convolution-based U-shape segmentation architectures are usually limited by the local receptive field. Existing vision transformers have been widely…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Qing Xu , Yanming Chen , Yue Li , Ziyu Liu , Zhenye Lou , Yixuan Zhang , Xiangjian He

Sequence modeling plays a vital role across various domains, with recurrent neural networks being historically the predominant method of performing these tasks. However, the emergence of transformers has altered this paradigm due to their…

Medical image segmentation is increasingly reliant on deep learning techniques, yet the promising performance often come with high annotation costs. This paper introduces Weak-Mamba-UNet, an innovative weakly-supervised learning (WSL)…

Image and Video Processing · Electrical Eng. & Systems 2024-02-19 Ziyang Wang , Chao Ma

Medical image segmentation is essential for applications like robotic surgeries, disease diagnosis, and treatment planning. Recently, various deep-learning models have been proposed to enhance medical image segmentation. One promising…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Akansh Agrawal , Akshan Agrawal , Shashwat Gupta , Priyanka Bagade

Radiography imaging protocols target on specific anatomical regions, resulting in highly consistent images with recurrent structural patterns across patients. Recent advances in medical anomaly detection have demonstrated the effectiveness…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Rui Pan , Ruiying Lu

UNet and its variants have been widely used in medical image segmentation. However, these models, especially those based on Transformer architectures, pose challenges due to their large number of parameters and computational loads, making…

Image and Video Processing · Electrical Eng. & Systems 2024-03-12 Weibin Liao , Yinghao Zhu , Xinyuan Wang , Chengwei Pan , Yasha Wang , Liantao Ma

The U-shaped encoder-decoder architecture with skip connections has become a prevailing paradigm in medical image segmentation due to its simplicity and effectiveness. While many recent works aim to improve this framework by designing more…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Jing Huang , Yongkang Zhao , Yuhan Li , Zhitao Dai , Cheng Chen , Qiying Lai

Deep learning has revolutionized medical imaging by providing innovative solutions to complex healthcare challenges. Traditional models often struggle to dynamically adjust feature importance, resulting in suboptimal representation,…

Image and Video Processing · Electrical Eng. & Systems 2024-04-29 Kazi Shahriar Sanjid , Md. Tanzim Hossain , Md. Shakib Shahariar Junayed , M. Monir Uddin

Mamba is an efficient State Space Model (SSM) with linear computational complexity. Although SSMs are not suitable for handling non-causal data, Vision Mamba (ViM) methods still demonstrate good performance in tasks such as image…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Juntao Zhang , Shaogeng Liu , Kun Bian , You Zhou , Pei Zhang , Jianning Liu , Jun Zhou , Bingyan Liu