English
Related papers

Related papers: Swin-UMamba: Mamba-based UNet with ImageNet-based …

200 papers

Deep learning, particularly convolutional neural networks (CNNs) and Transformers, has significantly advanced 3D medical image segmentation. While CNNs are highly effective at capturing local features, their limited receptive fields may…

Image and Video Processing · Electrical Eng. & Systems 2024-09-20 Chenyuan Bian , Nan Xia , Xia Yang , Feifei Wang , Fengjiao Wang , Bin Wei , Qian Dong

Medicine is inherently a multimodal discipline. Medical images can reflect the pathological changes of cancer and tumors, while the expression of specific genes can influence their morphological characteristics. However, most deep learning…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jiaying Zhou , Mingzhou Jiang , Junde Wu , Jiayuan Zhu , Ziyue Wang , Yueming Jin

Convolutional neural networks and Transformer have made significant progresses in multi-modality medical image super-resolution. However, these methods either have a fixed receptive field for local learning or significant computational…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Zexin Ji , Beiji Zou , Xiaoyan Kui , Sebastien Thureau , Su Ruan

Combining CNNs or ViTs, with RNNs for spatiotemporal forecasting, has yielded unparalleled results in predicting temporal and spatial dynamics. However, modeling extensive global information remains a formidable challenge; CNNs are limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Yujin Tang , Peijie Dong , Zhenheng Tang , Xiaowen Chu , Junwei Liang

Accurate medical image segmentation requires effective modeling of both global anatomical structures and fine-grained boundary details. Recent state space models (e.g., Vision Mamba) offer efficient long-range dependency modeling. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Fuhao Zhang , Lei Liu , Jialin Zhang , Ya-Nan Zhang , Nan Mu

The realm of Mamba for vision has been advanced in recent years to strike for the alternatives of Vision Transformers (ViTs) that suffer from the quadratic complexity. While the recurrent scanning mechanism of Mamba offers computational…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Masakazu Yoshimura , Teruaki Hayashi , Yuki Hoshino , Wei-Yao Wang , Takeshi Ohashi

Mamba, a State Space Model (SSM), has recently shown competitive performance to Convolutional Neural Networks (CNNs) and Transformers in Natural Language Processing and general sequence modeling. Various attempts have been made to adapt…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Trung Dinh Quoc Dang , Huy Hoang Nguyen , Aleksei Tiulpin

Recently, the field of 3D medical segmentation has been dominated by deep learning models employing Convolutional Neural Networks (CNNs) and Transformer-based architectures, each with their distinctive strengths and limitations. CNNs are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Luca Lumetti , Vittorio Pipoli , Kevin Marchesini , Elisa Ficarra , Costantino Grana , Federico Bolelli

In underwater image enhancement (UIE), convolutional neural networks (CNN) have inherent limitations in modeling long-range dependencies and are less effective in recovering global features. While Transformers excel at modeling long-range…

Artificial Intelligence · Computer Science 2024-08-01 Song Zhang , Yuqing Duan , Daoliang Li , Ran Zhao

State Space Model (SSM) is a mathematical model used to describe and analyze the behavior of dynamic systems. This model has witnessed numerous applications in several fields, including control theory, signal processing, economics and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Xiao Liu , Chenxu Zhang , Lei Zhang

Transformers have widely adopted attention networks for sequence mixing and MLPs for channel mixing, playing a pivotal role in achieving breakthroughs across domains. However, recent literature highlights issues with attention networks,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Badri N. Patro , Vijay S. Agneeswaran

Despite the progress made in Mamba-based medical image segmentation models, existing methods utilizing unidirectional or multi-directional feature scanning mechanisms struggle to effectively capture dependencies between neighboring…

Image and Video Processing · Electrical Eng. & Systems 2025-09-04 Chao Fan , Hongyuan Yu , Yan Huang , Liang Wang , Zhenghan Yang , Xibin Jia

Recent advances in deep learning have made it possible to predict phenotypic measures directly from functional magnetic resonance imaging (fMRI) brain volumes, sparking significant interest in the neuroimaging community. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Arunkumar Kannan , Martin A. Lindquist , Brian Caffo

CNN- and Transformer-based architectures have achieved strong performance in medical image segmentation, but CNNs are limited in modeling long-range dependencies, while Transformers often suffer from quadratic computational and memory…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Diego Adame , Fabian Vazquez , Jose A. Nunez , Huimin Li , Jinghao Yang , Erik Enriquez , DongChul Kim , Haoteng Tang , Bin Fu , Pengfei Gu

Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) are the predominant modalities utilized in the field of medical imaging. Although MRI capture the complexity of anatomical structures with greater detail than CT, it entails a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Zhenbin Wang , Lei Zhang , Lituan Wang , Zhenwei Zhang

In the field of self-supervised depth estimation, Convolutional Neural Networks (CNNs) and Transformers have traditionally been dominant. However, both architectures struggle with efficiently handling long-range dependencies due to their…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Ionuţ Grigore , Călin-Adrian Popa

Recently Mamba-based methods have shown promise in abdominal organ segmentation. However, existing approaches neglect cross-channel anatomical semantic collaboration and lack explicit boundary-aware feature fusion mechanisms. To address…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Yuyang Zheng , Mingda Zhang , Jianglong Qin , Qi Mo , Jingdan Pan , Haozhe Hu , Hongyi Huang

Recent advancements in large-scale Vision Transformers have made significant strides in improving pre-trained models for medical image segmentation. However, these methods face a notable challenge in acquiring a substantial amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yiqing Wang , Zihan Li , Jieru Mei , Zihao Wei , Li Liu , Chen Wang , Shengtian Sang , Alan Yuille , Cihang Xie , Yuyin Zhou

Snapshot Compressive Imaging (SCI) enables fast spectral imaging but requires effective decoding algorithms for hyperspectral image (HSI) reconstruction from compressed measurements. Current CNN-based methods are limited in modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Wenzhe Tian , Haijin Zeng , Yin-Ping Zhao , Yongyong Chen , Zhen Wang , Xuelong Li

High-resolution remotely sensed images pose a challenge for commonly used semantic segmentation methods such as Convolutional Neural Network (CNN) and Vision Transformer (ViT). CNN-based methods struggle with handling such high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Qinfeng Zhu , Yuanzhi Cai , Yuan Fang , Yihan Yang , Cheng Chen , Lei Fan , Anh Nguyen