English
Related papers

Related papers: CAMS: Convolution and Attention-Free Mamba-based C…

200 papers

To segment medical images with distribution shifts, domain generalization (DG) has emerged as a promising setting to train models on source domains that can generalize to unseen target domains. Existing DG methods are mainly based on CNN or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Zihan Cheng , Jintao Guo , Jian Zhang , Lei Qi , Luping Zhou , Yinghuan Shi , Yang Gao

Transformers have rapidly become the preferred choice for audio classification, surpassing methods based on CNNs. However, Audio Spectrogram Transformers (ASTs) exhibit quadratic scaling due to self-attention. The removal of this quadratic…

Sound · Computer Science 2024-06-06 Mehmet Hamza Erol , Arda Senocak , Jiu Feng , Joon Son Chung

Inspired by the recent success of the Mamba architecture in vision and language domains, we introduce a Unified Attention-Mamba (UAM) backbone. Unlike previous hybrid approaches that integrate Attention and Mamba modules in fixed…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Taixi Chen , Jingyun Chen , Nancy Guo

Convolutional neural networks (CNNs) have been the de facto standard in a diverse set of computer vision tasks for many years. Especially, deep neural networks based on seminal architectures such as U-shaped models with skip-connections or…

Image and Video Processing · Electrical Eng. & Systems 2022-08-02 Reza Azad , Moein Heidari , Moein Shariatnia , Ehsan Khodapanah Aghdam , Sanaz Karimijafarbigloo , Ehsan Adeli , Dorit Merhof

Breast cancer lesion segmentation in DCE-MRI remains challenging due to heterogeneous tumor morphology and indistinct boundaries. To address these challenges, this study proposes a novel hybrid segmentation network, HCMA-UNet, for lesion…

Image and Video Processing · Electrical Eng. & Systems 2025-04-02 Haoxuan Li , Wei song , Peiwu Qin , Xi Yuan , Zhenglin Chen

We present RMA-Mamba, a novel architecture that advances the capabilities of vision state space models through a specialized reverse mamba attention module (RMA). The key innovation lies in RMA-Mamba's ability to capture long-range…

Image and Video Processing · Electrical Eng. & Systems 2025-03-07 Jun Zeng , Debesh Jha , Ertugrul Aktas , Elif Keles , Alpay Medetalibeyoglu , Matthew Antalek , Robert Lewandowski , Daniela Ladner , Amir A. Borhani , Gorkem Durak , Ulas Bagci

Deep learning has revolutionized medical imaging by providing innovative solutions to complex healthcare challenges. Traditional models often struggle to dynamically adjust feature importance, resulting in suboptimal representation,…

Image and Video Processing · Electrical Eng. & Systems 2024-04-29 Kazi Shahriar Sanjid , Md. Tanzim Hossain , Md. Shakib Shahariar Junayed , M. Monir Uddin

Medical image segmentation has seen significant improvements with transformer models, which excel in grasping far-reaching contexts and global contextual information. However, the increasing computational demands of these models,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Reza Azad , Leon Niggemeier , Michael Huttemann , Amirhossein Kazerouni , Ehsan Khodapanah Aghdam , Yury Velichko , Ulas Bagci , Dorit Merhof

Existing deraining Transformers employ self-attention mechanisms with fixed-range windows or along channel dimensions, limiting the exploitation of non-local receptive fields. In response to this issue, we introduce a novel dual-branch…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Shangquan Sun , Wenqi Ren , Juxiang Zhou , Jianhou Gan , Rui Wang , Xiaochun Cao

Medical image segmentation remains particularly challenging for complex and low-contrast anatomical structures. In this paper, we introduce the U-Transformer network, which combines a U-shaped architecture for image segmentation with self-…

Image and Video Processing · Electrical Eng. & Systems 2021-03-15 Olivier Petit , Nicolas Thome , Clément Rambour , Luc Soler

CrackMamba, a Mamba-based model, is designed for efficient and accurate crack segmentation for monitoring the structural health of infrastructure. Traditional Convolutional Neural Network (CNN) models struggle with limited receptive fields,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Xin Zuo , Yu Sheng , Jifeng Shen , Yongwei Shan

Medical image segmentation plays a crucial role in clinical diagnosis and treatment planning, where accurate boundary delineation is essential for precise lesion localization, organ identification, and quantitative assessment. In recent…

Image and Video Processing · Electrical Eng. & Systems 2026-05-26 Peiting Tian , Xi Chen , Haixia Bi , Fan Li

Although Mamba models greatly improve Hyperspectral Image (HSI) classification, they have critical challenges in terms defining efficient and adaptive token sequences for improve performance. This paper therefore presents CSSMamba…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Zack Dewis , Yimin Zhu , Zhengsen Xu , Mabel Heffring , Saeid Taleghanidoozdoozan , Quinn Ledingham , Lincoln Linlin Xu

Multimodal image fusion aims to integrate information from different imaging techniques to produce a comprehensive, detail-rich single image for downstream vision tasks. Existing methods based on local convolutional neural networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xinyu Xie , Yawen Cui , Tao Tan , Xubin Zheng , Zitong Yu

Continual learning (CL) aims to efficiently learn from a non-stationary data stream, without storing or recomputing all seen samples. CL enables prediction on new tasks by incorporating sequential training samples. Building on this…

Machine Learning · Computer Science 2025-05-27 Chongyang Zhao , Dong Gong

Cell detection in pathological images presents unique challenges due to densely packed objects, subtle inter-class differences, and severe background clutter. In this paper, we propose CellMamba, a lightweight and accurate one-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Ruochen Liu , Yi Tian , Jiahao Wang , Hongbin Liu , Xianxu Hou , Jingxin Liu

Integrating components from convolutional neural networks and state space models in medical image segmentation presents a compelling approach to enhance accuracy and efficiency. We introduce Mamba HUNet, a novel architecture tailored for…

Image and Video Processing · Electrical Eng. & Systems 2024-08-31 Kazi Shahriar Sanjid , Md. Tanzim Hossain , Md. Shakib Shahariar Junayed , Mohammad Monir Uddin

Recent advances in deep learning for vision tasks have seen the rise of State Space Models (SSMs) like Mamba, celebrated for their linear scalability. However, their adaptation to 2D visual data often necessitates complex modifications that…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Minjong Cheon , Changbae Mun

State space models (SSMs) with selection mechanisms and hardware-aware architectures, namely Mamba, have recently demonstrated significant promise in long-sequence modeling. Since the self-attention mechanism in transformers has quadratic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Hanwei Zhang , Ying Zhu , Dan Wang , Lijun Zhang , Tianxiang Chen , Zi Ye

Convolutional Neural Networks have played a significant role in various medical imaging tasks like classification and segmentation. They provide state-of-the-art performance compared to classical image processing algorithms. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Rakshith Sathish , Swanand Khare , Debdoot Sheet