English
Related papers

Related papers: Similarity-Aware Selective State-Space Modeling fo…

200 papers

In the field of biomedical image analysis, the quest for architectures capable of effectively capturing long-range dependencies is paramount, especially when dealing with 3D image segmentation, classification, and landmark detection.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Haifan Gong , Luoyao Kang , Yitao Wang , Xiang Wan , Haofeng Li

Mamba is emerging as a novel approach to overcome the challenges faced by Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) in computer vision. While CNNs excel at extracting local features, they often struggle to capture…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Md Maklachur Rahman , Abdullah Aman Tutul , Ankur Nath , Lamyanba Laishram , Soon Ki Jung , Tracy Hammond

Single hyperspectral image super-resolution (SHSR) aims to restore high-resolution images from low-resolution hyperspectral images. Recently, the Visual Mamba model has achieved an impressive balance between performance and computational…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Baisong Li , Xingwang Wang , Haixiao Xu

Accurate building segmentation and height estimation from single-view RGB satellite imagery are fundamental for urban analytics, yet remain ill-posed due to structural variability and the high computational cost of global context modeling.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Sinan U. Ulu , A. Enes Doruk , I. Can Yagmur , Bahadir K. Gunturk , Oguz Hanoglu , Hasan F. Ates

Panoptic segmentation requires the simultaneous recognition of countable thing instances and amorphous stuff regions, placing joint demands on long-range context modelling, multi-scale feature representation, and efficient dense prediction.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Qing Cheng , Damiano Bertolini , Wei Zhang , Dong Wang , Niclas Zeller , Daniel Cremers

Accurate 3D medical image segmentation demands architectures capable of reconciling global context modeling with spatial topology preservation. While State Space Models (SSMs) like Mamba show potential for sequence modeling, existing…

Image and Video Processing · Electrical Eng. & Systems 2025-06-06 Hangyu Ji

This paper explores the capability of Mamba, a recently proposed architecture based on state space models (SSMs), as a competitive alternative to Transformer-based models. In the speech domain, well-designed Transformer-based models, such…

Sound · Computer Science 2024-06-25 Koichi Miyazaki , Yoshiki Masuyama , Masato Murata

Image restoration is a critical task in low-level computer vision, aiming to restore high-quality images from degraded inputs. Various models, such as convolutional neural networks (CNNs), generative adversarial networks (GANs),…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Yuan Shi , Bin Xia , Xiaoyu Jin , Xing Wang , Tianyu Zhao , Xin Xia , Xuefeng Xiao , Wenming Yang

We introduce VideoMamba, a novel adaptation of the pure Mamba architecture, specifically designed for video recognition. Unlike transformers that rely on self-attention mechanisms leading to high computational costs by quadratic complexity,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jinyoung Park , Hee-Seon Kim , Kangwook Ko , Minbeom Kim , Changick Kim

Recent advancements in State Space Models (SSMs) have attracted significant interest, particularly in models optimized for parallel training and handling long-range dependencies. Architectures like Mamba have scaled to billions of…

Machine Learning · Computer Science 2024-10-22 Zheng Zhan , Yushu Wu , Zhenglun Kong , Changdi Yang , Yifan Gong , Xuan Shen , Xue Lin , Pu Zhao , Yanzhi Wang

Recurrent neural networks and Transformers have recently dominated most applications in hyperspectral (HS) imaging, owing to their capability to capture long-range dependencies from spectrum sequences. However, despite the success of these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Jing Yao , Danfeng Hong , Chenyu Li , Jocelyn Chanussot

In recent speech enhancement (SE) research, transformer and its variants have emerged as the predominant methodologies. However, the quadratic complexity of the self-attention mechanism imposes certain limitations on practical deployment.…

Sound · Computer Science 2025-01-03 Junyu Wang , Zizhen Lin , Tianrui Wang , Meng Ge , Longbiao Wang , Jianwu Dang

The classification of insect pests is a critical task in agricultural technology, vital for ensuring food security and environmental sustainability. However, the complexity of pest identification, due to factors like high camouflage and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Qianning Wang , Chenglin Wang , Zhixin Lai , Yucheng Zhou

Image restoration requires simultaneously preserving fine-grained local structures and maintaining long-range spatial coherence. While convolutional networks struggle with limited receptive fields, and Transformers incur quadratic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Mohammed Hassanin , Nour Moustafa , Weijian Deng , Ibrahim Radwan

Recent advances in deep learning for vision tasks have seen the rise of State Space Models (SSMs) like Mamba, celebrated for their linear scalability. However, their adaptation to 2D visual data often necessitates complex modifications that…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Minjong Cheon , Changbae Mun

Recent progress in remote sensing image (RSI) super-resolution (SR) has exhibited remarkable performance using deep neural networks, e.g., Convolutional Neural Networks and Transformers. However, existing SR methods often suffer from either…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Yi Xiao , Qiangqiang Yuan , Kui Jiang , Yuzeng Chen , Qiang Zhang , Chia-Wen Lin

The advent of Transformer and Mamba-based architectures has significantly advanced 3D medical image segmentation by enabling global contextual modeling, a capability traditionally limited in Convolutional Neural Networks (CNNs). However,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Duy D. Nguyen , Phat T. Tran-Truong

CNN- and Transformer-based architectures have achieved strong performance in medical image segmentation, but CNNs are limited in modeling long-range dependencies, while Transformers often suffer from quadratic computational and memory…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Diego Adame , Fabian Vazquez , Jose A. Nunez , Huimin Li , Jinghao Yang , Erik Enriquez , DongChul Kim , Haoteng Tang , Bin Fu , Pengfei Gu

Enhancing and preserving the readability of document images, particularly historical ones, is crucial for effective document image analysis. Numerous models have been proposed for this task, including convolutional-based, transformer-based,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Mohd. Azfar , Siddhant Bharadwaj , Ashwin Sasikumar

In recent years, Transformers-based models have made significant progress in the field of image restoration by leveraging their inherent ability to capture complex contextual features. Recently, Mamba models have made a splash in the field…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Juan Wen , Weiyan Hou , Luc Van Gool , Radu Timofte