English
Related papers

Related papers: SP-MoMamba: Superpixel-driven Mixture of State Spa…

200 papers

The essence of multi-modal fusion lies in exploiting the complementary information inherent in diverse modalities. However, prevalent fusion methods rely on traditional neural architectures and are inadequately equipped to capture the…

Artificial Intelligence · Computer Science 2025-06-19 Wenbing Li , Hang Zhou , Junqing Yu , Zikai Song , Wei Yang

Acquiring high-quality annotated data for medical image segmentation is tedious and costly. Semi-supervised segmentation techniques alleviate this burden by leveraging unlabeled data to generate pseudo labels. Recently, advanced state space…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Shumeng Li , Jian Zhang , Lei Qi , Luping Zhou , Yinghuan Shi , Yang Gao

Transformers have demonstrated impressive results for 3D point cloud semantic segmentation. However, the quadratic complexity of transformer makes computation costs high, limiting the number of points that can be processed simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Zhuoyuan Li , Yubo Ai , Jiahao Lu , ChuXin Wang , Jiacheng Deng , Hanzhi Chang , Yanzhe Liang , Wenfei Yang , Shifeng Zhang , Tianzhu Zhang

Although Mamba models significantly improve hyperspectral image (HSI) classification, one critical challenge is the difficulty in building the sequence of Mamba tokens efficiently. This paper presents a Sparse Deformable Mamba (SDMamba)…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Lincoln Linlin Xu , Yimin Zhu , Zack Dewis , Zhengsen Xu , Motasem Alkayid , Mabel Heffring , Saeid Taleghanidoozdoozan

Transformers have become increasingly popular for image super-resolution (SR) tasks due to their strong global context modeling capabilities. However, their quadratic computational complexity necessitates the use of window-based attention…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Aman Urumbekov , Zheng Chen

Accurate building segmentation and height estimation from single-view RGB satellite imagery are fundamental for urban analytics, yet remain ill-posed due to structural variability and the high computational cost of global context modeling.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Sinan U. Ulu , A. Enes Doruk , I. Can Yagmur , Bahadir K. Gunturk , Oguz Hanoglu , Hasan F. Ates

Survival analysis using whole-slide images (WSIs) is crucial in cancer research. Despite significant successes, pathology images typically only provide slide-level labels, which hinders the learning of discriminative representations from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Chengsheng Zhang , Linhao Qu , Xiaoyu Liu , Zhijian Song

State-space models (SSMs), particularly the Mamba architecture, have emerged as powerful alternatives to Transformers for sequence modeling, offering linear-time complexity and competitive performance across diverse tasks. However, their…

Machine Learning · Computer Science 2025-09-30 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma

Recently, the Mamba architecture based on State Space Models (SSMs) has gained attention in 3D human pose estimation due to its linear complexity and strong global modeling capability. However, existing SSM-based methods typically apply…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Hu Cui , Wenqiang Hua , Renjing Huang , Shurui Jia , Tessai Hayama

Magnetic Resonance Imaging (MRI) is one of the most important medical imaging modalities as it provides superior resolution of soft tissues, albeit with a notable limitation in scanning speed. The advent of deep learning has catalyzed the…

Image and Video Processing · Electrical Eng. & Systems 2024-09-20 Yilmaz Korkmaz , Vishal M. Patel

Transformers have become foundational for visual tasks such as object detection, semantic segmentation, and video understanding, but their quadratic complexity in attention mechanisms presents scalability challenges. To address these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Fady Ibrahim , Guangjun Liu , Guanghui Wang

State-space models (SSMs), Mamba in particular, are increasingly adopted for long-context sequence modeling, providing linear-time aggregation via an input-dependent, causal selective-scan operation. Along this line, recent…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Jitesh Chavan , Rohit Lal , Anand Kamat , Mengjia Xu

Transformers have proven effective in language modeling but are limited by high computational and memory demands that grow quadratically with input sequence length. State space models (SSMs) offer a promising alternative by reducing…

Hardware Architecture · Computer Science 2025-08-06 Dongho Yoon , Gungyu Lee , Jaewon Chang , Yunjae Lee , Dongjae Lee , Minsoo Rhu

Underwater Image Enhancement (UIE) is critical for marine research and exploration but hindered by complex color distortions and severe blurring. Recent deep learning-based methods have achieved remarkable results, yet these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Wei-Tung Lin , Yong-Xiang Lin , Jyun-Wei Chen , Kai-Lung Hua

Recently the state space models (SSMs) with efficient hardware-aware designs, i.e., the Mamba deep learning model, have shown great potential for long sequence modeling. Meanwhile building efficient and generic vision backbones purely upon…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Lianghui Zhu , Bencheng Liao , Qian Zhang , Xinlong Wang , Wenyu Liu , Xinggang Wang

Single image super-resolution (SR) has long posed a challenge in the field of computer vision. While the advent of deep learning has led to the emergence of numerous methods aimed at tackling this persistent issue, the current methodologies…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Yuchun He , Yuhan He

Hyperspectral image (HSI) classification is pivotal in the remote sensing (RS) field, particularly with the advancement of deep learning techniques. Sequential models, adapted from the natural language processing (NLP) field such as…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Weilian Zhou , Sei-Ichiro Kamata , Haipeng Wang , Man-Sing Wong , Huiying , Hou

Foundation models, now powering most of the exciting applications in deep learning, are almost universally based on the Transformer architecture and its core attention module. Many subquadratic-time architectures such as linear attention,…

Machine Learning · Computer Science 2024-06-03 Albert Gu , Tri Dao

State Space models (SSMs) such as PointMamba enable efficient feature extraction for point cloud self-supervised learning with linear complexity, outperforming Transformers in computational efficiency. However, existing PointMamba-based…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Linshuang Diao , Sensen Song , Yurong Qian , Dayong Ren

Semantic Change Detection (SCD) from remote sensing imagery requires models balancing extensive spatial context, computational efficiency, and sensitivity to class-imbalanced land-cover transitions. While Convolutional Neural Networks excel…

Image and Video Processing · Electrical Eng. & Systems 2026-02-12 Buddhi Wijenayake , Athulya Ratnayake , Praveen Sumanasekara , Roshan Godaliyadda , Parakrama Ekanayake , Vijitha Herath , Nichula Wasalathilaka