English
Related papers

Related papers: MambaMIL: Enhancing Long Sequence Modeling with Se…

200 papers

Multiple Instance Learning (MIL) is widely used in analyzing histopathological Whole Slide Images (WSIs). However, existing MIL methods do not explicitly model the data distribution, and instead they only learn a bag-level or instance-level…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Linhao Qu , Xiaoyuan Luo , Shaolei Liu , Manning Wang , Zhijian Song

Recent advancements have highlighted the Mamba framework, a state-space model known for its efficiency in capturing long-range dependencies with linear computational complexity. While Mamba has shown competitive performance in medical image…

Image and Video Processing · Electrical Eng. & Systems 2025-02-05 Weiren Zhao , Feng Wang , Yanran Wang , Yutong Xie , Qi Wu , Yuyin Zhou

Deep learning has been extensively applied in medical image reconstruction, where Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) represent the predominant paradigms, each possessing distinct advantages and inherent…

We present PlainMamba: a simple non-hierarchical state space model (SSM) designed for general visual recognition. The recent Mamba model has shown how SSMs can be highly competitive with other architectures on sequential data and initial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Chenhongyi Yang , Zehui Chen , Miguel Espinosa , Linus Ericsson , Zhenyu Wang , Jiaming Liu , Elliot J. Crowley

Long sequence prediction is a key challenge in time series forecasting. While Mamba-based models have shown strong performance due to their sequence selection capabilities, they still struggle with insufficient focus on critical time steps…

Machine Learning · Computer Science 2026-01-21 Wenbo Yan , Hanzhong Cao , Ying Tan

We apply deep learning (DL) on Magnetic resonance spectroscopy (MRS) data for the task of brain tumor detection. Medical applications often suffer from data scarcity and corruption by noise. Both of these problems are prominent in our data…

Machine Learning · Computer Science 2021-12-17 Diyuan Lu , Gerhard Kurz , Nenad Polomac , Iskra Gacheva , Elke Hattingen , Jochen Triesch

Whole Slide Images (WSIs) are high-resolution digital scans widely used in medical diagnostics. WSI classification is typically approached using Multiple Instance Learning (MIL), where the slide is partitioned into tiles treated as…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Sharon Peled , Yosef E. Maruvka , Moti Freiman

Infrared image super-resolution demands long-range dependency modeling and multi-scale feature extraction to address challenges such as homogeneous backgrounds, weak edges, and sparse textures. While Mamba-based state-space models (SSMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Yongsong Huang , Tomo Miyazaki , Xiaofeng Liu , Shinichiro Omachi

Whole-slide image classification represents a key challenge in computational pathology and medicine. Attention-based multiple instance learning (MIL) has emerged as an effective approach for this problem. However, the effect of attention…

Quantitative Methods · Quantitative Biology 2025-03-14 Rajiv Krishnakumar , Julien Baglio , Frederik F. Flöther , Christian Ruiz , Stefan Habringer , Nicole H. Romano

Mamba, with its selective State Space Models (SSMs), offers a more computationally efficient solution than Transformers for long-range dependency modeling. However, there is still a debate about its effectiveness in high-resolution 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Chaohan Wang , Yutong Xie , Qi Chen , Yuyin Zhou , Qi Wu

Abnormality detection in medical imaging is a critical task requiring both high efficiency and accuracy to support effective diagnosis. While convolutional neural networks (CNNs) and Transformer-based models are widely used, both face…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yao Wang , Dong Yang , Zhi Qiao , Wenjian Huang , Liuzhi Yang , Zhen Qian

Fine-grained classification of whole slide images (WSIs) is essential in precision oncology, enabling precise cancer diagnosis and personalized treatment strategies. The core of this task involves distinguishing subtle morphological…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Cheng Jin , Luyang Luo , Huangjing Lin , Jun Hou , Hao Chen

Food classification is the foundation for developing food vision tasks and plays a key role in the burgeoning field of computational nutrition. Due to the complexity of food requiring fine-grained classification, recent academic research…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Chi-Sheng Chen , Guan-Ying Chen , Dong Zhou , Di Jiang , Dai-Shi Chen

In computational pathology, random sampling of patches during training of Multiple Instance Learning (MIL) methods is computationally efficient and serves as a regularization strategy. Despite its promising benefits, questions concerning…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 H. Keshvarikhojasteh , J. P. W. Pluim , M. Veta

Histopathology image analysis is the golden standard of clinical diagnosis for Cancers. In doctors daily routine and computer-aided diagnosis, the Whole Slide Image (WSI) of histopathology tissue is used for analysis. Because of the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Honglin Li , Yunlong Zhang , Chenglu Zhu , Jiatong Cai , Sunyi Zheng , Lin Yang

With the evolution of large language models, traditional Transformer models become computationally demanding for lengthy sequences due to the quadratic growth in computation with respect to the sequence length. Mamba, emerging as a…

Machine Learning · Computer Science 2024-08-22 Haoran Xu , Ziqian Liu , Rong Fu , Zhongling Su , Zerui Wang , Zheng Cai , Zhilin Pei , Xingcheng Zhang

The vision-language tracking task aims to perform object tracking based on various modality references. Existing Transformer-based vision-language tracking methods have made remarkable progress by leveraging the global modeling ability of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Xinqi Liu , Li Zhou , Zikun Zhou , Jianqiu Chen , Zhenyu He

Transformers have widely adopted attention networks for sequence mixing and MLPs for channel mixing, playing a pivotal role in achieving breakthroughs across domains. However, recent literature highlights issues with attention networks,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Badri N. Patro , Vijay S. Agneeswaran

Multi-modal image fusion integrates complementary information from different modalities to produce enhanced and informative images. Although State-Space Models, such as Mamba, are proficient in long-range modeling with linear complexity,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Ke Cao , Xuanhua He , Tao Hu , Chengjun Xie , Man Zhou , Jie Zhang

State-space models (SSMs), particularly the Mamba architecture, have emerged as powerful alternatives to Transformers for sequence modeling, offering linear-time complexity and competitive performance across diverse tasks. However, their…

Machine Learning · Computer Science 2025-09-30 Ibne Farabi Shihab , Sanjeda Akter , Anuj Sharma