English
Related papers

Related papers: MambaMIL: Enhancing Long Sequence Modeling with Se…

200 papers

Accurate microscopic medical image segmentation plays a crucial role in diagnosing various cancerous cells and identifying tumors. Driven by advancements in deep learning, convolutional neural networks (CNNs) and transformer-based models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Daniya Najiha Abdul Kareem , Abdul Hannan , Mubashir Noman , Jean Lahoud , Mustansar Fiaz , Hisham Cholakkal

In this paper, we consider the design of Model Predictive Control (MPC) algorithms based on Mamba neural networks. Mamba is a neural network architecture capable of sub-quadratic computational scaling in sequence length with…

Optimization and Control · Mathematics 2026-04-16 Michiel Cevaal , Thomas de Jong , Mircea Lazar

We introduce Multi-scale Adaptive Recurrent Biomedical Linear-time Encoder (MARBLE), the first \textit{purely Mamba-based} multi-state multiple instance learning (MIL) framework for whole-slide image (WSI) analysis. MARBLE processes…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Jagan Mohan Reddy Dwarampudi , Joshua Wong , Hien Van Nguyen , Tania Banerjee

In the era of large-scale pre-trained models, effectively adapting general knowledge to specific affective computing tasks remains a challenge, particularly regarding computational efficiency and multimodal heterogeneity. While…

Artificial Intelligence · Computer Science 2026-03-20 Yan Li , Yifei Xing , Xiangyuan Lan , Xin Li , Haifeng Chen , Dongmei Jiang

Effective reasoning is crucial to solving complex mathematical problems. Recent large language models (LLMs) have boosted performance by scaling test-time computation through long chain-of-thought reasoning. However, transformer-based…

Machine Learning · Computer Science 2025-09-10 Junxiong Wang , Wen-Ding Li , Daniele Paliotta , Daniel Ritter , Alexander M. Rush , Tri Dao

Multiple Instance Learning is the predominant method for Whole Slide Image classification in digital pathology, enabling the use of slide-level labels to supervise model training. Although MIL eliminates the tedious fine-grained annotation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Chen Shu , Boyu Fu , Yiman Li , Ting Yin , Wenchuan Zhang , Jie Chen , Yuhao Yi , Hong Bu

Multiple Instance Learning (MIL) has demonstrated promise in Whole Slide Image (WSI) classification. However, a major challenge persists due to the high computational cost associated with processing these gigapixel images. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Hongyi Wang , Luyang Luo , Fang Wang , Ruofeng Tong , Yen-Wei Chen , Hongjie Hu , Lanfen Lin , Hao Chen

Multi-instance learning (MIL) is a form of weakly supervised learning where a single class label is assigned to a bag of instances while the instance-level labels are not available. Training classifiers to accurately determine the bag label…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Bin Li , Kevin W. Eliceiri

Sequential recommendation aims to estimate the dynamic user preferences and sequential dependencies among historical user behaviors. Although Transformer-based models have proven to be effective for sequential recommendation, they suffer…

Information Retrieval · Computer Science 2024-07-02 Chengkai Liu , Jianghao Lin , Jianling Wang , Hanzhou Liu , James Caverlee

Multimodal large language models (MLLMs) have attracted widespread interest and have rich applications. However, the inherent attention mechanism in its Transformer structure requires quadratic complexity and results in expensive…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Yanyuan Qiao , Zheng Yu , Longteng Guo , Sihan Chen , Zijia Zhao , Mingzhen Sun , Qi Wu , Jing Liu

Multiple Instance Learning (MIL) has become the predominant approach for classification tasks on gigapixel histopathology whole slide images (WSIs). Within the MIL framework, single WSIs (bags) are decomposed into patches (instances), with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Daniel Sens , Ario Sadafi , Francesco Paolo Casale , Nassir Navab , Carsten Marr

Despite the significant achievements of Vision Transformers (ViTs) in various vision tasks, they are constrained by the quadratic complexity. Recently, State Space Models (SSMs) have garnered widespread attention due to their global…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Yuheng Shi , Minjing Dong , Chang Xu

In recent years, Visual Question Localized-Answering in robotic surgery (Surgical-VQLA) has gained significant attention for its potential to assist medical students and junior doctors in understanding surgical scenes. Recently, the rapid…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Pengfei Hao , Hongqiu Wang , Shuaibo Li , Zhaohu Xing , Guang Yang , Kaishun Wu , Lei Zhu

Computational pathology holds substantial promise for improving diagnosis and guiding treatment decisions. Recent pathology foundation models enable the extraction of rich patch-level representations from large-scale whole-slide images…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Xiangde Luo , Jinxi Xiang , Yuanfeng Ji , Ruijiang Li

Multi-modal object Re-IDentification (ReID) aims to retrieve specific objects by utilizing complementary image information from different modalities. Recently, large-scale pre-trained models like CLIP have demonstrated impressive…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuhao Wang , Xuehu Liu , Tianyu Yan , Yang Liu , Aihua Zheng , Pingping Zhang , Huchuan Lu

A high-performance image compression algorithm is crucial for real-time information transmission across numerous fields. Despite rapid progress in image compression, computational inefficiency and poor redundancy modeling still pose…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Fanhu Zeng , Hao Tang , Yihua Shao , Siyu Chen , Ling Shao , Yan Wang

Current automatic speech recognition systems struggle with modeling long speech sequences due to high quadratic complexity of Transformer-based models. Selective state space models such as Mamba has performed well on long-sequence modeling…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-30 Xiaoxue Gao , Nancy F. Chen

Decision Transformer, a promising approach that applies Transformer architectures to reinforcement learning, relies on causal self-attention to model sequences of states, actions, and rewards. While this method has shown competitive…

Machine Learning · Computer Science 2024-04-01 Toshihiro Ota

Surgical phase recognition is crucial for enhancing the efficiency and safety of computer-assisted interventions. One of the fundamental challenges involves modeling the long-distance temporal relationships present in surgical videos.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Rui Cao , Jiangliu Wang , Yun-Hui Liu

Mamba has attracted widespread interest as a general-purpose sequence model due to its low computational complexity and competitive performance relative to transformers. However, its performance can degrade when inference sequence lengths…

Machine Learning · Computer Science 2026-03-16 Jan Rathjens , Robin Schiewer , Laurenz Wiskott , Anand Subramoney