English
Related papers

Related papers: Prompt-MIL: Boosting Multi-Instance Learning Schem…

200 papers

Although multiple instance learning (MIL) methods are widely used for automatic tumor detection on whole slide images (WSI), they suffer from the extreme class imbalance within the small tumor WSIs. This occurs when the tumor comprises only…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Ziyu Su , Mostafa Rezapour , Usama Sajjad , Shuo Niu , Metin Nafi Gurcan , Muhammad Khalid Khan Niazi

Weakly-supervised temporal action localization aims to localize and recognize actions in untrimmed videos with only video-level category labels during training. Without instance-level annotations, most existing methods follow the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Huan Ren , Wenfei Yang , Tianzhu Zhang , Yongdong Zhang

Machine learning models have become integral to many fields, but their reliability, defined as producing dependable, trustworthy, and domain-consistent predictions, remains a critical concern. Multiple Instance Learning (MIL) models…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Hassan Keshvarikhojasteh , Marc Aubreville , Christof A. Bertram , Josien P. W. Pluim , Mitko Veta

Multiple Instance Learning (MIL) is a weakly-supervised problem in which one label is assigned to the whole bag of instances. An important class of MIL models is instance-based, where we first classify instances and then aggregate those…

Image and Video Processing · Electrical Eng. & Systems 2024-03-13 Łukasz Struski , Dawid Rymarczyk , Arkadiusz Lewicki , Robert Sabiniewicz , Jacek Tabor , Bartosz Zieliński

The emergence of foundation models in computational pathology has transformed histopathological image analysis, with whole slide imaging (WSI) diagnosis being a core application. Traditionally, weakly supervised fine-tuning via multiple…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Jiawen Li , Jiali Hu , Qiehe Sun , Renao Yan , Minxi Ouyang , Tian Guan , Anjia Han , Chao He , Yonghong He

Multiple instance learning (MIL) has been successfully applied for whole slide images (WSIs) analysis in computational pathology, enabling a wide range of prediction tasks from tumor subtyping to inferring genetic mutations and multi-omics…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Junyu Li , Ye Zhang , Wen Shu , Xiaobing Feng , Yingchun Wang , Pengju Yan , Xiaolin Li , Chulin Sha , Min He

Whole Slide Imaging (WSI) has become a gold standard in cancer diagnosis, inspecting multi-scale information from cellular to tissue levels. Processing an entire WSI directly is infeasible due to GPU memory constraints; thus, Multiple…

Image and Video Processing · Electrical Eng. & Systems 2026-05-08 Tianyi Zhang , Sicheng Chen , Borui Kang , Dankai Liao , Qiaochu Xue , Bochong Zhang , Fei Xia , Zeyu Liu , Yueming Jin

Multiple instance learning (MIL) has been extensively applied to whole slide histopathology image (WSI) analysis. The existing aggregation strategy in MIL, which primarily relies on the first-order distance (e.g., mean difference) between…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Yihang Chen , Tsai Hor Chan , Guosheng Yin , Yuming Jiang , Lequan Yu

Integrating information from multiple modalities enhances the robustness of scene perception systems in autonomous vehicles, providing a more comprehensive and reliable sensory framework. However, the modality incompleteness in multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Ruiping Liu , Jiaming Zhang , Kunyu Peng , Yufan Chen , Ke Cao , Junwei Zheng , M. Saquib Sarfraz , Kailun Yang , Rainer Stiefelhagen

Whole slide image (WSI) analysis heavily relies on multiple instance learning (MIL). While recent methods benefit from large-scale foundation models and advanced sequence modeling to capture long-range dependencies, they still struggle with…

Image and Video Processing · Electrical Eng. & Systems 2026-03-23 Lubin Gan , Jing Zhang , Heng Zhang , Xin Di , Zhifeng Wang , Wenke Huang , Xiaoyan Sun

We propose Spatial-Aware Correlated Multiple Instance Learning (SAC-MIL) for performing WSI classification. SAC-MIL consists of a positional encoding module to encode position information and a SAC block to perform full instance…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Yu Bai , Zitong Yu , Haowen Tian , Xijing Wang , Shuo Yan , Lin Wang , Honglin Li , Xitong Ling , Bo Zhang , Zheng Zhang , Wufan Wang , Hui Gao , Xiangyang Gong , Wendong Wang

Prediction of genetic biomarkers, e.g., microsatellite instability and BRAF in colorectal cancer is crucial for clinical decision making. In this paper, we propose a whole slide image (WSI) based genetic biomarker prediction method via…

Image and Video Processing · Electrical Eng. & Systems 2024-07-16 Ling Zhang , Boxiang Yun , Xingran Xie , Qingli Li , Xinxing Li , Yan Wang

Weakly-supervised classification of histopathology slides is a computationally intensive task, with a typical whole slide image (WSI) containing billions of pixels to process. We propose Discriminative Region Active Sampling for Multiple…

Image and Video Processing · Electrical Eng. & Systems 2023-02-23 Jack Breen , Katie Allen , Kieran Zucker , Geoff Hall , Nicolas M. Orsi , Nishant Ravikumar

Whole Slide Images (WSI), obtained by high-resolution digital scanning of microscope slides at multiple scales, are the cornerstone of modern Digital Pathology. However, they represent a particular challenge to AI-based/AI-mediated analysis…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Martim Afonso , Praphulla M. S. Bhawsar , Monjoy Saha , Jonas S. Almeida , Arlindo L. Oliveira

Pre-trained vision-language models (VLMs) have shown remarkable generalization capabilities via prompting, which leverages VLMs as knowledge bases to extract information beneficial for downstream tasks. However, existing methods primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Xiaoyu Qiu , Hao Feng , Yuechen Wang , Wengang Zhou , Houqiang Li

The expensive fine-grained annotation and data scarcity have become the primary obstacles for the widespread adoption of deep learning-based Whole Slide Images (WSI) classification algorithms in clinical practice. Unlike few-shot learning…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Kexue Fu , Xiaoyuan Luo , Linhao Qu , Shuo Wang , Ying Xiong , Ilias Maglogiannis , Longxiang Gao , Manning Wang

Deep learning offers transformative potential in medical imaging, yet its clinical adoption is frequently hampered by challenges such as data scarcity, distribution shifts, and the need for robust task generalization. Prompt-based…

Image and Video Processing · Electrical Eng. & Systems 2025-07-03 Hao Yang , Xinlong Liang , Zhang Li , Yue Sun , Zheyu Hu , Xinghe Xie , Behdad Dashtbozorg , Jincheng Huang , Shiwei Zhu , Luyi Han , Jiong Zhang , Shanshan Wang , Ritse Mann , Qifeng Yu , Tao Tan

Large Multimodal Models (LMMs) have made significant breakthroughs with the advancement of instruction tuning. However, while existing models can understand images and videos at a holistic level, they still struggle with instance-level…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Wujian Peng , Lingchen Meng , Yitong Chen , Yiweng Xie , Yang Liu , Tao Gui , Hang Xu , Xipeng Qiu , Zuxuan Wu , Yu-Gang Jiang

Multiple instance learning (MIL) has emerged as the dominant paradigm for whole slide image (WSI) analysis in computational pathology, achieving strong diagnostic performance through patch-level feature aggregation. However, existing MIL…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Yiran Song , Yikai Zhang , Shuang Zhou , Guojun Xiong , Xiaofeng Yang , Nian Wang , Fenglong Ma , Rui Zhang , Mingquan Lin

Deploying digital pathology models across medical centers is challenging due to distribution shifts. Recent advances in domain generalization improve model transferability in terms of aggregated performance measured by the Area Under Curve…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Arthur Pignet , John Klein , Genevieve Robin , Antoine Olivier