English
Related papers

Related papers: Bridging the Modality Bottleneck in Pathology MIL …

200 papers

Multiple Instance Learning (MIL) methods have succeeded remarkably in histopathology whole slide image (WSI) analysis. However, most MIL models only offer attention-based explanations that do not faithfully capture the model's decision…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Susu Sun , Dominique van Midden , Geert Litjens , Christian F. Baumgartner

Multiple instance learning (MIL) has become the leading approach for extracting discriminative features from whole slide images (WSIs) in computational pathology. Attention-based MIL methods can identify key patches but tend to overlook…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Lubin Gan , Xiaoman Wu , Jing Zhang , Zhifeng Wang , Linhao Qu , Siying Wu , Xiaoyan Sun

Segmenting tumors in histological images is vital for cancer diagnosis. While fully supervised models excel with pixel-level annotations, creating such annotations is labor-intensive and costly. Accurate histopathology image segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yinsheng He , Xingyu Li , Roger J. Zemp

Spatial transcriptomics (ST) enables gene expression mapping within anatomical context but remains costly and low-throughput. Hematoxylin and eosin (H\&E) staining offers rich morphology yet lacks molecular resolution. We present…

Histopathology and transcriptomics are fundamental modalities in oncology, encapsulating the morphological and molecular aspects of the disease. Multi-modal self-supervised learning has demonstrated remarkable potential in learning…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Tianyi Wang , Jianan Fan , Dingxin Zhang , Dongnan Liu , Yong Xia , Heng Huang , Weidong Cai

Multiple instance learning (MIL) is a key algorithm for classification of whole slide images (WSI). Histology WSIs can have billions of pixels, which create enormous computational and annotation challenges. Typically, such images are…

Image and Video Processing · Electrical Eng. & Systems 2021-11-03 Andriy Myronenko , Ziyue Xu , Dong Yang , Holger Roth , Daguang Xu

Hematoxylin and eosin (H&E)-stained slides are central to cancer diagnosis and monitoring, visualizing tissue architecture and cellular morphology. However, H&E lacks the molecular specificity needed to distinguish cell states and…

Image and Video Processing · Electrical Eng. & Systems 2026-04-14 Tushar Kataria , Beatrice Knudsen , Shireen Y. Elhabian

Understanding the way cells communicate, co-locate, and interrelate is essential to understanding human physiology. Hematoxylin and eosin (H&E) staining is ubiquitously available both for clinical studies and research. The Colon Nucleus…

Multi-instance learning (MIL) is widely used in the computer-aided interpretation of pathological Whole Slide Images (WSIs) to solve the lack of pixel-wise or patch-wise annotations. Often, this approach directly applies "natural image…

Multiple Instance Learning (MIL) has enabled weakly supervised analysis of whole-slide images (WSIs) in computational pathology. However, traditional MIL approaches often lose crucial contextual information, while transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Xitong Ling , Minxi Ouyang , Xiaoxiao Li , Jiawen Li , Ying Chen , Yuxuan Sun , Xinrui Chen , Tian Guan , Xiaoping Liu , Yonghong He

Supervised learning tasks such as cancer survival prediction from gigapixel whole slide images (WSIs) are a critical challenge in computational pathology that requires modeling complex features of the tumor microenvironment. These learning…

Image and Video Processing · Electrical Eng. & Systems 2022-11-22 Iain Carmichael , Andrew H. Song , Richard J. Chen , Drew F. K. Williamson , Tiffany Y. Chen , Faisal Mahmood

Whole-slide image analysis via the means of computational pathology often relies on processing tessellated gigapixel images with only slide-level labels available. Applying multiple instance learning-based methods or transformer models is…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Joshua Butke , Noriaki Hashimoto , Ichiro Takeuchi , Hiroaki Miyoshi , Koichi Ohshima , Jun Sakuma

Conventional hematoxylin-eosin (H&E) staining is limited to revealing cell morphology and distribution, whereas immunohistochemical (IHC) staining provides precise and specific visualization of protein activation at the molecular level.…

Image and Video Processing · Electrical Eng. & Systems 2024-07-30 Fuqiang Chen , Ranran Zhang , Boyun Zheng , Yiwen Sun , Jiahui He , Wenjian Qin

Hematoxylin and Eosin (H&E) staining is the cornerstone of histopathology but lacks molecular specificity. While Immunohistochemistry (IHC) provides molecular insights, it is costly and complex, motivating H&E-to-IHC translation as a…

Image and Video Processing · Electrical Eng. & Systems 2025-09-22 Erik Großkopf , Valay Bundele , Mehran Hosseinzadeh , Hendrik P. A. Lensch

Multiple instance learning (MIL) has enabled substantial progress in computational histopathology, where a large amount of patches from gigapixel whole slide images are aggregated into slide-level predictions. Heatmaps are widely used to…

Fine-grained classification of whole slide images (WSIs) is essential in precision oncology, enabling precise cancer diagnosis and personalized treatment strategies. The core of this task involves distinguishing subtle morphological…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Cheng Jin , Luyang Luo , Huangjing Lin , Jun Hou , Hao Chen

Whole Slide Images (WSI), obtained by high-resolution digital scanning of microscope slides at multiple scales, are the cornerstone of modern Digital Pathology. However, they represent a particular challenge to AI-based/AI-mediated analysis…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Martim Afonso , Praphulla M. S. Bhawsar , Monjoy Saha , Jonas S. Almeida , Arlindo L. Oliveira

Multiple Instance Learning (MIL) is widely used in analyzing histopathological Whole Slide Images (WSIs). However, existing MIL methods do not explicitly model the data distribution, and instead they only learn a bag-level or instance-level…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Linhao Qu , Xiaoyuan Luo , Shaolei Liu , Manning Wang , Zhijian Song

Multiple instance learning (MIL) can reduce the need for costly annotation in tasks such as semantic segmentation by weakening the required degree of supervision. We propose a novel MIL formulation of multi-class semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2015-04-16 Deepak Pathak , Evan Shelhamer , Jonathan Long , Trevor Darrell

Multiple Instance Learning (MIL) methods have become increasingly popular for classifying giga-pixel sized Whole-Slide Images (WSIs) in digital pathology. Most MIL methods operate at a single WSI magnification, by processing all the tissue…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Kevin Thandiackal , Boqi Chen , Pushpak Pati , Guillaume Jaume , Drew F. K. Williamson , Maria Gabrani , Orcun Goksel