English
Related papers

Related papers: Beyond Attention Heatmaps: How to Get Better Expla…

200 papers

Prompt learning has emerged as a promising paradigm for adapting pre-trained vision-language models (VLMs) to few-shot whole slide image (WSI) classification by aligning visual features with textual representations, thereby reducing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Junjie Zhou , Wei Shao , Yagao Yue , Wei Mu , Peng Wan , Qi Zhu , Daoqiang Zhang

Multiple instance learning (MIL)-based framework has become the mainstream for processing the whole slide image (WSI) with giga-pixel size and hierarchical image context in digital pathology. However, these methods heavily depend on a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Jiangbo Shi , Chen Li , Tieliang Gong , Yefeng Zheng , Huazhu Fu

Multiple Instance Learning (MIL) is a sub-domain of classification problems with positive and negative labels and a "bag" of inputs, where the label is positive if and only if a positive element is contained within the bag, and otherwise is…

Machine Learning · Statistics 2023-10-30 Edward Raff , James Holt

We provide in this paper a comprehensive comparison of various transfer learning strategies and deep learning architectures for computer-aided classification of adult-type diffuse gliomas. We evaluate the generalizability of out-of-domain…

Human pose estimation - the process of recognizing human keypoints in a given image - is one of the most important tasks in computer vision and has a wide range of applications including movement diagnostics, surveillance, or self-driving…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Trung Q. Tran , Giang V. Nguyen , Daeyoung Kim

This paper analyzes the predictions of image captioning models with attention mechanisms beyond visualizing the attention itself. We develop variants of layer-wise relevance propagation (LRP) and gradient-based explanation methods, tailored…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Jiamei Sun , Sebastian Lapuschkin , Wojciech Samek , Alexander Binder

The development of vision-language models (VLMs) for histo-pathology has shown promising new usages and zero-shot performances. However, current approaches, which decompose large slides into smaller patches, focus solely on inductive…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Maxime Zanella , Fereshteh Shakeri , Yunshi Huang , Houda Bahig , Ismail Ben Ayed

In pathological research, education, and clinical practice, the decision-making process based on pathological images is critically important. This significance extends to digital pathology image analysis: its adequacy is demonstrated by the…

Image and Video Processing · Electrical Eng. & Systems 2024-08-19 Zhi-Bo Liu , Xiaobo Pang , Jizhao Wang , Shuai Liu , Chen Li

Deep learning methods have emerged as powerful tools for analyzing histopathological images, but current methods are often specialized for specific domains and software environments, and few open-source options exist for deploying models in…

Deep Learning has shown outstanding results in computer vision tasks; healthcare is no exception. However, there is no straightforward way to expose the decision-making process of DL models. Good accuracy is not enough for skin cancer…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Rosa Y. G. Paccotacya-Yanque , Alceu Bissoto , Sandra Avila

Pathological diagnosis remains the definitive standard for identifying tumors. The rise of multimodal large models has simplified the process of integrating image analysis with textual descriptions. Despite this advancement, the substantial…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Xiaomin Wu , Rui Xu , Pengchen Wei , Wenkang Qin , Peixiang Huang , Ziheng Li , Lin Luo

Explainability is key to enhancing artificial intelligence's trustworthiness in medicine. However, several issues remain concerning the actual benefit of explainable models for clinical decision-making. Firstly, there is a lack of consensus…

Image and Video Processing · Electrical Eng. & Systems 2023-12-18 Kazuma Kobayashi , Yasuyuki Takamizawa , Mototaka Miyake , Sono Ito , Lin Gu , Tatsuya Nakatsuka , Yu Akagi , Tatsuya Harada , Yukihide Kanemitsu , Ryuji Hamamoto

Multiple Instance Learning (MIL) is the leading approach for whole slide image (WSI) classification, enabling efficient analysis of gigapixel pathology slides. Recent work has introduced vision-language models (VLMs) into MIL pipelines to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Ngoc Bui Lam Quang , Nam Le Nguyen Binh , Thanh-Huy Nguyen , Le Thien Phuc Nguyen , Quan Nguyen , Ulas Bagci

Histopathological images (HIs) are the gold standard for evaluating some types of tumors for cancer diagnosis. The analysis of such images is not only time and resource consuming, but also very challenging even for experienced pathologists,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Jonathan de Matos , Steve Tsham Mpinda Ataky , Alceu de Souza Britto , Luiz Eduardo Soares de Oliveira , Alessandro Lameiras Koerich

Annotating cancerous regions in whole-slide images (WSIs) of pathology samples plays a critical role in clinical diagnosis, biomedical research, and machine learning algorithms development. However, generating exhaustive and accurate…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Zhenzhen Wang , Carla Saoud , Sintawat Wangsiricharoen , Aaron W. James , Aleksander S. Popel , Jeremias Sulam

Machine Learning (ML) is a fundamental part of modern perception systems. In the last decade, the performance of computer vision using trained deep neural networks has outperformed previous approaches based on careful feature engineering.…

Software Engineering · Computer Science 2021-03-03 Markus Borg , Ronald Jabangwe , Simon Åberg , Arvid Ekblom , Ludwig Hedlund , August Lidfeldt

Single-cell datasets often lack individual cell labels, making it challenging to identify cells associated with disease. To address this, we introduce Mixture Modeling for Multiple Instance Learning (MMIL), an expectation maximization…

Quantitative Methods · Quantitative Biology 2024-06-13 Erin Craig , Timothy Keyes , Jolanda Sarno , Maxim Zaslavsky , Garry Nolan , Kara Davis , Trevor Hastie , Robert Tibshirani

The visual examination of tissue biopsy sections is fundamental for cancer diagnosis, with pathologists analyzing sections at multiple magnifications to discern tumor cells and their subtypes. However, existing attention-based multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Olga Fourkioti , Matt De Vries , Chen Jin , Daniel C. Alexander , Chris Bakal

In computational pathology, multiple instance learning (MIL) is widely used to circumvent the computational impasse in giga-pixel whole slide image (WSI) analysis. It usually consists of two stages: patch-level feature extraction and…

Image and Video Processing · Electrical Eng. & Systems 2023-09-21 Beidi Zhao , Wenlong Deng , Zi Han , Li , Chen Zhou , Zuhua Gao , Gang Wang , Xiaoxiao Li

Computer vision models are increasingly capable of classifying ovarian epithelial cancer subtypes, but they differ from pathologists by processing small tissue patches at a single resolution. Multi-resolution graph models leverage the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-26 Jack Breen , Katie Allen , Kieran Zucker , Nicolas M. Orsi , Nishant Ravikumar