English
Related papers

Related papers: Pixel-Level Explanation of Multiple Instance Learn…

200 papers

Multiple instance learning (MIL) is a powerful approach to classify whole slide images (WSIs) for diagnostic pathology. A fundamental challenge of MIL on WSI classification is to discover the \textit{critical instances} that trigger the bag…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Zhikang Wang , Yue Bi , Tong Pan , Xiaoyu Wang , Chris Bain , Richard Bassed , Seiya Imoto , Jianhua Yao , Jiangning Song

The interpretability of deep neural networks has become a subject of great interest within the medical and healthcare domain. This attention stems from concerns regarding transparency, legal and ethical considerations, and the medical…

Image and Video Processing · Electrical Eng. & Systems 2023-11-20 Mahbub Ul Alam , Jaakko Hollmén , Jón Rúnar Baldvinsson , Rahim Rahmani

Deep learning methods are widely used for medical applications to assist medical doctors in their daily routines. While performances reach expert's level, interpretability (highlight how and what a trained model learned and why it makes a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Antoine Pirovano , Hippolyte Heuberger , Sylvain Berlemont , Saïd Ladjal , Isabelle Bloch

The task of identifying multimodal image-text representations has garnered increasing attention, particularly with models such as CLIP (Contrastive Language-Image Pretraining), which demonstrate exceptional performance in learning complex…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Zhiyu Zhu , Zhibo Jin , Jiayu Zhang , Nan Yang , Jiahao Huang , Jianlong Zhou , Fang Chen

In-Context Learning (ICL) empowers Large Language Models (LLMs) for rapid task adaptation without Fine-Tuning (FT), but its reliance on demonstration selection remains a critical challenge. While many-shot ICL shows promising performance…

Computation and Language · Computer Science 2025-06-06 Jianfei Zhang , Bei Li , Jun Bai , Rumei Li , Yanmeng Wang , Chenghua Lin , Wenge Rong

Early detection of cancers has been much explored due to its paramount importance in biomedical fields. Among different types of data used to answer this biological question, studies based on T cell receptors (TCRs) are under recent…

Machine Learning · Statistics 2022-08-10 Younghoon Kim , Tao Wang , Danyi Xiong , Xinlei Wang , Seongoh Park

Deep learning based approaches to Computer Aided Diagnosis (CAD) typically pose the problem as an image classification (Normal or Abnormal) problem. These systems achieve high to very high accuracy in specific disease detection for which…

Computer Vision and Pattern Recognition · Computer Science 2020-10-06 Aniket Joshi , Gaurav Mishra , Jayanthi Sivaswamy

Multimodal language models (MLMs) show promise for clinical decision support and diagnostic reasoning, raising the prospect of end-to-end automated medical image interpretation. However, clinicians are highly selective in adopting AI tools;…

Artificial Intelligence · Computer Science 2025-08-06 Mahtab Bigverdi , Wisdom Ikezogwo , Kevin Zhang , Hyewon Jeong , Mingyu Lu , Sungjae Cho , Linda Shapiro , Ranjay Krishna

Medical image classification requires labeled, task-specific datasets which are used to train deep learning networks de novo, or to fine-tune foundation models. However, this process is computationally and technically demanding. In language…

In the ever-evolving field of Artificial Intelligence, a critical challenge has been to decipher the decision-making processes within the so-called "black boxes" in deep learning. Over recent years, a plethora of methods have emerged,…

Artificial Intelligence · Computer Science 2024-02-15 Karam Dawoud , Wojciech Samek , Peter Eisert , Sebastian Lapuschkin , Sebastian Bosse

There has been a recent push in making machine learning models more interpretable so that their performance can be trusted. Although successful, these methods have mostly focused on the deep learning methods while the fundamental…

Machine Learning · Computer Science 2022-06-16 David Steinmann , Matej Zečević , Devendra Singh Dhami , Kristian Kersting

In mission-critical domains such as law enforcement and medical diagnosis, the ability to explain and interpret the outputs of deep learning models is crucial for ensuring user trust and supporting informed decision-making. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Bharat Chandra Yalavarthi , Nalini Ratha

Numerous explanation methods have been recently developed to interpret the decisions made by deep neural network (DNN) models. For image classifiers, these methods typically provide an attribution score to each pixel in the image to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Ruo Yang , Binghui Wang , Mustafa Bilgic

Predicting breast cancer recurrence risk is a critical clinical challenge. This study investigates the potential of computational pathology to stratify patients using deep learning on routine Hematoxylin and Eosin (H&E) stained whole-slide…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Jinqiu Chen , Huyan Xu

The deployment of vision-language models (VLMs) in dermatology is hindered by the trilemma of high computational costs, extreme data scarcity, and the black-box nature of deep learning. To address these challenges, we present SkinCLIP-VL, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhixiang Lu , Shijie Xu , Kaicheng Yan , Xuyue Cai , Chong Zhang , Yulong Li , Angelos Stefanidis , Anh Nguyen , Jionglong Su

Vision-language models (VLMs) are increasingly important in medical applications; however, their evaluation in dermatology remains limited by datasets that focus primarily on image-level classification tasks such as lesion recognition.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Abdurrahim Yilmaz , Ozan Erdem , Ece Gokyayla , Ayda Acar , Burc Bugra Dagtas , Dilara Ilhan Erdil , Gulsum Gencoglan , Burak Temelkuran

When we deploy machine learning models in high-stakes medical settings, we must ensure these models make accurate predictions that are consistent with known medical science. Inherently interpretable networks address this need by explaining…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Alina Jade Barnett , Fides Regina Schwartz , Chaofan Tao , Chaofan Chen , Yinhao Ren , Joseph Y. Lo , Cynthia Rudin

Multi-label image recognition aims to predict a set of labels that present in an image. The key to deal with such problem is to mine the associations between image contents and labels, and further obtain the correct assignments between…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Yanan Wu , Songhe Feng , Yang Wang

We present a clustering-based explainability technique for digital pathology models based on convolutional neural networks. Unlike commonly used methods based on saliency maps, such as occlusion, GradCAM, or relevance propagation, which…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Adam Bajger , Jan Obdržálek , Vojtěch Kůr , Rudolf Nenutil , Petr Holub , Vít Musil , Tomáš Brázdil

Recent advances in attention-based multiple instance learning (MIL) have improved our insights into the tissue regions that models rely on to make predictions in digital pathology. However, the interpretability of these approaches is still…

Quantitative Methods · Quantitative Biology 2023-09-11 Willem Bonnaffé , CRUK ICGC Prostate Group , Freddie Hamdy , Yang Hu , Ian Mills , Jens Rittscher , Clare Verrill , Dan J. Woodcock