English
Related papers

Related papers: Towards Concept-based Interpretability of Skin Les…

200 papers

Artificial Intelligence models have demonstrated significant success in diagnosing skin diseases, including cancer, showing the potential to assist clinicians in their analysis. However, the interpretability of model predictions must be…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Max Torop , Masih Eskandar , Nicholas Kurtansky , Jinyang Liu , Jochen Weber , Octavia Camps , Veronica Rotemberg , Jennifer Dy , Kivanc Kose

To increase the transparency of modern computer-aided diagnosis (CAD) systems for assessing the malignancy of lung nodules, an interpretable model based on applying the generalized additive models and the concept-based learning is proposed.…

Image and Video Processing · Electrical Eng. & Systems 2024-05-29 Rinat I. Dumaev , Sergei A. Molodyakov , Lev V. Utkin

Machine learning models that first learn a representation of a domain in terms of human-understandable concepts, then use it to make predictions, have been proposed to facilitate interpretation and interaction with models trained on…

Machine Learning · Computer Science 2020-12-08 Isaac Lage , Finale Doshi-Velez

Although explainability is essential in the clinical diagnosis, most deep learning models still function as black boxes without elucidating their decision-making process. In this study, we investigate the explainable model development that…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Yunhe Gao , Difei Gu , Mu Zhou , Dimitris Metaxas

Deep neural networks have demonstrated promising performance on image recognition tasks. However, they may heavily rely on confounding factors, using irrelevant artifacts or bias within the dataset as the cue to improve performance. When a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Siyuan Yan , Zhen Yu , Xuelin Zhang , Dwarikanath Mahapatra , Shekhar S. Chandra , Monika Janda , Peter Soyer , Zongyuan Ge

A key issue in critical contexts such as medical diagnosis is the interpretability of the deep learning models adopted in decision-making systems. Research in eXplainable Artificial Intelligence (XAI) is trying to solve this issue. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Carlo Metta , Andrea Beretta , Riccardo Guidotti , Yuan Yin , Patrick Gallinari , Salvatore Rinzivillo , Fosca Giannotti

Decision-making processes in healthcare can be highly complex and challenging. Machine Learning tools offer significant potential to assist in these processes. However, many current methodologies rely on complex models that are not easily…

Artificial Intelligence · Computer Science 2025-03-24 Alessio Cascione , Mattia Setzu , Federico A. Galatolo , Mario G. C. A. Cimino , Riccardo Guidotti

Automatic lesion analysis is critical in skin cancer diagnosis and ensures effective treatment. The computer aided diagnosis of such skin cancer in dermoscopic images can significantly reduce the clinicians workload and help improve…

Image and Video Processing · Electrical Eng. & Systems 2023-01-18 Shubham Innani , Prasad Dutande , Bhakti Baheti , Ujjwal Baid , Sanjay Talbar

In practice, many medical datasets have an underlying taxonomy defined over the disease label space. However, existing classification algorithms for medical diagnoses often assume semantically independent labels. In this study, we aim to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Zhen Yu , Toan Nguyen , Yaniv Gal , Lie Ju , Shekhar S. Chandra , Lei Zhang , Paul Bonnington , Victoria Mar , Zhiyong Wang , Zongyuan Ge

Concept-based approaches, which aim to identify human-understandable concepts within a model's internal representations, are a promising method for interpreting embeddings from deep neural network models, such as CLIP. While these…

Machine Learning · Computer Science 2025-06-18 Jitian Zhao , Chenghui Li , Frederic Sala , Karl Rohe

Language models~(LMs) gradually become general-purpose interfaces in the interactive and embodied world, where the understanding of physical concepts is an essential prerequisite. However, it is not yet clear whether LMs can understand…

Computation and Language · Computer Science 2023-05-24 Lei Li , Jingjing Xu , Qingxiu Dong , Ce Zheng , Qi Liu , Lingpeng Kong , Xu Sun

Transformer-based CLIP models are widely used for text-image probing and feature extraction, making it relevant to understand the internal mechanisms behind their predictions. While recent works show that Sparse Autoencoders (SAEs) yield…

Machine Learning · Computer Science 2025-05-27 Maximilian Dreyer , Lorenz Hufe , Jim Berend , Thomas Wiegand , Sebastian Lapuschkin , Wojciech Samek

Explainable AI consists in developing mechanisms allowing for an interaction between decision systems and humans by making the decisions of the formers understandable. This is particularly important in sensitive contexts like in the medical…

Image and Video Processing · Electrical Eng. & Systems 2023-02-08 Carlo Metta , Riccardo Guidotti , Yuan Yin , Patrick Gallinari , Salvatore Rinzivillo

Annotated images and ground truth for the diagnosis of rare and novel diseases are scarce. This is expected to prevail, considering the small number of affected patient population and limited clinical expertise to annotate images. Further,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Karthik Desingu , Mirunalini P. , Aravindan Chandrabose

Multiple Instance Learning (MIL) methods allow for gigapixel Whole-Slide Image (WSI) analysis with only slide-level annotations. Interpretability is crucial for safely deploying such algorithms in high-stakes medical domains. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Susu Sun , Leslie Tessier , Frédérique Meeuwsen , Clément Grisi , Dominique van Midden , Geert Litjens , Christian F. Baumgartner

Accurate classification of focal liver lesions is crucial for diagnosis and treatment in hepatology. However, traditional supervised deep learning models depend on large-scale annotated datasets, which are often limited in medical imaging.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Song Jian , Hu Yuchang , Wang Hui , Chen Yen-Wei

The emergence of vision-language models (VLMs) has opened new possibilities for clinical reasoning and has shown promising performance in dermatological diagnosis. However, their trustworthiness and clinical utility are often limited by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Zehao Liu , Wejieying Ren , Jipeng Zhang , Tianxiang Zhao , Jingxi Zhu , Xiaoting Li , Vasant G. Honavar

Objective: This work addresses two key problems of skin lesion classification. The first problem is the effective use of high-resolution images with pretrained standard architectures for image classification. The second problem is the high…

Computer Vision and Pattern Recognition · Computer Science 2019-05-10 Nils Gessert , Thilo Sentker , Frederic Madesta , Rüdiger Schmitz , Helge Kniep , Ivo Baltruschat , René Werner , Alexander Schlaefer

Concept-based machine learning methods have increasingly gained importance due to the growing interest in making neural networks interpretable. However, concept annotations are generally challenging to obtain, making it crucial to leverage…

Machine Learning · Computer Science 2024-11-06 Alba Carballo-Castro , Sonia Laguna , Moritz Vandenhirtz , Julia E. Vogt

Large-scale vision-language models such as CLIP have achieved remarkable success in zero-shot image recognition, yet their predictions remain largely opaque to human understanding. In contrast, Concept Bottleneck Models provide…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Onat Ozdemir , Anders Christensen , Stephan Alaniz , Zeynep Akata , Emre Akbas